Data Engineer at Whatnot (W20)
Livestream shopping platform and marketplace.
Remote
Full-time
3+ years
About Whatnot

Whatnot is a livestream shopping platform and marketplace where you can buy, sell, go live and geek out with collectors and other like-minded people.

We're focused on product categories that people are passionate about like Sports Cards, Pokemon Cards, NFTs, Sneakers and more.

Whatnot is the fastest growing marketplace ever in the United States and has raised $225M from YC, A16Z, Capital G and others.

About the role
Skills: Python, Data Warehousing, SQL, Distributed Systems, Software Architecture, Software Security, ETL, Data Modeling, Data Analytics

About Whatnot

Whatnot (YC W20) is a livestream shopping platform and marketplace backed by Andreessen Horowitz, CapitalG, and Y Combinator. We’re one of YC’s top companies and one of the fastest-growing marketplaces ever. We’re passionate about crafting an outstanding software company, team, and place to work.

Our mission: enable anyone to turn their passion into a business and bring people together through commerce. We’re building the future of eCommerce; an interactive community where creators can make a living off their passion.

Role

We are looking for a creative, passionate Data Engineer to come join the data team. We are a spirited, fast-paced team, and we're excited to have another motivated engineer help us lead and build some of the most important data systems at the company.

We're big believers in self-service and transparency. As a Data Engineer, you'll help support a wide variety of data products, both internal and external — you will lay the technical foundation for innovative data services working with some of the most exciting datasets available today.

Responsibilities

*Own and drive the architecture for the Data Warehouse. Solve all problems related to scaling the data warehouse ranging from analytical to machine learning use cases.

*Own our ETL/ELT strategy. Identify and make key decisions about how we should think about data ingestion and transformation, and implement the tools to make it happen.

*Contribute to the design and implementation of our cloud infrastructure. We're an entirely cloud-based company and team, and our environment grows more sophisticated as we scale. You will help craft best practices and rollouts to steer the direction of the team.

*Build internal and external data applications from data sources to API construction to client-side integration.

*Contribute to the design of data governance policies, and assist with the implementation that enforces and monitors them.

Requirements

As our next data engineer you should have 3+ years of experience, plus:

*Experience with, comfort using, and passion for Infrastructure-as-Code (Terraform, CloudFormation, Pulumi, etc.).

*Design and implementation experience with at least one of the major Cloud Data Warehouses (Snowflake, BigQuery, Redshift, etc.).

*Proven understanding of the cloud, and experience with at least one of the major cloud providers (AWS, GCP, Azure) and their associated standard methodologies (basic networking, authentication/authorization patterns, patterns for high-availability and fault-tolerance, etc.).

*Proficiency in at least one programming language (preferably Python, or Scala, Java, Go).

*Experience with batch and streaming design patterns and tools (Kinesis, Kafka).

*First hand knowledge of the latest ETL/ELT tooling and vendors (dbt, Airflow, Prefect, Fivetran, Segment, Stitch, etc...)

*An understanding of and appreciation for high-quality, well-tested, API driven software.

*Professionalism around collaborating in a remote working environment. Above average documentation and communication skills.

Compensation

Full-time and benefits (top-quality healthcare benefits, generous parental leave, unlimited vacation policy, lunch, internet & cell phone expensed, highly competitive compensation, equity)

Technology

Infrastructure: AWS, Kubernetes, Serverless

Databases: Postgres, DynamoDB, ElasticSearch, Redis

Backend: Python (Flask), Node, Elixir

Front-End React, GraphQL, Swift, Kotlin

Other jobs at Whatnot

fulltimeRemote - North AmericaFull StackAny (new grads ok)
fulltimeLos Angeles, CA / RemoteDevops3+ years
fulltimeSan Francisco, LA, NYC / RemoteFull Stack1+ years
fulltimeRemoteFull StackAny (new grads ok)
fulltimeRemoteFull Stack6+ years
fulltimeRemoteBackend3+ years
fulltimeRemote3+ years
fulltimeLos Angeles, CA or RemoteFull Stack
fulltimeLos Angeles, CA or RemoteFull Stack
fulltimeLos Angeles, CA or RemoteFull Stack
fulltimeLos Angeles / RemoteFull Stack6+ years
fulltimeLos Angeles, CA or Remote
fulltimeLos Angeles / Remote3+ years
fulltimeLos Angeles, CAFull Stack

Hundreds of YC startups are hiring on Work at a Startup.

Sign up to see more ›