About Whatnot
Whatnot (YC W20) is a livestream shopping platform and marketplace backed by Andreessen Horowitz, CapitalG, and Y Combinator. We’re one of YC’s top companies and one of the fastest-growing marketplaces ever. We’re passionate about crafting an outstanding software company, team, and place to work.
Our mission: enable anyone to turn their passion into a business and bring people together through commerce. We’re building the future of eCommerce; an interactive community where creators can make a living off their passion.
Role
We are looking for a creative, passionate Data Engineer to come join the data team. We are a spirited, fast-paced team, and we're excited to have another motivated engineer help us lead and build some of the most important data systems at the company.
We're big believers in self-service and transparency. As a Data Engineer, you'll help support a wide variety of data products, both internal and external — you will lay the technical foundation for innovative data services working with some of the most exciting datasets available today.
Responsibilities
*Own and drive the architecture for the Data Warehouse. Solve all problems related to scaling the data warehouse ranging from analytical to machine learning use cases.
*Own our ETL/ELT strategy. Identify and make key decisions about how we should think about data ingestion and transformation, and implement the tools to make it happen.
*Contribute to the design and implementation of our cloud infrastructure. We're an entirely cloud-based company and team, and our environment grows more sophisticated as we scale. You will help craft best practices and rollouts to steer the direction of the team.
*Build internal and external data applications from data sources to API construction to client-side integration.
*Contribute to the design of data governance policies, and assist with the implementation that enforces and monitors them.
Requirements
As our next data engineer you should have 3+ years of experience, plus:
*Experience with, comfort using, and passion for Infrastructure-as-Code (Terraform, CloudFormation, Pulumi, etc.).
*Design and implementation experience with at least one of the major Cloud Data Warehouses (Snowflake, BigQuery, Redshift, etc.).
*Proven understanding of the cloud, and experience with at least one of the major cloud providers (AWS, GCP, Azure) and their associated standard methodologies (basic networking, authentication/authorization patterns, patterns for high-availability and fault-tolerance, etc.).
*Proficiency in at least one programming language (preferably Python, or Scala, Java, Go).
*Experience with batch and streaming design patterns and tools (Kinesis, Kafka).
*First hand knowledge of the latest ETL/ELT tooling and vendors (dbt, Airflow, Prefect, Fivetran, Segment, Stitch, etc...)
*An understanding of and appreciation for high-quality, well-tested, API driven software.
*Professionalism around collaborating in a remote working environment. Above average documentation and communication skills.
Compensation
Full-time and benefits (top-quality healthcare benefits, generous parental leave, unlimited vacation policy, lunch, internet & cell phone expensed, highly competitive compensation, equity)
Whatnot
