Senior Data Engineer

Company

Corrily (Y Combinator W21) helps companies optimize prices and discounts using ML. Our optimizer tests different price points to study their impact on revenue and other downstream metrics. We segment users based on their characteristics such as their location and usage patterns to make sure a director in the US and a student in India aren't offered the same price or discount.

In less than 6 months the company has gone from an idea to a revenue-generating product used by household names in tech including Linktree, IFTTT and Skillshare, among others.

We are now looking to hire a senior data engineer to join a very strong technical team and build together a system that will help power the world's prices.

Team

• Technical founders. Our founders are ex-BlackRock quants and startup veterans focused on building cutting-edge products that people want.
• Small team of senior engineers. You will get to work with ex-founders, ex-Yandex, ex-Avito engineers and talented data-scientists. We made a conscious decision to keep the team small and exceptional.
• Scrappy. We are problem solvers at heart. Our sales automation is being run from an old laptop under the CEO's couch. We like to accomplish as much as possible with as little resources as possible.
• International. No two employees at Corrily are in, or from, the same country - or even in the same timezone. We are in Taiwan, Russia, the UK, Slovenia, Spain, the US, ... The average Corrily employee speaks 3.5 languages. We're constantly traveling.
• Flat. We do not have hierarchies and our founders are strong believers in flat hierarchies and even almost launched a startup about it.
• Owners. Everyone at Corrily is an owner. Employees set their agendas and are expected to understand our clients and business and come up with creative solutions to meet their needs.

And we have cool benefits too!

• a generous equity package
• generous comp
• fully remote worldwide
• visa sponsorship where needed
• unlimited time off
• flexible hours
• healthcare where needed

Stack

Infrastructure: GCP fully handled via Terraform (K8s, BigTable, BigQuery, Cloud Run, Cloud Functions)

Databases: BigTable for everything latency-sensitive (we developed a library on top of it to make it easier to use), BigQuery for analytics tasks, Hasura w/ PostgreSQL back-end for configuration / user management

ML: Currently using multiple frameworks (PyTorch for tensor manipulation / legacy neural network models, Nevergrad for non-convex optimization, cvxpy for convex optimization, Pandas and Numpy for data manipulation). The ML stack evolves very quickly as we develop new versions of our optimizer.

Our mono repo is mostly written in Python but we are expecting to expand this in the near future.

Responsibilities

• Design ETL/ELT pipelines allowing for each client to provide their own definitions of concepts such as "active subscriber" or "MRR"
• Own data pipelines and infrastructure, optimizing for extensibility as opposed to performance
• Contribute to python data libraries to make it easy for clients to interact with our data
• Collaborate with data-scientists to make data accessible and provide valuable insights to clients
• Define and improve training pipelines
• Create checks and improve observability in data systems

Requirements

• Strong programming and algorithmic skills.
• Strong experience with data processing (such as DBT, Hadoop, Spark, Pig, Hive, MapReduce etc).
• Experience scoping ETL/ELT projects from day 0 all the way to completion.
• Solid Python skills.

During interviews we look for:

• Technical skills: A good candidate should be able to architect from scratch a new service with scale and maintainability at heart. Typically, candidates that we see perform well have in the past led personal or professional projects to completion. Open source development, curiosity in learning about new technologies, propensity to prefer practical solutions to hyped ones are all things we value.
• Proactivity: What makes the difference between a good candidate and a great one tends to be proactivity. Are you purely following tasks, or are you thinking through why you are doing things, thinking of better ways to go about it, and pushing things forward?
• Communication / Personality: Any hint of douchiness is a cause for rejection, regardless of technical skill. We strive to make sure we maintain a productive collaborative environment. We value candidates who can express complicated ideas simply and clearly.

How to apply

Email us at jobs [at] corrily.com