About Eventual:
At Eventual (YC W22), we are building Daft, the open-source framework for processing complex data.
Data processing systems today are highly optimized for simple tabular data.
However, much of the useful data in the world is in a more complex form, such as media (e.g. images, video, audio), scientific formats (e.g. genomes), and ML artifacts (e.g. embeddings).
There are many challenges today that make processing complex data much more difficult than working with simple tabular data.
Our goal is to make working with complex data as easy as working with simple data, and become the de-facto solution for building applications on top of complex data.
You would be joining a small, fast-moving team of engineers with deep expertise across related domains: big data, distributed systems, machine learning, self-driving, genomics, and high performance computing.
About the role:
As a software engineering intern, your primary responsibilities would be contributing to the development of the open-source Daft distributed dataframe.
Development moves quickly here, but here are some projects you might expect to work on:
- Implementing algorithms on complex data types, such as embedding similarity or image kernels
- Improving performance of distributed join operations
- Building integrations for high-performance data loading
We are a young startup, so do be prepared to wear many hats - tinkering with infrastructure, talking to users, and participating in design processes with the team!
About you:
You will want to be comfortable working on a novel distributed data processing system. Some things that will be important are:
- Industry or research experience working with distributed systems, especially data-intensive systems such as Spark, Dask, or Ray.
- Experience with Arrow-based frameworks.
- Familiarity with Python or Rust.
- A strong sense of ownership and autonomy; a desire to build good systems for users.
Big nice to haves are:
- Experience working on production machine learning systems.
- Experience with compilers or query optimization.
Office and benefits:
Our office setup is hybrid remote, with three in-person days a week. We are in our San Francisco office Wednesday to Friday.
Eventual
