Second Measure is building products that leverage de-identified transaction data to help companies better understand consumer spend behavior and propensities, and help investors understand companies’ performance, and consumer spend shifts. We apply advanced data science techniques on large, complex data sets to ensure the highest quality of data and insights.
As a senior data engineer at Second Measure, you will be a critical technical contributor in the team responsible for building, managing data pipelines, and enriching transaction data. Your architectural guidance will allow pipelines to run reliably, to process billions of transactions and to provide daily updates, so that our high value clients can formulate their marketing and investment strategies.
In this role, you’ll:
- Collaborate with data scientists to implement novel data corrections to the data.
- Partner with our product team to explore new ways of combining multiple types of data to gain better consumer insights.
- Develop high-quality new features (70% hands-on design/coding/development/delivery, 30% mentoring junior engineers on the team).
- Proactively identify and remove challenging performance bottlenecks.
About you:
- Proven track record (5+ years) delivering high-quality systems built using Spark, Hive, and Presto (along with Scala, Java and/or Python)
- Experience working with data pipelines, event-driven architecture
- Experience with container and orchestration frameworks (Docker, Kubernetes)
- Ability to identify Product MVPs and build fast
- Intolerance for sloppy code
- Solid understanding of Computer Science Fundamentals
Nice-to-have:
Experience building innovative solutions under flux and constraints
Understanding of FinTech systems
Familiarity with Terraform, Argo Workflows
Our Tech Stack/Development Tools:
S3, Hive Metastore, Spark, Presto, AWS SNS, SQS, EKS, ECR, Batch Terraform, Helm, Prometheus, Grafana, Go, Python, Scala, Redshift, Waggledance, Argo, Github, CircleCI, Docker
Have questions about why/how we use these? Let’s talk!
Working at Second Measure:
- Highly competitive compensation, systematized to promote fairness and break down traditional gender, race, and age pay gaps
- Comprehensive medical, dental, and vision benefits for employees and their families
- 401(k) with company matching - up to 4% of annual salary
- Unlimited paid time off and flexible work arrangements
- Generous paid parental leave
- Pre-tax FSAs and commuter benefits
- Life insurance, disability plans, and legal assistance
Note on Remote ability:
We are all working from home at least through 2020 to keep our team safe and healthy. We hope to (at some point) work from our San Mateo, CA HQ and NYC offices in some capacity in 2021 and it would be great if you are based in the Bay Area or NYC. That said, we are open to remote on a permanent basis, granted you would need to be based in one of the following states: AL, CA, CO, FL, IL, NJ, NY, or WA.
Second Measure
