Jack & Jill AI Logo

Jack & Jill AI

Data Engineer ($170K – $220K + Equity) at Duckbill

Reposted 13 Days Ago
In-Office
San Jose, CA, USA
170K-220K Annually
Mid level
In-Office
San Jose, CA, USA
170K-220K Annually
Mid level
Build and maintain ETL pipelines and workflows to process cloud billing data. Design data storage systems and develop validation systems to ensure data quality.
The summary above was generated by AI

This is a job that Jill, our AI Recruiter, is recruiting for on behalf of one of our customers.


She will pick the best candidates from Jack's network

The next step is to speak to Jack.

Job Title: Data Engineer

Salary: $170K – $220K + Equity

Company Description: Duckbill - VC-backed SaaS platform for cloud financial data

Job Description:
Join a high-growth team building Skyway, a sophisticated platform designed to ingest and normalize complex cloud billing data for large enterprises. You will design scalable ETL pipelines, tackle massive semistructured datasets at scale, and own the data product end-to-end to help Fortune 500 clients make critical cloud financial decisions.

Location: San Francisco, USA

Why this role is remarkable:

  • Tackle massive technical challenges at scale by processing hundreds of millions of rows of complex cloud billing data using ClickHouse and Parquet.

  • Join a small, elite team of 12 people on the ground floor, backed by $7.75 million from top-tier investors Heavybit and Uncork Capital.

  • Build deep expertise in the rapidly growing field of cloud financial data while enjoying 100% company-paid healthcare premiums and a results-oriented culture.

What you will do:

  • Build and maintain high-performance ETL pipelines and Airflow workflows to process complex cloud billing data across multiple providers.

  • Design and optimize efficient data storage and retrieval systems using ClickHouse, S3, and advanced data modeling techniques.

  • Develop automated data validation and quality control systems using Python and SQL to ensure high-fidelity financial reporting for clients.

The ideal candidate:

  • 3+ years of experience building data products, warehouses, or ETL pipelines with a focus on data quality and scale.

  • Strong proficiency in Python and advanced SQL, including window functions, CTEs, and query optimization for OLAP datastores.

  • Proven ability to thrive in a fast-paced startup environment and a fastidious approach to managing evolving, semistructured data schemas.

Who are Jack & Jill?
Ok, I'll go first. I'm Jack, an AI that gets to know you on a quick call, learning what you're great at and what you want from your career. Then I help you land your dream job by finding unmissable opportunities as they come up, supporting you with applications, interview prep, and moral support.
And I'm Jill, an AI Recruiter who talks to companies to understand who they're looking to hire. Then I recruit from Jack's network, making an introduction when I spot an excellent candidate.

Next steps
Step 1. Visit our website.
Step 2. Click 'Talk to Jack'.
Step 3. Talk to Jack so he can understand your experience and ambitions.
Step 4. Jack will make sure Jill (the AI agent working for the company) considers you for this role.
Step 5. If Jill thinks you're a great fit and her client wants to meet you, they will make the introduction.
Step 6. If not, Jack will find you excellent alternatives. All for free.

We never post fake jobs
This isn't a trick. This is an open role that Jill is currently recruiting for from Jack's network.
Sometimes Jill's clients ask her to anonymize their jobs when she advertises them, which means she can't share all the details in the job description.
We appreciate this can make them look a bit suspect, but there isn't much we can do about it.
Give Jack a spin! You could land this role. If not, most people find him incredibly helpful with their job search, and we're giving his services away for free.

Similar Jobs

20 Days Ago
Hybrid
Redwood City, CA, USA
185K-240K Annually
Senior level
185K-240K Annually
Senior level
Healthtech • Software
As a Senior Data Engineer at Nimble, you will own the data platform, build and optimize data pipelines, ensure data compliance, and mentor team members, while collaborating across departments to enhance data accessibility and usage.
Top Skills: Ci/CdEmrIcebergJavaKinesisPysparkPythonS3Spring BootSQLTerraformTrino
5 Days Ago
In-Office
South San Francisco, CA, USA
191K-195K Annually
Mid level
191K-195K Annually
Mid level
Healthtech • Biotech
As a Data Engineer at Calico, you'll develop infrastructure for research data, collaborate on projects, mentor junior engineers, and ensure data governance.
Top Skills: AWSAzureFastapiGoogle Cloud PlatformKubernetesPythonReactSQLTerraform
15 Days Ago
In-Office
San Francisco, CA, USA
230K-310K Annually
Expert/Leader
230K-310K Annually
Expert/Leader
Artificial Intelligence • Software
As a Staff Data Engineer, you'll oversee Gamma's data infrastructure, architect scalable systems, mentor engineers, and drive strategic decisions for data usage across the organization.
Top Skills: Apache KafkaDbtPostgresSnowflakeTerraform

What you need to know about the San Francisco Tech Scene

San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.

Key Facts About San Francisco Tech

  • Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Google, Apple, Salesforce, Meta
  • Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
  • Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
  • Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account