Yobi AI Logo

Yobi AI

Lead Data Engineer

Reposted 8 Days Ago
In-Office or Remote
2 Locations
Senior level
In-Office or Remote
2 Locations
Senior level
As Lead Data Engineer, you'll design data workflows, collaborate with teams to optimize data movement and modeling, ensuring efficiency and scalability for behavioral AI products.
The summary above was generated by AI

Yobi is a rapidly growing Behavioral AI company on a mission to ethically democratize the benefits of data and AI.

Since 2019, we have built one of the largest consented behavioral datasets in the United States, extending far beyond the walled gardens of Big Tech. Unlike traditional LLM companies, Yobi builds foundation models of human behavior grounded in real-world actions such as purchases and store visits.

Our private-by-design modeling enables state-of-the-art personalization and decisioning for leading brands and agencies while protecting privacy, safety, and ethics.

Today, we are focused on bringing the performance of closed-web user acquisition to the open web and connected TV, giving brands walled-garden results without the walls.

At our core, Yobi is building the behavioral intelligence layer for any system that makes a personalization decision.

Working at Yobi

We’re at an inflection point—customer adoption is accelerating, but there’s still room to shape the architecture and culture from the ground up. Engineers here own major surface areas, build 0→1 systems in large-scale data and model infrastructure, and help define how Behavioral AI scales ethically and effectively.

Highlights:

  • Well-funded with 5+ years of runway. At the same time, we are scaling revenue quickly and project to be breakeven in 2026.

  • Partnerships with Microsoft and Databricks

  • Fully remote or hybrid from several hubs (SF Bay Area, Seattle, NYC)

  • World-class team of Machine Learning experts who worked on cutting edge infra and recommender systems @ Amazon, Uber, Twitter, Meta, etc.

  • Product and Go-To-Market teams who have taken ideas from concept to 9 figure revenue streams

Benefits:

  • Competitive Base Salary

  • Meaningful equity & financial upside - a real % of the company

  • Annual bonus target based on personal and company performance

  • Health, Dental, Vision - most plans will pay little to 0 out of pocket

  • Unlimited PTO - we care about impact, not tracking days you’re out

  • 401k with company match %

About The Role

As the Lead Data Engineer at Yobi, you will be at the center of how data moves, scales, and powers our Behavioral AI products. You will be working on various virtual teams and projects, with an eye towards schema modeling, orchestration, abstractions, workload efficiency, reliability/observability, and so on. This is a hands-on engineering role.

What it takes to succeed in this role:
  • You think in systems. You’re comfortable designing data workflows that balance clarity, modularity, and performance.

  • You’re flexible and opinionated. You’re familiar with many different patterns for instrumenting data pipelines - push based, pull based, eventually consistent, 1 job per partition, batch, streaming, etc. and know when to reach for different patterns.

  • You’re ready to influence and lead, aligning other flexible and opinionated engineers from other domains on the right conventions, abstractions, and strategy in an ambiguous and evolving environment.

  • You have the hard skills. While we are big believers in “hire the person, not the specific language background”, our current data stack is Delta Lake, Scala Spark, Python Spark, and Airflow - it would be great if you have direct experience with at least some of these.

  • You sweat the details. Schema evolution, data contracts, dependency graphs, metadata tracking — you know these are what make data reliable at scale.

  • You’re pragmatic - you know when to polish and when to just ship.

  • You care about performance. Wall clock time matters for us. Cost also matters for us. We think in many projects, there are opportunities to win on both, with the right data engineering.

We prioritize attitude, culture, and general (technical) fit over matching perfectly into one of our job descriptions. If our mission and work resonates with you, we encourage you to apply. Tell us how you can help drive our products forward, even if you don’t feel like you are a perfect fit for some of the listings. 

Top Skills

Airflow
Delta Lake
Python Spark
Scala Spark

Similar Jobs

11 Days Ago
Remote or Hybrid
2 Locations
176K-201K Annually
Senior level
176K-201K Annually
Senior level
Fintech • Machine Learning • Payments • Software • Financial Services
The Lead Data Engineer will design, develop, and support cloud-based data solutions, lead Agile teams, and mentor engineers while utilizing various technologies including Java and Python.
Top Skills: AWSCassandraDatabricksEmrGCPGurobiHadoopHiveJavaKafkaMapreduceAzureMongodbMySQLPythonScalaSnowflakeSparkSQL
11 Days Ago
Easy Apply
Remote
USA
Easy Apply
185K-225K Annually
Senior level
185K-225K Annually
Senior level
Blockchain • Fintech • Social Media • Cryptocurrency • NFT • Web3
The Lead Data Engineer will design and build scalable data pipelines and infrastructure for trading analytics, overseeing data architecture and collaborating with cross-functional teams.
Top Skills: AirflowAWSAzureBigQueryDagsterDbtFlinkGCPGraphQLKafkaKinesisPrefectPythonRedshiftSnowflakeSQLTemporal
13 Days Ago
Easy Apply
Remote
United States
Easy Apply
147K-160K Annually
Senior level
147K-160K Annually
Senior level
Software
Lead the data strategy at Edmentum by designing scalable data pipelines, optimizing data systems, and mentoring junior engineers while ensuring compliance with data governance policies.
Top Skills: AWSAzureETLGCPHadoopPythonSparkSQL

What you need to know about the San Francisco Tech Scene

San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.

Key Facts About San Francisco Tech

  • Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Google, Apple, Salesforce, Meta
  • Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
  • Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
  • Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account