Biohub Logo

Biohub

Senior Staff Data Engineer

Posted Yesterday
Hybrid
Redwood City, CA, USA
270K-300K Annually
Senior level
Hybrid
Redwood City, CA, USA
270K-300K Annually
Senior level
Design and build petabyte-scale data pipelines for genomic and imaging data, transforming public and proprietary datasets into AI-ready training data. Develop agent-based curation and quality-control systems, data cataloging tools, and reliable observable infrastructure. Collaborate with AI researchers and scientists to define data requirements and integrate diverse biological datasets while addressing performance, bandwidth, scalability, and scientific correctness.
The summary above was generated by AI

Biohub is the first large-scale initiative bringing frontier AI models, massive compute, and frontier experimental capabilities under one roof. We're building a general-purpose system to accelerate scientific discovery, integrating frontier AI models, biological foundation models, and lab capabilities, with the ultimate goal of curing disease. Our technology powers scientists around the world, translating AI capabilities into tools that accelerate research everywhere.

The Team

Biohub is a 501(c)(3) biomedical research organization building the first large-scale scientific initiative combining frontier AI with frontier biology to solve disease. We build the technology to help scientists around the world use AI-powered biology to study how cells operate, organize, and work as part of systems to understand why disease happens and how to correct it. With our compute capacity, AI research and engineering, and state-of-the-art technology for measuring, imaging, and programming biology, we are enabling scientists worldwide to use AI-powered biology to advance our understanding of human health.

The Opportunity

The role is part of the Data Engineering team, which focuses on owning the strategy, sourcing and implementation for data supporting AI research and development. Our goal is to maximize the speed, agility, and capability of biological AI research by connecting public data resources and Biohub's experimental platforms to AI systems. The data that trains biological frontier models comes in dozens of modalities (sequences, images, spatial coordinates, time series, molecular structures, metadata, publication artifacts) each with its own noise characteristics, biases, and information content. The question of how to represent this data for learning is one of the most important open problems in biological AI.

As a Senior Staff Data Engineer at Biohub, you'll be designing systems that ingest data from public repositories, transform heterogeneous biological formats into AI-ready datasets, combine that with proprietary datasets, and deliver training datasets to researchers pushing the boundaries of what's possible in biological AI. The infrastructure you build will directly shape what our models can learn.

We're a small team with significant resources and long time horizons. We use AI tools aggressively in our own work—Claude Code, agents for workflow automation, LLMs for metadata extraction. We care about code quality, operational reliability, and building systems that scale. And we care about the biology: we want engineers who can recognize when a pipeline output is technically correct but scientifically wrong.

If you want to work at the intersection of large-scale infrastructure and frontier science, with real autonomy and the chance to build something genuinely new, we'd like to talk.

What You'll Do
  • Design and build data pipelines that process genomic and imaging data at petabyte scale
  • Solve performance and bandwidth challenges with creative engineering
  • Build agent-based systems for automated dataset curation, quality control, and workflow generation
  • Create tooling for data cataloging and registration that makes datasets discoverable and accessible
  • Collaborate with AI Research teams to translate model requirements into data specifications, and with our scientists to integrate public and internal data into large-scale ai-ready datasets 
  • Improve pipeline reliability and observability, working toward 99%+ success rates without manual intervention 
What You'll Bring
  • 12+ years of experience building reliable, operable data systems at petabyte scale
  • Strong software engineering fundamentals
  • Experience deploying distributed computing frameworks like Databricks, Spark, or Ray for large-scale data processing
  • Experience building and deploying large scale data platform solutions using infrastructure as code like Terraform or CDK
  • Experience with cloud infrastructure (AWS preferred) and on prem infrastructure
  • Comfort with ambiguity; ability to make progress when requirements are evolving
  • Interest in AI-native development practices and tooling
  • Nice to have: Background in computational biology, bioinformatics, or life sciences and experience with genomics datasets and formats (FASTQ, BAM, VCF) or imaging formats (OME-Zarr, HDF5)
Compensation
The anticipated base pay ranges for this role in Redwood City, CA and New York City, NY is $270,000–$300,000 annually for the Senior Staff level. New hires are typically hired into the lower portion of the range, enabling employee growth in the range over time. Actual placement in range is based on job-related skills and experience, as evaluated throughout the interview process. 

This position may be eligible to participate in Biohub's discretionary annual performance bonus program. Bonus eligibility and targets are determined in accordance with Biohub's total rewards philosophy and may vary by role.

Better Together

As we grow, we’re excited to strengthen in-person connections and cultivate a collaborative, team-oriented environment. This role is a hybrid position requiring you to be onsite for at least 60% of the working month, approximately 3 days a week, with specific in-office days determined by the team’s manager. The exact schedule will be at the hiring manager's discretion and communicated during the interview process.

Benefits for the Whole You 

We’re thankful to have an incredible team behind our work. To honor their commitment, we offer a wide range of benefits to support the people who make all we do possible. 

  • Provides a generous employer match on employee 401(k) contributions to support planning for the future.
  • Paid time off to volunteer at an organization of your choice. 
  • Funding for select family-forming benefits. 
  • Relocation support for employees who need assistance moving

If you’re interested in a role but your previous experience doesn’t perfectly align with each qualification in the job description, we still encourage you to apply as you may be the perfect fit for this or another role.

#LI-Hybrid #LI-Onsite

HQ

Biohub San Francisco, California, USA Office

San Francisco, CA, United States

Biohub Redwood, California, USA Office

Redwood, United States

Similar Jobs

One Month Ago
Remote or Hybrid
286K-392K Annually
Senior level
286K-392K Annually
Senior level
Fintech • Machine Learning • Payments • Software • Financial Services
Leads enterprise data engineering strategy and architecture for pipelines, external data sharing, and scalable data platforms. Designs and codes critical data solutions while driving adoption of modern technologies, governance, resiliency, operational excellence, and unified data architecture. Advises stakeholders, mentors engineers, recruits talent, evaluates emerging data and AI technologies, and develops platform roadmaps. The role requires hands-on expertise across AWS, lakehouse architecture, streaming, distributed computing, data warehousing, and multiple programming languages.
Top Skills: AgileAirflowAmazon RedshiftApache FlinkSparkAWSAws GlueCassandraDagsterDatabricksDynamoDBEmrJavaKafkaLakehouseMongoDBMonte CarloPythonScalaSnowflakeSplunkSQL
4 Days Ago
In-Office
229K-364K Annually
Senior level
229K-364K Annually
Senior level
Information Technology • Internet of Things
Build and operate scalable data infrastructure for personalized recommendations and music discovery. Responsibilities include streaming and batch pipelines, feature computation and serving, event logging, workflow orchestration, observability, data quality, and infrastructure as code across AWS and Snowflake. The role owns architecture and reliability, partners with ML, data, and product teams, leads technical design, and mentors engineers.
Top Skills: AirflowAWSDagsterDbtFirehoseFlinkGlueKafkaKinesisLambdaPythonS3SnowflakeTerraform
6 Days Ago
In-Office
200K-400K Annually
Senior level
200K-400K Annually
Senior level
Artificial Intelligence • Software
Build data lifecycle infrastructure for collecting, retaining, redacting, and deleting sensitive customer data. Responsibilities include PII and PHI detection, configurable retention policies, reliable deletion workflows, self-service APIs, LLM-backed anomaly detection, multimodal redaction, monitoring, auditability, and fault-tolerant systems at scale.
Top Skills: Ai AgentsAsynchronous ProcessingData PipelinesLlmsMonitoringMultimodal AiObservabilityPython

What you need to know about the San Francisco Tech Scene

San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.

Key Facts About San Francisco Tech

  • Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Google, Apple, Salesforce, Meta
  • Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
  • Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
  • Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account