Design, build, and operate high-throughput, fault-tolerant data ingestion and transformation pipelines and a lakehouse for large-scale ML training and inference. Ensure data quality, lineage, and versioning; partner with ML engineers on feature stores, dataset contracts, and performance optimization.
Headquartered in Silicon Valley, California, Archer is a leader in the next-gen aerospace sector building an end-to-end advanced air mobility platform that delivers air taxis, unmanned aircraft systems (“UAS”), aviation-related physical artificial intelligence (“AI”) solutions, and other technologies to customers worldwide across the commercial aerospace and defense sectors.
Our sights are set high and our problems are hard, and we believe that diversity in the workplace is what makes us smarter, drives better insights, and will ultimately lift us all to success. We are dedicated to cultivating an equitable and inclusive environment that embraces our differences, and supports and celebrates all of our team members.
Archer is best known for Midnight, our electric aircraft. This role isn't on that program. The AI Products Org is building software for the general aviation industry. As a Staff Data Engineer on the AI Platform team, you will design, build, and operate the data infrastructure that powers large-scale model training and inference. You will own the pipelines, storage systems, and data quality mechanisms that sit upstream of our ML platform, ensuring models train on clean, high-throughput, well-governed data.
What You’ll Do:
- Design and maintain high-throughput, fault-tolerant ingestion and transformation pipelines that feed training workloads at scale, with a focus on latency, throughput, and correctness.
- Build and operate the data lakehouse — defining table formats (Iceberg, Paimon, Parquet), partitioning strategies, and compaction policies optimized for ML consumption patterns.
- Instrument pipelines with data quality checks, lineage tracking, and anomaly detection so that model failures trace back to data problems quickly.
- Partner with ML engineers to define feature stores, dataset versioning, and experiment-to-production data contracts; integrate with tools like MLflow for dataset and artifact tracking.
- Work closely with AI researchers, platform engineers, and software engineers to understand data access patterns, optimize query performance, and unblock training runs.
What You Need:
- 5+ years of professional data engineering experience excluding internships.
- BS/MS/PhD in Computer Science, Data Engineering, Software Engineering, or a related field.
- Hands-on experience building production pipelines with tools like Apache Spark, Flink, Airflow, dbt, or similar batch/streaming frameworks.
- Deep proficiency with columnar formats (i.e. Parquet), open table formats (Apache Iceberg or Apache Paimon), and object storage systems (S3 or equivalent).
- Experience with high-throughput messaging systems such as Apache Pulsar or Kafka for real-time data ingestion.
- Strong SQL skills; experience with StarRocks for large-scale analytical queries and real-time analytics over the lakehouse.
- Familiarity with AWS data services (S3, Glue, EMR) and containerized workloads (Docker/Kubernetes) in production environments. Airflow/Prefect/Dagster
Bonus Qualifications:
- Experience with CDC (Change Data Capture) replication from transactional systems (i.e. PostgreSQL → Lakehouse via Debezium or Airbyte).
- Exposure to audio or time-series data pipelines, including preprocessing for ASR or speech model training.
- Prior experience in aerospace, aviation, or other safety-critical domains where data lineage and auditability are non-negotiable.
About The Team:
AI Products is a roughly 100-person software org inside a company of aerospace engineers, and we expect to grow substantially over the next year. You get the resources and momentum of a real org, but the products themselves are early — which means Data Engineers here get the kind of ownership that usually only exists at startups.
If you want to hear more about what we're building before you apply, you can't. Apply, and we'll tell you plenty.
At Archer we aim to attract, retain, and motivate talent that possess the skills and leadership necessary to grow our business. We drive a pay-for-performance culture and reward performance that supports the Company’s business strategy. For this position we are targeting a base pay between $175,00.00 - $215,000.00 . Actual compensation offered will be determined by factors such as job-related knowledge, skills, and experience.
Information collected and processed as part of any job applications you choose to submit is subject to Archer's Candidate Privacy Policy.Certain positions may be eligible for visa sponsorship.Archer is proud to be an Equal Opportunity employer committed to diversity and inclusivity in the workplace. All aspects of employment are decided on the basis of merit, qualifications, and business needs. We do not discriminate based upon race, color, religion, sex, sexual orientation, age, national origin, disability status, protected veteran status, gender identity or any other characteristic protected by federal, state or local laws.Archer Aviation does not engage with external recruiting agencies/individual recruiters with whom it does not have a prior written agreement. Archer reserves the right to make use of any unsolicited resumes that it receives and bears no responsibility for payment of any fees asserted from the use of unsolicited resumes. If you are a recruiting agency or individual recruiter wishing to do business with Archer, please reach out to [email protected]. All employment processes are managed by the Archer People Team.
Archer Aviation San Jose, California, USA Office
San Jose, CA, United States
Archer Aviation Mountain View, California, USA Office
1090 Terra Bella, Mountain View, United States
Similar Jobs
Legal Tech • Software • Generative AI
Staff Data Engineer will set technical direction and build Eve’s scalable data platform. Responsibilities include Snowflake administration, role-based access, governance, ingestion, dbt modeling and orchestration, Terraform infrastructure, observability, schema change detection, reliability practices, and CI standards. The role also mentors engineers and analysts, supports AI-assisted development, and establishes secure, reliable workflows for product, case, customer, and go-to-market data.
Top Skills:
AirflowClaude CodeDbtFivetranGithub ActionsMcp ServersPythonSnowflakeSnowflake CortexSQLTerraform
Fintech • Real Estate • Sales • Financial Services
Architects and evolves enterprise-scale batch, real-time, and event-driven data platforms and pipelines. Leads data modeling, distributed processing, data quality, governance, observability, CI/CD, security, monitoring, incident response, and cost optimization. Provides technical direction across hybrid cloud environments, mentors engineers, leads critical initiatives and code reviews, manages technical debt, evaluates new technologies, and partners with business and technical stakeholders. Participates in on-call rotations and supports distributed and offshore engineering teams.
Top Skills:
AirflowAPIsAutomated TestingAws LambdaBatch ProcessingCi/CdCloud ServicesDagsterData GovernanceData QualityData WarehousesDevOpsDimensional Data ModelingEltETLLinuxMonitoringNetworkingNon-Relational DatabasesObservabilityPower BIPrefectPythonReal-Time Data PipelinesRelational DatabasesShell ScriptingSnowflakeSQLStreamingTabular Data ModelingWorkflow Orchestration
eCommerce • Information Technology • Sharing Economy • Software
Build and maintain ELT pipelines, data models, semantic layers, and personalization signals for client retention and marketing tests. Partner with machine learning, product, marketing, design, and architecture teams to prepare predictive data, connect signals to CRM channels, support real-time event processing, and document a scalable data foundation. Use AI coding assistants daily to accelerate development, testing, and reviews in a fast-moving discovery environment.
Top Skills:
AirflowBigQueryClaude CodeCursorDbtFivetranGithub CopilotJavaKafkaKinesisLookerModePythonRedshiftScalaSnowflakeSQLTableau
What you need to know about the San Francisco Tech Scene
San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.
Key Facts About San Francisco Tech
- Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Google, Apple, Salesforce, Meta
- Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
- Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
- Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine
