The Data Platform Tech Lead (Architect) is responsible for building and scaling a cloud-native data platform, leading architectural efforts, and enabling analytics for manufacturing data. The role requires collaboration with cross-functional teams and driving projects from conception to completion.
Manufacturing advanced electronics requires understanding millions of signals generated across complex assembly processes. Instrumental builds systems that capture and analyze those signals — images, test results, and process data — enabling engineers to discover failures, identify root causes, and deploy production controls that improve yield and product maturity. Leading companies such as NVIDIA, Cisco, and Meta rely on Instrumental to accelerate new product development and scale manufacturing across global factories. Instrumental has become mission-critical for manufacturers building and scaling the next generation of AI infrastructure hardware.
Instrumental is hiring a Data Platform Tech Lead/Architect to be responsible for building a cloud-native, highly performing, scalable, and reliable data platform to ingest manufacturing data, support AI/ML, and enable analytics.
- Has played a lead role in building a modern data platform on public cloud infrastructure and deploying it at scale.
- Is technically strong – well-versed in distributed systems, queuing, data pipelines, modern big-data technologies, and hands-on with languages like Go, Java, or Scala.
- Can drive platform evolution to support AI/ML and company-wide analytics.
- Is intelligent and knowledgeable, collaborates well, and understands the business side of requirements. Able to articulate engineering decisions and trade-offs to both technical and non-technical audiences.
- 5+ years of experience in building large-scale distributed cloud data platforms.
- BS/MS/PhD degree in Computer Science or related majors.
- Strong proficiency in at least one of the programming languages, such as Go (preferred), Java, Rust, or Scala.
- Deep understanding of message queuing, batch, and stream processing.
- Extensive experience in data modeling, data lake, and various database technologies (Postgres, MongoDB, Iceberg, ClickHouse), and indexing/caching (ElasticSearch, Redis).
- Cloud-native architecture expertise (AWS preferred).
- Experience leading architectural efforts for performance-sensitive systems (latency-critical services, multi-tenancy, large-scale indexing pipelines).
- Track record of driving projects from conception to completion by collaborating with cross-functional stakeholders, mentoring, and leading engineering teams.
- AI first mindset - Augment your productivity with AI whenever you see fit.
- Fast learner. Eager to absorb new emerging technologies.
- High energy. Can thrive in a fast-paced environment with a can-do attitude.
- Startup experience building, scaling, and evolving data platforms for IPO-scale growth.
- Has built data platforms for highly specialized industries, including manufacturing, cybersecurity, and security trading.
We’re a growing team that works collaboratively, supports each other, and is energized by having an impact. We value passion and the ability to learn – you’re encouraged to apply even if your experience doesn’t match the job description precisely!
The following is a representative annual base salary range for this position within the Bay Area: $205-310k. In addition, job level and salary opportunities are evaluated during our interview process – we review each applicant's experience, knowledge, skills, and abilities.
Instrumental is proud to offer a highly-rated variety of benefits, including health, vision, dental, commuter plans, and parental leave.
Top Skills
AWS
Clickhouse
Elasticsearch
Go
Iceberg
Java
MongoDB
Postgres
Redis
Scala
Instrumental Palo Alto, California, USA Office
909 Alma Street, Palo Alto, CA, United States, 94301
Similar Jobs
Fintech • Information Technology • Insurance • Financial Services • Big Data Analytics
This role involves originating and managing agricultural loans, fostering relationships with clients, and overseeing the agricultural investment portfolio in Southern states.
Top Skills:
Ai PlatformsDatabase ManagementDigital Sales Techniques
Fintech • Machine Learning • Payments • Software • Financial Services
The Sr. Business Director will lead strategies for growth and innovation at Capital One, manage teams, oversee product and marketing strategies, and improve credit performance through analytics and risk modeling.
40 Minutes Ago
Fintech • Machine Learning • Payments • Software • Financial Services
The Relationship Manager will drive new customer acquisitions for business cards and payments, focusing on small and mid-sized businesses through consultative sales techniques and strong relationship building.
Top Skills:
Google SuiteSalesforce
What you need to know about the San Francisco Tech Scene
San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.
Key Facts About San Francisco Tech
- Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Google, Apple, Salesforce, Meta
- Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
- Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
- Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine
