Foundation Robotics Logo

Foundation Robotics

AI Engineer (VLM & VLA)

Reposted 2 Days Ago
Be an Early Applicant
In-Office
San Francisco, CA, USA
150K-300K Annually
Senior level
In-Office
San Francisco, CA, USA
150K-300K Annually
Senior level
Develop and optimize vision-language-action models, integrating LLM-based reasoning with control policies, ensuring real-time robot interactions, and optimizing training and evaluation frameworks.
The summary above was generated by AI

About Us


Foundation is developing the future of general purpose robotics with the goal to address the labor shortage.

Our mission is to create advanced robots that can operate in complex environments, reducing human risk in conflict zones and enhancing efficiency in labor-intensive industries.

We are on the lookout for extraordinary engineers and scientists to join our team. Your previous experience in robotics isn't a prerequisite — it's your talent and determination that truly count.

We expect that many of our team members will bring diverse perspectives from various industries and fields. We are looking for individuals with a proven record of exceptional ability and a history of creating things that work.


Our Culture

We like to be frank and honest about who we are, so that people can decide for themselves if this is a culture they resonate with. Please read more about our culture here https://foundation.bot/culture.


Who should join:

  • You like working in person with a team in San Francisco.
  • You deeply believe that this is the most important mission for humanity and needs to happen yesterday.
  • You are highly technical - regardless of the role you are in. We are building technology; you need to understand technology well.
  • You care about aesthetics and design inside out. If it's not the best product ever, it bothers you, and you need to “fix” it.
  • You don't need someone to motivate you; you get things done.

Why Are We Hiring for this Role 

  • Develop and optimize vision-language-action models, including transformers, diffusion models, and multimodal encoders/decoders.
  • Build representations for 2D/3D perception, affordances, scene understanding, and spatial reasoning.
  • Integrate LLM-based reasoning with action planning and control policies.
  • Design datasets for multimodal learning: video-action trajectories, instruction following, teleoperation data, and synthetic data.
  • Interface VLAM outputs with real-time robot control stacks (navigation, manipulation, locomotion).
  • Implement grounding layers that convert natural language instructions into symbolic, geometric, or skill-level action plans.
  • Deploy models on on-board or edge compute platforms, optimizing for latency, safety, and reliability.
  • Build scalable pipelines for ingesting, labeling, and generating multimodal training data.
  • Create simulation-to-real (Sim2Real) training workflows using synthetic environments and teleoperated demonstration data.
  • Optimize training pipelines, model parallelism, and evaluation frameworks.
  • Work closely with robotics, hardware, controls, and safety teams to ensure model outputs are executable, safe, and predictable.
  • Collaborate with product teams to define robot capabilities and user-facing behaviors.
  • Participate in user and field testing to iterate on real-world performance.
What Kind of Person are we looking For 
  • Strong experience with training multimodal models, including VLAs, VLMs, vision transformers, LLMs.
  • Ability to build and iterate on large-scale training pipelines.
  • Deep proficiency in PyTorch or JAX, distributed training, and GPU acceleration.
  • Strong software engineering skills in Python and modern ML tooling.
  • Experience with (synthetic) dataset creation and curation.
  • Understanding of real-time deployment constraints on embedded hardware.
  • Optimally, familiarity with robotics simulation environments (Isaac Lab, Mujoco, or similar).
  • Ideally, hands-on experience with robotics, embodied AI, or reinforcement/imitation learning.
  • MSc or PhD in Computer Science, Robotics, Machine Learning, or related field—or equivalent industry experience.


Benefits

We provide market standard benefits (health, vision, dental, 401k, etc.). Join us for the culture and the mission, not for the benefits.


Salary

The annual compensation is expected to be between $150,000 - $300,000. Exact compensation may vary based on skills, experience, and location.


HQ

Foundation Robotics San Francisco, California, USA Office

617 Bryant St, San Francisco, California, United States, 94107

Similar Jobs

15 Hours Ago
In-Office
113K-153K Annually
Mid level
113K-153K Annually
Mid level
Aerospace • Information Technology • Software • Cybersecurity • Design • Defense • Manufacturing
The ISSO maintains and implements security policies for classified information systems, conducts risk assessments, and supports compliance with cybersecurity requirements.
Top Skills: AcasAudit ReductionCybersecurityDisa StigsHbssInformation Assurance (Ia)NessusRisk Management Framework (Rmf)Scap
15 Hours Ago
In-Office
99K-133K Annually
Junior
99K-133K Annually
Junior
Aerospace • Information Technology • Software • Cybersecurity • Design • Defense • Manufacturing
The Associate Space Communications Systems Engineer Analyst contributes to the design and analysis of space systems, focusing on RF links and waveform analysis.
Top Skills: C++JavaMatlabPython
15 Hours Ago
In-Office
82K-177K Annually
Mid level
82K-177K Annually
Mid level
Aerospace • Information Technology • Software • Cybersecurity • Design • Defense • Manufacturing
Lead design, programming, integration, commissioning, and troubleshooting of PLC-based control systems for robotic and automated machinery. Create electrical schematics, wiring diagrams, I/O documentation, and oversee control panel builds. Specify/configure PLCs, HMIs, drives, sensors, and safety devices while ensuring compliance with electrical and safety standards.
Top Skills: Advanced Logix 5000Control PanelsElectrical SchematicsEthernet/IpFunctional SafetyHmisI/O DocumentationMachine SafetyModbus TcpMotion ControlPlc ProgrammingPlcsProfinetRobotic AutomationSensorsServo DrivesWiring Diagrams

What you need to know about the San Francisco Tech Scene

San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.

Key Facts About San Francisco Tech

  • Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Google, Apple, Salesforce, Meta
  • Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
  • Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
  • Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account