Physical Intelligence Logo

Physical Intelligence

Robotics Software Engineer

Reposted 2 Months Ago
In-Office
San Francisco, CA, USA
Mid level
In-Office
San Francisco, CA, USA
Mid level
Engineer low-latency, high-throughput sensor and actuator pipelines, optimize system performance, and integrate complex models into real-time workflows while collaborating across teams.
The summary above was generated by AI

Who We Are

Physical Intelligence is bringing general-purpose AI into the physical world. We are a group of engineers, scientists, roboticists, and company builders developing foundation models and learning algorithms to power the robots of today and the physically-actuated devices of the future.

Achieving real-world performance requires extremely tight system latency, reliable sensor pipelines, and end-to-end engineering that makes perception and control loops work at real-time speeds.

As a Runtime Software Engineer, you’ll engineer the low-latency, high-throughput systems that underpin our physical intelligence model. You won’t be designing ML models - you’ll be the person who makes them run flawlessly in production, optimizing every layer from OS to camera pipeline to networking. You’ll collaborate closely with researchers, platform engineers, and robotics operators to identify bottlenecks and extract maximum performance from the entire system.

The Team

The Runtime team is responsible for building the core platform that Pi’s robots, sensors, and evaluation pipelines rely on. The team spans Linux systems engineering, camera and sensor pipelines, robot actuator controllers, networking, real-time IO, and performance tooling. They ensure our ML models and control systems operate under strict latency budgets and are robust under real-world conditions.

In This Role You Will

-Own Real-Time Pipelines: Engineer low-latency, high-reliability sensor and actuator pipelines across Linux, drivers, and middleware.

-Optimize System Performance: Profile and optimize across compute, I/O, memory, scheduling, networking, and storage to meet real-time constraints and increase throughput.

-Build OS-Level Capabilities: Extend or modify Linux components, drivers, and scheduling to achieve deterministic behavior under load.

-Streaming & Video Systems: Develop and optimize real-time video streaming systems where frame timing and packet scheduling matter.

-Reliability & Debugging: Build tooling for profiling, tracing, and debugging timing issues across distributed systems and hardware interfaces.

-Cross-Functional Collaboration: Work with researchers, hardware engineers, and operations teams to integrate optimized pipelines into production workflows.

What We Hope You’ll Bring

-Strong programming skills in C++, Rust, or Python, with experience building and optimizing production software.

-Experience with Linux systems programming (syscalls, drivers, kernel parameters, scheduling, memory/IO subsystems).

-Background in real-time or near–real-time systems, VR/AR, video pipelines, 3D engines, or streaming systems where latency budgets are strict.

-Ability to optimize across the entire stack - kernel scheduling, drivers, networking, GPU/CPU workloads, video frameworks, and distributed components.

-Experience with profiling tools (perf, tracing, eBPF, GPU profilers, network analyzers) and comfort diving into complex performance issues.

-A mindset oriented around determinism, throughput, frame budgets, jitter minimization, and real-time correctness.

-Ability to collaborate deeply with researchers and platform engineers to translate high-level model requirements into real-world system performance.

Bonus Points If You Have

-Experience with VR/AR platforms or low-latency 3D engines.

-Camera system expertise (synchronization, capture pipelines, codecs, GPU offload).

-Streaming/video conferencing stack experience (WebRTC, real-time transport optimizations).

-Background in robotics, autonomous systems, SLAM pipelines, or perception systems (implementation, not research).

-Expertise in kernel-level engineering, device drivers, or high-performance networking.

-Familiarity with distributed systems that process real-time data flows.

Pursuant to the San Francisco Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records.

Similar Jobs

7 Days Ago
Hybrid
Mountain View, CA, USA
153K-234K Annually
Senior level
153K-234K Annually
Senior level
Automotive • Big Data • Information Technology • Robotics • Software • Transportation • Manufacturing
Designs, develops, integrates, validates, and deploys AI-enabled robotic applications for industrial automation. Responsibilities include manipulation, perception, motion planning, computer vision, controls, simulation, VLA models, learned policies, sensor integration, calibration, force control, and hardware deployment. The role owns robotic software architecture and transitions systems from simulation and prototypes to production, collaborating across robotics, AI, controls, manufacturing, and plant-facing teams.
Top Skills: C++DockerEthernet/IpGitIso 10218Iso/Ts 15066LinuxLulaModbusMoveitNvidia Isaac LabNvidia Isaac SimNvidia OmniverseOmniverse ReplicatorOmplOnnx RuntimeOpc UaPlcsPythonPyTorchRmpflowRos 2Tensorrt
11 Days Ago
Remote or Hybrid
Mountain View, CA, USA
160K-291K Annually
Senior level
160K-291K Annually
Senior level
Automotive • Big Data • Information Technology • Robotics • Software • Transportation • Manufacturing
Build and own physics-grade robotics simulation infrastructure for manipulation, perception, SLAM, and navigation validation. Model robot dynamics, kinematics, actuation, and sensors; develop scene-authoring and CAD import tools; integrate simulation into CI; support AI data generation; and lead virtual commissioning and digital twin capabilities. The role also evaluates simulation-to-hardware divergence, supports infrastructure users, and balances simulation fidelity with performance.
Top Skills: C++CadCiDigital TwinsGazeboGpu-Accelerated SimulationIsaac SimLidarProcess SimulatePythonRgb-D CamerasRosSdfUrdfUsdVirtual CommissioningVisual Components
Yesterday
In-Office
San Francisco, CA, USA
148K-230K Annually
Mid level
148K-230K Annually
Mid level
Professional Services • Consulting
Develop and test motion-control software for physical robot arms, from simulation through live hardware. Create motion-planning algorithms for dynamic environments, apply computer vision to tool-handling tasks, troubleshoot simulated and hardware systems, and deliver reliable releases. Collaborate with external scientists on deployment needs while improving software scalability, robustness, and simplicity.
Top Skills: Computer VisionMotion ControlMotion PlanningPythonRobotic ArmsRobotics Simulation

What you need to know about the San Francisco Tech Scene

San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.

Key Facts About San Francisco Tech

  • Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Google, Apple, Salesforce, Meta
  • Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
  • Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
  • Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account