Conduct robot learning research across simulated and real robotic systems, training and evaluating imitation learning, diffusion, VLA, and reinforcement learning policies. Build evaluation infrastructure and scalable pipelines for synthesizing, annotating, and curating robotics datasets. Analyze how data affects policy performance, reproduce state-of-the-art research, deploy policies on robot hardware, and contribute findings to leading robotics, computer vision, and machine learning publications.
About Abaka AI
Abaka AI is built on one mission: to be the world’s most trusted data partner for AI companies. More than 1,000 industry leaders across Generative AI, Embodied AI, and Automotive AI rely on us to power their data pipelines. With our headquarters in Silicon Valley—and teams in Paris, Singapore, and Tokyo—we support global partners with fast, reliable, and scalable data solutions.
Our offerings include a diverse catalog of off-the-shelf datasets (image, video, multimodal, reasoning, 3D, and beyond) as well as comprehensive data collection and annotation services. Whether teams need raw data, curated datasets, or full-cycle data engineering, Abaka AI provides the foundation for building high-performance AI systems.
About the Role
We are looking for a Robotics Research Engineer to join Abaka Robotics Lab, our in-house research group focused on building the data foundation for physical AI.
We believe the next wave of AI will act in the physical world—and that its greatest bottleneck will be data. Unlike language and vision, there is no internet-scale corpus of robot experience readily available. That data must be captured, synthesized, labeled, and carefully curated. Abaka already works closely with several leading physical AI labs to help build this foundation.
This is a hands-on, research-driven role combining robot learning, data production, and publishable research. You will train and evaluate policies on both simulated and real-world robotic systems, use experimental results to understand which data matters, and design scalable pipelines that turn raw sensor data into high-quality training datasets with minimal human intervention.
You will work with hardware including 6-DoF collaborative robot arms and an ALOHA-style bimanual platform with full teleoperation. Your findings will directly inform the datasets we build for our partners and contribute to publications at leading robotics, computer vision, and machine learning venues.
Responsibilities
Scope 1: Robot Learning Research
- Train and evaluate robot policies (imitation learning, diffusion policies, VLA, RL fine-tuning) on our data and public baselines, in simulation and on real robots.
- Turn evaluation results into a quality signal for the data: which data helped, which did not, and why.
- Track the state of the art: reproduce the papers that matter, run current methods on our hardware, and develop findings that hold up into publications at top robotics, vision, or ML venues.
- Maintain the training and evaluation infrastructure: training runs, evaluation harnesses, and the simulation or world-model environments used ahead of hardware tests.
Scope 2: Data Pipeline: Synthesis, Annotation, Curation
- Design pipelines that turn raw capture (egocentric human video, robot logs, teleoperation, 3D scans) into training data with minimal human labeling: synthesize what was not captured, auto-label with models and geometry, and curate what goes into training.
- Track which data decisions changed policy performance.
Minimum Qualifications
- MS or PhD in Robotics, Computer Science, Machine Learning, or a related field.
- 1 - 3 years of hands-on experience with real robot hardware, through research, an internship, or a project.
- Strong machine learning fundamentals: optimization, generalization, evaluation methodology, and end-to-end model training.
- Strong robotics fundamentals: coordinate frames, kinematics, basic control.
- Strong 3D vision fundamentals: camera models, multi-view geometry, point clouds.
- Rigor in evaluation: claims about a policy or a dataset are backed by measurements.
Preferred Qualifications
- Publications or workshop papers at top-tier robotics (CoRL, RSS, ICRA, IROS), vision (CVPR, ICCV, ECCV, 3DV), or ML (NeurIPS, ICML, ICLR) venues. A widely used open-source repository or a dataset adopted by other teams is valued equally.
- Experience with imitation learning or VLA codebases such as LeRobot, ACT, Diffusion Policy, OpenVLA, or π0.
- Experience deploying a learned policy on a real robot and running a rigorous evaluation.
- Practical 3D reconstruction experience: COLMAP, SLAM, 3DGS/NeRF, point-cloud registration.
- World models or video generative models, particularly as simulators or data generators.
- RL fine-tuning of learned policies, or model-based RL.
- Hand and object pose estimation, hand-object interaction, or human-to-robot motion retargeting.
- Depth in a simulator (MuJoCo, Isaac Sim/Lab, Genesis, SAPIEN), including environment and asset authoring.
- Domain randomization, procedural scene generation, or sim-to-real transfer.
- Teleoperation or data collection systems in the ALOHA / UMI / hand-tracking lineage.
- Familiarity with egocentric datasets such as Ego-Exo4D, EgoMimic, HOT3D, Project Aria, and DexCap.
- Dexterous or bimanual manipulation research.
- Camera calibration and multi-sensor time synchronization.
- Vision-language models applied to robotics: task planning, language-conditioned policies, reward or success detection.
- Auto-labeling or ground-truth generation over real sensor data, with quality metrics attached.
- Tactile, force-torque, or other multimodal sensing for manipulation.
- Data curation and dataset-scaling studies: deduplication, mixture ratios, difficulty or diversity scoring, and ablations that identify which data mattered.
We recognize that no candidate will match every preferred qualification. If you meet the core requirements and have meaningful depth in several of these areas, we encourage you to apply.
Compensation & Benefits
The base salary range for this position is $100,000 - $140,000 USD annually.
Compensation may vary outside of this range depending on a number of factors, including a candidate’s qualifications, skills, competencies, and experience. Base pay is one part of the Total Package that is provided to compensate and recognize employees for their work at Abaka AI. This role is eligible for equity, as well as a comprehensive benefits package (health, dental, vision, PTO, flexible work schedule).
Similar Jobs
Artificial Intelligence • Hardware • Robotics • Automation
Design and ship end-to-end teleoperation systems for bimanual home robots. Build VR and 3D operator interfaces, integrate headsets and controllers, develop motion-retargeting and optimization-based control, reduce perceived network latency, and create shared-autonomy capabilities. Specify ergonomic operator stations and collaborate across mechanical, robotics, and software teams. The role combines HCI, sensing, ergonomics, robotics, systems profiling, and empirical testing to deliver reliable tools used by operators in real-world settings.
Top Skills:
C++Computer NetworksConstraint HandlingDifferential Inverse KinematicsGame EnginesHapticsOptimization-Based ControlQuadratic ProgrammingShared AutonomySimulationStereo VideoVr
Artificial Intelligence • Computer Vision • Hardware • Robotics • Metaverse
The role involves designing teleoperation software, developing control algorithms, deploying neural networks on hardware, and ensuring system reliability for humanoid robots.
Top Skills:
C++GazeboIsaacMujocoPythonRosRust
Artificial Intelligence • Robotics • Automation • Manufacturing
As a Robotics Research Engineer, you will design, implement, and deploy intelligent robotic systems, focusing on system architecture and control methods for manufacturing applications.
Top Skills:
Ros2
What you need to know about the San Francisco Tech Scene
San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.
Key Facts About San Francisco Tech
- Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Google, Apple, Salesforce, Meta
- Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
- Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
- Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine
