Pantograph Logo

Pantograph

Research Scientist

Posted 5 Days Ago
Be an Early Applicant
In-Office
San Francisco, CA, USA
Mid level
In-Office
San Francisco, CA, USA
Mid level
Research scientist to scale simple, general models trained on internet-scale video and robot data. Develop and pre-train large multimodal/video models, apply self-supervised or unsupervised RL, train on large GPU clusters, and measure model performance rigorously.
The summary above was generated by AI

Pantograph is training general models that start by watching internet-scale video and end up on robots. We think the path to capable robots runs through general intelligence rather than narrow, robot-specific skills. We're scaling simple methods across video games, real-world video, and our own fleet of affordable, durable robots.

We're looking for research scientists who want to scale simple methods across the largest datasets available.

You might be a good fit if you:

  • Have experience with one or more of:

    • Large-scale pre-training (video, multimodal, image, or language)

    • Self-supervised, goal-conditioned, or unsupervised RL

    • Robotics models, especially those trained on large-scale data

    • Video generation or other large-scale sequence modeling over high-dimensional observations (e.g. pixels)

  • Have trained models on large GPU clusters and are comfortable working with Kubernetes

  • Believe simple methods that scale beat complicated ones that don't, and reach for the simplest thing that could work

  • Strive to find simple, expressive metrics and measure them accurately

  • Value scientific integrity and seek to understand the true effect of different interventions

Nice to have:

  • Experience with JAX

  • Interest in problems adjacent to the critical path — new modalities, alternatives to text for reasoning, pixel-space modeling, or automating research itself

  • A strong background in proof-based mathematics, including topics such as:

    • Measure-theoretic probability

    • Stochastic processes

    • Optimization theory

We care much more about what you can do than any specific credential. We're interested in published work or lab experience, but equally in strong open-source contributions or personal projects. If you're excited about scaling general models that learn from and act in the real world, we'd love to talk.

Similar Jobs

11 Days Ago
Hybrid
Redwood City, CA, USA
90K-150K Annually
Mid level
90K-150K Annually
Mid level
Artificial Intelligence • Big Data • Healthtech • Machine Learning • Analytics • Biotech • Generative AI
Partner with pharma clients to design and execute computational translational research using large clinical and molecular datasets. Drive account strategies, co-architect client solutions on the Tempus platform, communicate technical results to diverse audiences, author whitepapers, and coordinate with Product, Engineering, and Research teams. Travel ~25% for client engagements.
Top Skills: AWSCSS3D3DaskDockerFlaskGgplotGitHTML5JavaScriptJupyter NotebooksMatplotlibNumpyPandasPlot.LyPythonRRstudioScikit-LearnScipySeabornSQLTidyverse
12 Days Ago
Hybrid
Sunnyvale, CA, USA
219K-335K Annually
Senior level
219K-335K Annually
Senior level
Automotive • Big Data • Information Technology • Robotics • Software • Transportation • Manufacturing
Lead research and development of vision-language and vision-language-action foundational models for autonomous driving, focusing on multimodal alignment, onboard model optimization (quantization, pruning, distillation, compilation), real-time deployment on vehicle edge hardware, cross-team integration with perception and planning, mentoring engineers, and publishing/patenting research.
Top Skills: CameraGenerative AiKnowledge DistillationLidarModel CompilationModel QuantizationMultimodal SystemsPruningPythonRadarTransformers
13 Days Ago
Hybrid
Redwood City, CA, USA
100K-175K Annually
Senior level
100K-175K Annually
Senior level
Artificial Intelligence • Big Data • Healthtech • Machine Learning • Analytics • Biotech • Generative AI
Collaborate with biopharma clients to design and execute computational translational research using Tempus' platform. Integrate large clinical and molecular datasets, develop multimodal AI models, co-architect client solutions, drive account strategy, communicate technical results to non-technical audiences, author whitepapers, and coordinate with Product and Engineering. Travel about 25%.
Top Skills: AWSCSS3D3DaskDockerFlaskGgplotGitHTML5JavaScriptJupyter NotebooksMatplotlibNumpyPandasPlot.LyPythonRRstudioScikit-LearnScipySeabornSQLTidyverse

What you need to know about the San Francisco Tech Scene

San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.

Key Facts About San Francisco Tech

  • Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Google, Apple, Salesforce, Meta
  • Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
  • Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
  • Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account