Periodic Labs Logo

Periodic Labs

LLM Inference Engineer

Reposted 11 Days Ago
In-Office or Remote
Hiring Remotely in Menlo Park, CA, USA
Mid level
In-Office or Remote
Hiring Remotely in Menlo Park, CA, USA
Mid level
Integrate and optimize large-scale inference systems for AI research, supporting GPU utilization and low-latency access across models in a collaborative setting.
The summary above was generated by AI

About Periodic Labs

We are an AI + physical sciences lab building state of the art models to make novel scientific discoveries. We are well funded and growing rapidly. Team members are owners who identity and solve problems without boundaries or bureaucracy. We eagerly learn new tools and new science to push forward our mission.

About the role

You will integrate, optimize, and operate large-scale inference systems to power AI scientific research. You will build and maintain high-performance serving infrastructure that delivers low-latency, high-throughput access to large language models across thousands of GPUs. You will work closely with researchers and engineers to integrate cutting-edge inference into large-scale reinforcement learning workloads. You will build tools and directly support frontier-scale experiments to make Periodic Labs the world’s best AI + science lab. You will make contributions to open-source LLM inference software.

You might thrive in this role if you have experience with:

  • Optimizing inference for the largest open-source model

  • High-performance model serving frameworks such as TensorRT-LLM, vLLM, SGLang

  • Distributed inference techniques (tensor/expert/pipeline parallelism, speculative decoding, KV cache management)

  • Optimizing GPU utilization and latency for reinforcement learning

Top Skills

Gpus
Large Language Models
Reinforcement Learning
Sglang
Tensorrt-Llm
Vllm

Similar Jobs

57 Minutes Ago
Remote or Hybrid
7 Locations
153K-270K Annually
Senior level
153K-270K Annually
Senior level
eCommerce • Fintech • Hardware • Payments • Software • Financial Services
The Partner Manager will develop and manage partnerships to enhance products and drive seller acquisition, collaborating with various teams and being accountable for KPIs.
Top Skills: Api Integrations
An Hour Ago
Easy Apply
Remote or Hybrid
United States
Easy Apply
102K-137K Annually
Senior level
102K-137K Annually
Senior level
Artificial Intelligence • Cloud • Computer Vision • Hardware • Internet of Things • Software
The Senior Program Manager will lead large-scale cross-functional programs in Customer Success, enhancing operational cadence, stakeholder alignment, and business impact across digital transformation efforts in physical operations.
4 Hours Ago
Remote or Hybrid
Santa Clara, CA, USA
263K-447K Annually
Expert/Leader
263K-447K Annually
Expert/Leader
Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
The Vice President will drive the growth strategy for ServiceNow's Public Sector business, managing a global team, engaging with executive customers, and leveraging AI for operational efficiency.
Top Skills: AIAnalyticsCloud-Based PlatformEnterprise Software

What you need to know about the San Francisco Tech Scene

San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.

Key Facts About San Francisco Tech

  • Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Google, Apple, Salesforce, Meta
  • Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
  • Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
  • Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account