Together AI Logo

Together AI

Research Intern RL & Post-Training Systems, Turbo (Fall 2026)

Posted Yesterday
Be an Early Applicant
In-Office
San Francisco, CA, USA
58-63 Hourly
Internship
In-Office
San Francisco, CA, USA
58-63 Hourly
Internship
Study RL and post-training methods tightly coupled to inference behavior, co-designing algorithms and systems. Design controlled experiments, modify inference/training systems, develop inference-aware RL objectives, optimize inference systems for reproducible RL rollouts, and evaluate scaling, cost-quality trade-offs and benchmarks.
The summary above was generated by AI
About the Role

The Turbo Research team investigates how to make post-training and reinforcement learning for large language models efficient, scalable, and reliable. Our work sits at the intersection of RL algorithms, inference systems, and large-scale experimentation, where the cost and structure of inference dominate overall training efficiency and shape what learning algorithms are practical.

As a research intern, you will study RL and post-training methods whose performance and scalability are tightly coupled to inference behavior, co-designing algorithms and systems rather than treating them independently. Projects aim to unlock new regimes of experimentation—larger models, longer rollouts, and more complex evaluations—by rethinking how inference, scheduling, and training interact.

Requirements
  • Pursuing a PhD or MS in Computer Science, EE, or a related field (exceptional undergraduates considered)
  • Have research experience in one or more of:
    • RL or post-training for large models (e.g., RLHF, RLAIF, GRPO, preference optimization)
    • ML systems (inference engines, runtimes, distributed systems)
    • Large-scale empirical ML research or evaluation
  • Are comfortable with empirical research by designing controlled experiments, while interpreting noisy results and drawing principled conclusions
  • Can work across abstraction layers:
    • Strong Python skills for experimentation
    • Willingness to modify inference or training systems (experience with C++, CUDA, or similar is a plus)
Example Research Directions

Intern projects are tailored to your background and interests, and may include:

  • Inference-Aware RL & Post-Training
    • Designing RL or preference-optimization objectives that explicitly account for inference cost and structure (e.g., speculative decoding, partial rollouts, controllable sampling).
    • Studying how inference-time approximations affect learning dynamics in GRPO-, RLHF-, RLAIF-, or DPO-style methods.
    • Analyzing bias, variance, and stability trade-offs introduced by accelerated inference within RL loops.
  • RL-Centric Inference Systems
    • Developing inference mechanisms that support deterministic, reproducible RL rollouts at scale.
    • Exploring batching, scheduling, and memory-management strategies optimized for RL and evaluation workloads rather than pure serving.
    • Investigating how KV-cache policies, sampling controls, or runtime abstractions influence learning efficiency.
  • Scaling Laws & Cost–Quality Trade-offs
    • Empirically characterizing how reward improvement and generalization scale with rollout cost, latency, and throughput.
    • Quantifying when systems-level optimizations change algorithmic behavior rather than only reducing runtime.
    • Identifying regimes where inference efficiency unlocks qualitatively new learning capabilities.
  • Evaluation & Measurement
    • Designing rigorous benchmarks and diagnostics for post-training and RL efficiency.
    • Studying failure modes in long-horizon training and how system constraints shape outcomes.
Preferred Qualifications
  • Publications at leading ML and NLP conferences (such as NeurIPS, ICML, ICLR, ACL, or EMNLP)
  • Understanding of model optimization techniques and hardware acceleration approaches
  • Contributions to open-source machine learning projects
Internship Program Details

Our fall internship program spans over 12 to 16 weeks where you’ll have the opportunity to work with industry-leading engineers building a cloud from the ground up and possibly contribute to influential open source projects. Our internship dates are September 14th to December 18th. 

About Together AI

Together AI is a research-driven artificial intelligence company. We believe open and transparent AI systems will drive innovation and create the best outcomes for society, and together we are on a mission to significantly lower the cost of modern AI systems by co-designing software, algorithms, and models. We have contributed to leading open-source research, models, and datasets to advance the frontier of AI, and our team has been behind technological advancements such as FlashAttention, Mamba, FlexGen, Petals, Mixture of Agents, and RedPajama.

Compensation

We offer competitive compensation, housing stipends, and other competitive benefits. The estimated US hourly rate for this role is $58 to $63 an hour. Our hourly rates are determined by location, level and role. Individual compensation will be determined by experience, skills, and job-related knowledge.

Equal Opportunity

Together AI is an Equal Opportunity Employer and is proud to offer equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and more.

Please see our privacy policy at https://www.together.ai/privacy


Together AI San Francisco, California, USA Office

584 Castro St, #2050, San Francisco, California , United States, 94114

Similar Jobs

50 Minutes Ago
In-Office
2 Locations
134K-179K Annually
Expert/Leader
134K-179K Annually
Expert/Leader
Cloud • Information Technology • Machine Learning
Lead sourcing strategy and commercial execution for dark fiber, lit services, wavelengths, and carrier connectivity. Run RFPs and negotiations, translate network engineering requirements into contracts, manage supplier performance and delivery across design, construction, and turn-up, and support cross-functional stakeholders to enable global data center and network expansion.
Top Skills: Contract Lifecycle ManagementDark FiberErpGis ToolsIx ConnectivityKmzLit FiberOsp FiberTelecom Management ToolWavelengths
51 Minutes Ago
In-Office
2 Locations
177K-237K Annually
Senior level
177K-237K Annually
Senior level
Cloud • Information Technology • Machine Learning
Lead electrical design for medium-voltage substations (15kV–230kV) across data center campuses. Own projects from concept through construction, produce SLDs, layouts, protection/control schemes, review power system studies, integrate on-site generation (BESS, turbines, generators), direct consultants, establish MV design standards, and mentor junior engineers. Support feasibility, capacity planning, budgeting, and risk management. Up to 30% travel.
Top Skills: AutocadBessEtapGeneratorsIec 61850InvertersMicrostationParalleling SwitchgearPscadRtuScadaSkmTurbines
An Hour Ago
In-Office
San Jose, CA, USA
144K-216K Annually
Mid level
144K-216K Annually
Mid level
Artificial Intelligence • Fintech • Software
Own product vision and execution for data integrations: define supported integration types and tooling (API, sFTP, CDC, Snowflake), shape integration architecture and data mapping, work with engineering and non-technical customers, create playbooks and documentation, and align with GTM, Sales, and Customer Success to accelerate onboarding and platform value.
Top Skills: APIsChange Data Capture (Cdc)Data PipelinesData WarehousingNetSuiteSAPSftpSnowflakeWorkdayYardi

What you need to know about the San Francisco Tech Scene

San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.

Key Facts About San Francisco Tech

  • Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Google, Apple, Salesforce, Meta
  • Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
  • Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
  • Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account