Robinhood Logo

Robinhood

Senior Software Engineer, AI Infra

Reposted 6 Days Ago
In-Office
Menlo Park, CA, USA
196K-230K Annually
Senior level
In-Office
Menlo Park, CA, USA
196K-230K Annually
Senior level
Lead architecture and delivery of scalable AI infrastructure, including model serving, feature stores, training systems, and ML observability. Partner with ML, data, and AI teams to improve workflows and reliability. Manage AWS CPU/GPU resources, establish monitoring standards, shape technical strategy, and mentor engineers. The role requires deep expertise in distributed systems, production ML workflows, search systems, vector databases, and modern ML infrastructure tooling.
The summary above was generated by AI
Join us in building the future of finance.

Our mission is to democratize finance for all. An estimated $124 trillion of assets will be inherited by younger generations in the next two decades. The largest transfer of wealth in human history. If you’re ready to be at the epicenter of this historic cultural and financial shift, keep reading.

About the team + role

We are building an elite team, applying frontier technologies to the world’s biggest financial problems. We’re looking for bold thinkers. Sharp problem-solvers. Builders who are wired to make an impact. Robinhood isn’t a place for complacency, it’s where ambitious people do the best work of their careers. We’re a high-performing, fast-moving team with ethics at the center of everything we do. Expectations are high, and so are the rewards. 

The AI Infrastructure team is building the foundation that powers machine learning and AI across Robinhood. We own the infrastructure supporting the entire ML/AI lifecycle, from feature engineering and training pipelines to model serving, inference, and observability. We also build and operate Robinhood's LLM gateway, enabling engineering teams across the company to leverage frontier and fine-tuned in-house AI models efficiently and at scale.

As a Senior Software Engineer, AI Infrastructure, you'll join a small, growing team tackling some of the most interesting infrastructure challenges at the intersection of distributed systems and AI. You'll work across traditional ML infrastructure and emerging LLM technologies, helping improve GPU efficiency, scale model serving, and build intelligent routing systems. This is an opportunity to get in early, take meaningful ownership, and help shape the infrastructure that will support Robinhood's next generation of AI capabilities.

This role is based in our Menlo Park office, with in-person attendance expected at least 3 days per week.

At Robinhood, we believe in the power of in-person work to accelerate progress, spark innovation, and strengthen community. Our office experience is intentional, energizing, and designed to fully support high-performing teams. 

What you’ll do
  • Design, build, and scale the infrastructure powering machine learning and AI across Robinhood, including feature stores, training pipelines, model serving, inference, and observability.
  • Build and optimize distributed systems that support large-scale ML/AI workloads, with a focus on performance, reliability, scalability, and latency.
  • Improve GPU utilization and efficiency by developing scheduling solutions for training and inference workloads.
  • Help evolve Robinhood's LLM gateway, including intelligent model routing, query and prompt understanding, and context optimization.
  • Support infrastructure for serving open-weight and fine-tuned models, enabling reliable access to AI capabilities across the company.
  • Partner with engineering teams across Robinhood to understand their infrastructure needs and build scalable, reusable solutions.
  • Own the operational health of critical infrastructure, including monitoring, troubleshooting, performance optimization, and participation in an on-call rotation.
What you bring
  • Strong software engineering experience with a focus on infrastructure, distributed systems, or large-scale backend platforms.
  • Hands-on experience designing, building, and operating distributed systems in production, with a strong understanding of scalability, reliability, and system performance.
  • Experience solving complex infrastructure challenges, including latency optimization, resource utilization, and production system reliability.
  • Strong software development and system design skills, with the ability to take ownership of complex technical problems from design through production.
  • Experience working with infrastructure technologies and tools in production environments, with an understanding of how to build and operate reliable systems at scale.
  • Ability to work independently, navigate ambiguity, and contribute to foundational engineering projects within a small, growing team.
  • Interest in machine learning and AI infrastructure, with a willingness to learn and work across both traditional infrastructure and emerging AI technologies.
  • Bonus: Experience with ML infrastructure, model training or serving, GPU workload scheduling, LLM gateways, or open-source infrastructure technologies.
What we offer
  • Challenging, high-impact work to grow your career.
  • Performance driven compensation with multipliers for outsized impact, bonus programs, equity ownership, and 401(k) matching.
  • Top Tier benefits to fuel your work, including 100% paid health insurance for employees with 90% coverage for dependents.
  • Access to the Robinhood Employee Fund that gives eligible US employees the opportunity to invest in a private employee fund that provides exposure to Robinhood Ventures funds.
  • Access to the best AI tools on the market and continuous AI skill-building for every employee, technical or not. 
  • Lifestyle wallet - a highly flexible benefits spending account for wellness, learning, and more.
  • Employer-paid life & disability insurance, fertility benefits, and mental health benefits.
  • Time off to recharge including company holidays, paid time off, sick time, parental leave, and more!
  • Exceptional office experience with catered meals, events, and comfortable workspaces.

In addition to the base pay range listed below, this role is also eligible for bonus opportunities + equity + benefits.

Base pay for the successful applicant will depend on a variety of job-related factors, which may include education, training, experience, location, business needs, or market demands. The expected base pay range for this role is based on the location where the work will be performed and is aligned to one of 3 compensation zones. For other locations not listed, compensation can be discussed with your recruiter during the interview process.

Base Pay Range:

Zone 1 (Menlo Park, CA; New York, NY; Bellevue, WA; Washington, DC)
$196,000—$230,000 USD
Zone 2 (Denver, CO; Westlake, TX; Chicago, IL)
$172,000—$202,000 USD
Zone 3 (Lake Mary, FL; Clearwater, FL; Gainesville, FL)
$153,000—$179,000 USD

Click here to learn more about our Total Rewards, which vary by region and entity.

If our mission energizes you and you’re ready to build the future of finance, we look forward to seeing your application.

AI Usage Disclosure: Robinhood uses artificial intelligence (AI) tools to support parts of our recruiting process. These tools enhance the efficiency and consistency of our hiring process; however, all hiring decisions are made by our hiring teams.

Robinhood provides equal opportunity for all applicants, offers reasonable accommodations upon request, and complies with applicable equal employment and privacy laws. Inclusion is built into how we hire and work—welcoming different backgrounds, perspectives, and experiences so everyone can do their best. Please review the Privacy Policy for your country of application.

HQ

Robinhood Menlo Park, California, USA Office

Menlo Park, CA, United States

Similar Jobs

2 Minutes Ago
Remote or Hybrid
2 Locations
306K-381K Annually
Senior level
306K-381K Annually
Senior level
Fintech • Machine Learning • Payments • Software • Financial Services
Leads applied AI research and development for foundation models and large-scale machine learning systems. Partners with data scientists, engineers, product managers, and academic researchers to define research directions, train and evaluate models, optimize inference and training, and deploy AI capabilities into products. Mentors applied scientists and managers, represents the organization externally, and translates advanced research into scalable customer experiences.
Top Skills: Aws UltraclustersCloud ComputingDeepspeedDglGpu ClustersHugging FaceLightningNemoPyTorchPytorch Geometric
2 Minutes Ago
Hybrid
San Francisco, CA, USA
150K-205K Annually
Mid level
150K-205K Annually
Mid level
Fintech • Machine Learning • Payments • Software • Financial Services
Lead product management for Capital One’s developer experience platform and CI/CD capabilities. Identify developer pain points, shape multi-year platform strategies, advocate for customer needs, and partner with engineering and stakeholders to deliver secure, reliable, automated, and scalable cloud solutions. The role also involves leading DevOps product strategies, enterprise platform initiatives, risk management, and emerging technology experimentation.
Top Skills: Ci/CdClaudeClaude CodeCloud ComputingDevOpsGeminiGoogle Apps ScriptManaged ComputeSoftware Delivery Platforms
2 Minutes Ago
Hybrid
2 Locations
197K-246K Annually
Mid level
197K-246K Annually
Mid level
Fintech • Machine Learning • Payments • Software • Financial Services
Design, develop, deploy, and support scalable AI systems, including foundation models, LLM inference, agentic workflows, similarity search, guardrails, evaluation, governance, and observability. Optimize model performance, cost, latency, throughput, and hardware utilization; define reliability objectives; own complex system architecture; lead technical reviews; ensure security and compliance; and mentor engineering associates.
Top Skills: Agentic AiAWSAws UltraclustersAzureC#C++CudaDistributed SystemsGoGoGCPGpuHugging FaceJavaLarge Language ModelsPythonPyTorchScalaSimilarity SearchTpuVectordbs

What you need to know about the San Francisco Tech Scene

San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.

Key Facts About San Francisco Tech

  • Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Google, Apple, Salesforce, Meta
  • Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
  • Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
  • Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account