The AI Systems Engineer will design and develop a core ML stack, solve technical challenges across verticals, ensure code quality, and lead the team in building impactful AI systems.
Salary range: $350,000 - $600,000/year + benefits
Description: Transluce is a fast-moving research lab building the public tech stack for understanding and debugging AI systems. We build world-class, AI-backed analysis tools and use these to set industry standards for evaluation. We are a non-profit with a mission to steer the development of AI for the public good.
About the role: We are looking for an exceptional AI systems engineer to lead the design and development of our core ML stack, building systems that can scale to thousands of GPUs and performantly query trillion-token databases.
As an early member of a highly collaborative team, you will be free to innovate and move fast, building high-impact systems from the ground up. As part of a mission-focused non-profit, your work will have high direct impact (e.g. used by governments to inform AI policy) and cross-organisational reach (open-source tools the entire community can build on).
Core responsibilities:
- Set overall code culture and tooling for a fast-growing org
- Help to solve our core technical challenges across verticals. Examples include:
- Docent:
- High-concurrency container-based evals with quick ability to iterate on interventions to agentic trajectories
- Deterministic sandbox execution of code that can efficiently restore state from checkpoints
- Interpretability:
- Inference stacks that are as performant as vLLM but flexible enough to allow complex model introspection and intervention, steering, configurable sampling, etc., and that can scale to 400B+ parameter models
- Behavior elicitation:
- Distributed RL training and roll-outs allowing thousands of concurrent rollouts across machines
- Build great internal tools to speed up the team
- Docent:
- Help tone-set in the organization around best practices for building and path-set on what infra we should build
- Help other team members think through infra challenges
Qualities of a strong candidate:
- Exceptional programmer fluent in Python
- Bare metal optimization: know GPUs, other accelerators in and out (low-level performance + optimization + parallel programming)
- Experience engineering at scale (distributed systems, reliability, architecture design)
- Leader on global code quality and health (designing good primitives, managing complexity and scale)
- Bonus: can set up LLM pipelines, e.g. multiple specialized LLMs interacting with each other in a performant and reliable way
- Bonus: experience with open-source community management
We are located in San Francisco and enthusiastic to work together in-person. We are open to sponsoring international visas.
Transluce San Francisco, California, USA Office
1301 Sansome St, San Francisco, California, United States, 94111 1122
Similar Jobs
Artificial Intelligence • Big Data • Cloud • Information Technology • Software • Cybersecurity • Data Privacy
Design, build, deploy, and operate production-grade AI agents, automations, and internal tools. Lead workflow discovery, multi-agent orchestration, context and state management, integrations, full-stack interfaces, evaluation, guardrails, testing, monitoring, and staged releases. Measure business outcomes and determine when agents, simpler automation, or no solution is appropriate. The role requires ownership of agent systems from architecture through production improvement and reuse.
Top Skills:
Ai SdksAPIsCi/CdData ModelsFastapiGoogle AdkGraph StoresGraphragHybrid RetrievalLanggraphLlm ApisMcpMicrosoft TeamsPythonRest ApisSalesforceSlackSnowflakeVersion ControlWebhooks
Fintech • Machine Learning • Payments • Software • Financial Services
Design, develop, deploy, and support large-scale AI systems, including foundation models, LLM inference, agentic workflows, vector search, guardrails, evaluation, governance, and observability. Optimize model performance, scalability, latency, throughput, hardware utilization, and cost. Lead technical reviews and governance, define AI platform roadmaps, integrate heterogeneous AI systems, and mentor senior engineering talent.
Top Skills:
AWSAws UltraclustersAzureC#C++CudaGoGCPHugging FaceJavaPythonPyTorchScalaVectordbs
Fintech • Information Technology • Payments • Sharing Economy • Financial Services • Cryptocurrency
Develop and deploy AI capabilities across enterprise ERP platforms including Workday and SAP Ariba. Build intelligent agents, chatbots, automation, integrations, and custom GenAI/LLM solutions. Establish PaaS environments, cloud services, deployment pipelines, security, governance, and engineering processes. Lead AI projects from concept through production, evaluate vendor versus custom solutions, support technology roadmaps, and promote AI literacy. Provide production support and training while aligning solutions with business needs and measurable ROI.
Top Skills:
Ai AgentsAWSAzureChatbotsCi/CdCloud ComputingData PipelinesDevOpsGenerative AiGoogle Cloud Platform (Gcp)Infrastructure As A Service (Iaas)Large Language Models (Llms)Machine LearningMlopsOauthPlatform As A Service (Paas)PythonRestful ApisSAMLSap AribaSap BtpSQLWebhooksWorkdayWorkday Extend
What you need to know about the San Francisco Tech Scene
San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.
Key Facts About San Francisco Tech
- Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Google, Apple, Salesforce, Meta
- Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
- Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
- Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine
