Develop and train scalable interpretability assistants to predict and detect subtle model behaviors. Create diverse evaluations, design novel architectures and objectives, and scale training/inference pipelines to support up to 1T‑scale models. Collaborate closely with a research team and contribute to high-impact evaluations used for industry standards and regulation.
Salary range: $250,000 - $500,000/year + benefits
Description: Transluce is a non-profit research lab building tools for scalable, end-to-end oversight of AI systems. We build world-class, AI-backed analysis tools and use these to set industry standards for evaluation. Our tools are integrated with core agent benchmarks like SWE-bench, while our evaluations are directly underpinning regulation, including our role as EU AI Office’s main evaluation developer for harmful manipulation risks.
About the role: We are looking for strong scientists and engineers to help advance our vision of oversight foundation models: AI systems that formalize, test, and answer questions about the behavior of other AI systems. As part of our highly collaborative team, you will learn and grow quickly, creating technology at the frontier of AI research and with high direct impact.
Core responsibility: Help us develop and train scalable oversight assistants that can predict and detect unexpected and subtle behaviors in AI systems. This includes:
- Creating diverse evaluations that range in difficulty. This involves finding naturally occurring interesting and undesirable behaviors exhibited by open-source models.
- Developing novel architectures and objectives for training oversight assistants.
- Scaling up the training and inference pipelines to support up to 1T-scale models.
Qualities of a strong candidate:
- Experience with fine-tuning language models, designing new architectures, and creating evaluations.
- Reliable results: good experimental design, epistemic self-awareness and transparency
- Generativeness: coming up with original, productive ideas for unblocking progress
- Curiosity: a desire to understand ML systems and how they work
- Strong programming ability, including navigating trade-offs between prototyping speed and maintainability
- Strong communication skills, low ego, openness to giving and receiving feedback
We are located in San Francisco and enthusiastic to work together in-person. We are open to sponsoring international visas.
Transluce San Francisco, California, USA Office
1301 Sansome St, San Francisco, California, United States, 94111 1122
Similar Jobs
.png)
Consumer Web • eCommerce • Marketing Tech • Retail • Software • Analytics • Generative AI
Own the positioning, messaging, launches, packaging, pricing, adoption, and revenue growth strategy for Klaviyo Personalization. Partner with Product, Sales, Customer Success, Enablement, and Marketing to translate AI and data science capabilities into compelling customer value. Shape the roadmap through market insight, develop enablement and thought-leadership materials, influence cross-functional teams, and measure launch and program performance.
Top Skills:
Ai/MlAnalyticsCustomer Data Platforms (Cdp)Marketing AutomationPredictive Models
Blockchain • Fintech • Payments • Financial Services • Cryptocurrency • Web3
Lead the technical vision, architecture, and roadmap for Circle’s identity and access platform. Manage and develop backend and frontend engineers, guide architectural changes, review designs and code, troubleshoot production issues, participate in incident response, and partner with Security, Product, Risk, and engineering teams. The role focuses on authentication, authorization, customer and agent identity, secure delegation, platform reliability, migrations, and operational readiness.
Top Skills:
Auth0CedarJavaKotlinMcpOauth 2.XOidcOktaOpen Policy Agent (Opa)SAMLSpiffeSpireTypescript
Cloud • Information Technology • Internet of Things • Machine Learning • Software • Cybersecurity • Infrastructure as a Service (IaaS)
Supports RF network performance and RAN optimization across 4G, 5G, 6G, and small-cell deployments. Responsibilities include developing generative AI automation tools, launching carriers and sites, conducting verification and drive testing, monitoring KPIs, troubleshooting radio and baseband issues, and delivering engineering projects through customer acceptance. The role requires telecommunications or engineering knowledge, automation familiarity, structured problem-solving, and collaboration with customers and cross-functional teams.
Top Skills:
4G5G6GGenerative AiPower BIPythonRanRf OptimizationSmall CellsTableau
What you need to know about the San Francisco Tech Scene
San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.
Key Facts About San Francisco Tech
- Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Google, Apple, Salesforce, Meta
- Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
- Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
- Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine
