Work across modeling, data, systems, and evaluation to make video foundation models expressive, controllable, and personalized. Build adaptation and personalization pipelines, define end-user quality metrics and evaluations, and collaborate with product and design to deploy production-ready model variants for creative partners.
About Luma AI
Luma's mission is to build multimodal AI to expand human imagination and capabilities. We believe that multimodality is critical for intelligence. To go beyond language models and build more aware, capable, and useful systems, the next step function change will come from vision. So, we are working on training and scaling up multimodal foundation models for systems that can see and understand, show and explain, and eventually interact with our world to effect change.
About the Role
This is a foundational opportunity to refine, personalize, and build the final capabilities and control interface of Luma’s foundation models and drive real-world value.
You’ll sit at the intersection of research, product, and partnerships, helping close the gap between state-of-the-art and production-ready. Your mission is to make our video foundation models more expressive, controllable, and personalized – solving the “last mile” challenges demanded by top-tier creative workflows.
What You'll Do
You will work as a fullstack applied researcher across modeling, data, systems, and evaluation to adapt and deploy models to production.
- Controllability and Features: You will leverage a toolkit spanning SFT, RL, personalization, distillation, control adapters, and more, to develop and maintain model variants purpose-built for user environments and creative partners.
- Personalization: Architect the data engine for rapid adaptation. You will leverage proprietary, vertical-specific datasets to create specialized finetunes and improve future training recipes, ensuring our models rely on data that reflects real-world use cases.
- End-User Quality: You will define and drive end-user quality – setting success metrics, building user-aligned evaluations, and iterating on the model/data/evals loop to meet strict fidelity and reliability targets in specific enterprise verticals.
- Cross-functional Collaboration: Partner closely with Product, Research, and Design to translate creative intent and user feedback into model behavior, intuitive controls, and production-ready capabilities for users and partners.
Who You Are
- Product-Obsessed Researcher/Engineer: You treat end users and partners as collaborators and enjoy solving specific “last mile” problems—not just optimizing public metrics.
- ML Expert: Strong ML fundamentals with deep experience in visual generative models (diffusion/transformers or related architectures). Ideal candidates also have a deep understanding of at least one: fine-tuning, personalization, domain adaptation, data curation, targeted distillation, interpretability, or human-feedback-driven refinement.
- Hands-On Builder: Strong Python and deep learning engineering skills (ideally PyTorch), comfortable moving between research prototypes and production systems.
- Contributions to state-of-the-art models in image/video generation.
- Experience collaborating with creative partners (VFX, animation, film, design tools).
- Track record building workflows/tools that materially improve iteration speed and evaluation rigor.
- Familiarity with large-scale training infrastructure and distributed systems (Ray, Slurm, Kubernetes).
The base pay range for this role is $200,000 – $450,000 per year.
About LumaLuma’s mission is to build unified general intelligence that can generate, understand, and operate in the physical world.
We believe that multimodality is critical for intelligence. To go beyond language models and build more aware, capable and useful systems, the next step function change will come from vision. So, we are working on training and scaling up multimodal foundation models for systems that can see and understand, show and explain, and eventually interact with our world to effect change.
Luma AI San Francisco, California, USA Office
San Francisco, CA, United States
Similar Jobs
Blockchain • eCommerce • Fintech • Payments • Software • Financial Services • Cryptocurrency
Design, build, test, launch, and operate full-stack services automating responses to legal, regulatory, and civil requests. Develop backend systems, internal web tools, and integrations across microservice and event-driven architectures. Collaborate with Counsel, Compliance, and Operations while handling sensitive customer data. Participate in on-call, incident response, code reviews, modernization efforts, and responsible use of AI-powered development tools.
Top Skills:
Ai AgentsAuroraAWSBuildkiteClaudeDatadogDynamoDBGooseGradleGrpcHTTPJavaJSONKafkaKotlinLlmsMcpMicroservicesMySQLProtocol BuffersReactRedisRuby On RailsSidekiqTypescript
Big Data • Fintech • Mobile • Payments • Financial Services
Build and operate backend systems supporting post-transaction card account accuracy, issue resolution, and customer communications. Break down projects, deliver work in phases, collaborate with product and cross-functional teams, monitor system metrics, support availability and on-call operations, and contribute to code reviews and interviews. The role requires backend development experience, distributed systems knowledge, and proficiency in Python or Kotlin, AWS, MySQL, and Kubernetes.
Top Skills:
AWSKotlinKubernetesMySQLPython
Artificial Intelligence • Cloud • Edtech • HR Tech • Sales • Software • Generative AI
Drive enterprise revenue growth by prospecting and closing complex B2B SaaS deals with organizations of 5,000+ employees. Responsibilities include territory planning, pipeline development, executive engagement, consultative selling, product demonstrations, quota attainment, multi-threaded deal management, and mentoring junior Account Executives. The role requires regular customer travel of up to 25% and expertise in learning and development technology markets.
Top Skills:
360Learning PlatformB2B SaasHr TechLmsLxp
What you need to know about the San Francisco Tech Scene
San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.
Key Facts About San Francisco Tech
- Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Google, Apple, Salesforce, Meta
- Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
- Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
- Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine
