fal Logo

fal

Staff Technical Lead for Inference & ML Performance

Reposted 7 Days Ago
In-Office
San Francisco, CA, USA
Expert/Leader
In-Office
San Francisco, CA, USA
Expert/Leader
Lead the optimization of inference systems, guiding a team to enhance model performance, drive innovation, and mentor performance engineers in a high-growth environment.
The summary above was generated by AI

fal is the generative media ecosystem powering the next generation of AI products. We build the infrastructure, tools, and model access that teams need to move from idea to production, and do it at scale without compromise. For developers and enterprises, fal is the foundation that makes generative media not just possible, but practical: a unified platform where high-performance inference, orchestration, and observability come together to unlock new categories of AI-native products.

As generative media reshapes industries across a market projected to grow by hundreds of billions over the next decade, fal is becoming the ecosystem that ambitious teams build on.

Why this role matters

You’ll shape the future of fal’s inference engine and ensure our generative models achieve best-in-class performance. Your work directly impacts our ability to rapidly deliver cutting-edge creative solutions to users, from individual creators to global brands.

What you'll do
Day-to-day
What success looks like
Set technical direction. Guide your team (kernels, applied performance, ML compilers, distributed inference) to build high-performance inference solutions.
fal’s inference engine consistently outperforms industry benchmarks in throughput, latency, and efficiency.
Hands-on IC leadership. Personally contribute to critical inference performance enhancements and optimizations.
You regularly ship code that significantly improves model serving performance.
Collaborate closely with research & applied ML teams. Influence model inference strategies and deployment techniques.
Seamless integration of inference innovations rapidly moves from research to production deployment.
Drive advanced performance optimizations. Implement model parallelism, kernel optimization, and compiler strategies.
Performance bottlenecks are quickly identified and eliminated, dramatically enhancing inference speed and scalability.
Mentor and scale your team. Coach and expand your team of performance-focused engineers.
Your team independently innovates, proactively solves complex performance challenges, and consistently levels up their skills.
You might be a fit if you
  • Are deeply experienced in ML performance optimization. You've optimized inference for large-scale generative models in production environments.
  • Understand the full ML performance stack. From PyTorch, TensorRT, TransformerEngine, Triton to CUTLASS kernels, you’ve navigated and optimized them all.
  • Know inference inside-out. Expert-level familiarity with advanced inference techniques: quantization, kernel authoring, compilation, model parallelism (TP, context/sequence parallel, expert parallel), distributed serving and profiling.
  • Lead from the front. You're a respected IC who enjoys getting hands-on with the toughest problems, demonstrating excellence to inspire your team.
  • Thrive in cross-functional collaboration. Comfortable interfacing closely with applied ML teams, researchers, and stakeholders.
Nice-to-haves
  • Experience building inference engines specifically for diffusion and generative media models
  • Track record of industry-leading performance improvements (papers, open-source contributions, benchmarks)
  • Leadership experience in scaling technical teams
What you'll get

One of the highest impact roles at one of the fastest growing companies (revenue is growing 40% MoM, we are 60x+ RR compared to last year, raised Series A/B/C within the last 12 months) with a world changing vision: hyperscaling human creativity.

Sound like your calling? Share your proudest optimization breakthrough, open-source contribution, or performance milestone with us. Let's set new standards for inference performance, together.

Similar Jobs

29 Minutes Ago
In-Office
Sunnyvale, CA, USA
153K-204K Annually
Senior level
153K-204K Annually
Senior level
Cloud • Information Technology • Machine Learning
Design and build a proto-driven code-generation pipeline to emit Go SDKs, CLI commands, and Terraform resources. Own API service framework components end-to-end, enforce API standards, collaborate with teams on API design, improve developer experience, and mentor engineers.
Top Skills: BufCliCobraCode GenerationConnectrpcCrossplaneCwicGoGrpcJwksMtlsOidcProtocol BuffersPulumiSdksTerraformTerraform Plugin Framework
29 Minutes Ago
In-Office
2 Locations
215K-254K Annually
Senior level
215K-254K Annually
Senior level
Cloud • Information Technology • Machine Learning
Design, build, and operate large-scale data ingestion, storage, and query systems for AI/ML experiment tracking. Architect and optimize distributed backend services (petabyte-scale), implement customer-facing APIs, run services on Kubernetes/cloud, diagnose production issues, lead architectural initiatives, and mentor junior engineers.
Top Skills: AWSAzureBigtableClickhouseDockerGCPGoGrpcKafkaKubernetesMySQLPostgresPubsubPythonRestTerraformTypescript
50 Minutes Ago
Easy Apply
Hybrid
San Francisco, CA, USA
Easy Apply
221K-247K Annually
Senior level
221K-247K Annually
Senior level
Fintech • HR Tech
Own the AI-first product vision and roadmap for Legal & Compliance enterprise applications. Design and deliver generative-AI features, AI agents, MCPs, and RAG-powered workflows across CLM, matter management, e-signature, GRC, and e-discovery. Translate legal needs into functional specs, ensure security, privilege protection, and SOX-aligned controls, run POCs and vendor evaluations, and drive adoption, change management, and metrics for AI-enabled legal operations.
Top Skills: AgiloftAi AgentsAi AssistantsAnthropicBrightflagCrewaiDocusignDocusign ClmE-DiscoveryGeminiGrcIroncladLangchainLarge Language Models (Llms)Legal TrackerModel Context Protocols (Mcps)OpenaiPrompt EngineeringRetrieval-Augmented Generation (Rag)Semantic KernelSimplelegal

What you need to know about the San Francisco Tech Scene

San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.

Key Facts About San Francisco Tech

  • Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Google, Apple, Salesforce, Meta
  • Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
  • Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
  • Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account