femtoAI Logo

femtoAI

ML Compiler Engineer

Reposted 19 Days Ago
In-Office
San Bruno, CA, USA
Junior
In-Office
San Bruno, CA, USA
Junior
As an ML Compiler Engineer, you will develop efficient programs for ML models, implementing transformations and optimizations within the compiler stack.
The summary above was generated by AI

You will work on a custom ML compiler that transforms modern ML and DSP models into highly efficient programs for our accelerator.

This role spans the full compiler stack—from ingesting models and transforming intermediate representations to optimizing execution under tight memory and latency constraints.

What You’ll Do
  • Build and maintain model ingestion pipelines (e.g., PyTorch / ONNX → internal IR)
  • Implement graph transformations such as:
    • Operator decomposition and canonicalization
    • Shape inference and layout transformations
  • Develop and extend intermediate representations (e.g., MLIR)
  • Implement optimization passes including:
    • Operator fusion and graph partitioning
    • Basic scheduling and tiling strategies
    • Memory planning and reuse
  • Debug correctness and numerical issues across transformations
  • Collaborate with hardware and ML teams to improve system performance



Requirements
Required qualifications and experience:
  • 2+ years of experience in compilers and/or edge-AI
  • Proficiency in Python and/or C++
  • Experience with at least one:
  • MLIR, LLVM, TVM, XLA, or similar
  • Graph-level transformations or ML model internals
  • Understanding of deep learning models (conv, sequence models, etc.)
  • Ability to reason about correctness and performance tradeoffs
Nice to have:
  • Experience with optimization techniques (tiling, scheduling, memory reuse)
  • Familiarity with ONNX or PyTorch internals
  • Exposure to quantization or low-precision computation
  • Interest in hardware-aware ML systems

Benefits
  • 401(k)
  • Medical insurance
  • Vision insurance
  • Dental insurance
  • Commuter benefits
  • Disability insurance
  • Paid maternity leave
  • Paid paternity leave
  • Child care support

femtoAI is an equal opportunity employer committed to a diverse workforce which strives to create an inclusive working environment empowering everyone to do their best work. We do not discriminate on the basis of race, ethnicity, religion, gender, gender identity, sexual orientation, age, marital status, veteran status, or disability status.



Similar Jobs

10 Days Ago
In-Office
Mountain View, CA, USA
213K-263K Annually
Senior level
213K-263K Annually
Senior level
Automotive
Design and implement compiler optimizations and new compiler features for a high-performance neural network inference platform. Analyze generated code performance, collaborate with hardware architects for hardware/software codesign, and work with model developers to tune networks for inference efficiency and accuracy. Leverage agentic AI to accelerate analysis, planning, and production software improvements.
Top Skills: Agentic AiC++Compilers For Parallel ArchitecturesLinear Algebra ComputationMl Inference
5 Days Ago
In-Office or Remote
Palo Alto, CA, USA
Mid level
Mid level
Artificial Intelligence • Hardware • Machine Learning • Semiconductor
Develop the next generation AI compiler for Mythic's analog compute, optimizing for dataflow architectures and collaborating with hardware engineers.
Top Skills: C++GurobiIreeMlirOnnxOr-ToolsPythonPyTorchTvmXla
19 Days Ago
In-Office
San Bruno, CA, USA
Senior level
Senior level
Semiconductor
Design and build core components of the ML compiler, focusing on optimization strategies, compiler architecture, and collaboration with hardware teams.
Top Skills: MlirTvmXla

What you need to know about the San Francisco Tech Scene

San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.

Key Facts About San Francisco Tech

  • Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Google, Apple, Salesforce, Meta
  • Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
  • Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
  • Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account