femtoAI Logo

femtoAI

ML Compiler Engineer

Posted 4 Days Ago
In-Office
San Bruno, CA, USA
Junior
In-Office
San Bruno, CA, USA
Junior
As an ML Compiler Engineer, you will develop efficient programs for ML models, implementing transformations and optimizations within the compiler stack.
The summary above was generated by AI

You will work on a custom ML compiler that transforms modern ML and DSP models into highly efficient programs for our accelerator.

This role spans the full compiler stack—from ingesting models and transforming intermediate representations to optimizing execution under tight memory and latency constraints.

What You’ll Do
  • Build and maintain model ingestion pipelines (e.g., PyTorch / ONNX → internal IR)
  • Implement graph transformations such as:
    • Operator decomposition and canonicalization
    • Shape inference and layout transformations
  • Develop and extend intermediate representations (e.g., MLIR)
  • Implement optimization passes including:
    • Operator fusion and graph partitioning
    • Basic scheduling and tiling strategies
    • Memory planning and reuse
  • Debug correctness and numerical issues across transformations
  • Collaborate with hardware and ML teams to improve system performance



Requirements
Required qualifications and experience:
  • 2+ years of experience in compilers and/or edge-AI
  • Proficiency in Python and/or C++
  • Experience with at least one:
  • MLIR, LLVM, TVM, XLA, or similar
  • Graph-level transformations or ML model internals
  • Understanding of deep learning models (conv, sequence models, etc.)
  • Ability to reason about correctness and performance tradeoffs
Nice to have:
  • Experience with optimization techniques (tiling, scheduling, memory reuse)
  • Familiarity with ONNX or PyTorch internals
  • Exposure to quantization or low-precision computation
  • Interest in hardware-aware ML systems

Benefits
  • 401(k)
  • Medical insurance
  • Vision insurance
  • Dental insurance
  • Commuter benefits
  • Disability insurance
  • Paid maternity leave
  • Paid paternity leave
  • Child care support

femtoAI is an equal opportunity employer committed to a diverse workforce which strives to create an inclusive working environment empowering everyone to do their best work. We do not discriminate on the basis of race, ethnicity, religion, gender, gender identity, sexual orientation, age, marital status, veteran status, or disability status.



Similar Jobs

4 Days Ago
In-Office
San Bruno, CA, USA
Senior level
Senior level
Semiconductor
Design and build core components of the ML compiler, focusing on optimization strategies, compiler architecture, and collaboration with hardware teams.
Top Skills: MlirTvmXla
17 Days Ago
In-Office
Santa Clara, CA, USA
124K-242K Annually
Entry level
124K-242K Annually
Entry level
Artificial Intelligence • Computer Vision • Hardware • Robotics • Metaverse
Develop algorithms and optimizations for NVIDIA's LPX inference and compiler stack focusing on performance, efficiency, and integration with hardware systems.
Top Skills: CC++LlvmMlirOnnxPyTorchRustTensorFlow
11 Days Ago
Remote or Hybrid
2 Locations
185K-335K Annually
Senior level
185K-335K Annually
Senior level
Automotive • Big Data • Information Technology • Robotics • Software • Transportation • Manufacturing
You will own the compilation stack transforming AI models into optimized inference for autonomous driving. This includes developing tools and techniques for model export and optimizing performance while ensuring safety and reliability.
Top Skills: CudaJaxMlirOnnxPyTorchTensorFlowTensorrtTvmXla

What you need to know about the San Francisco Tech Scene

San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.

Key Facts About San Francisco Tech

  • Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Google, Apple, Salesforce, Meta
  • Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
  • Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
  • Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account