Intel Logo

Intel

AI Infrastructure Engineer

Posted 3 Days Ago
In-Office
Santa Clara, CA, USA
171K-315K Annually
Mid level
In-Office
Santa Clara, CA, USA
171K-315K Annually
Mid level
Drive end-to-end LLM inference performance on Intel GPUs: profile bottlenecks, write and optimize custom GPU kernels (attention, MoE, quantization, fusions), upstream improvements to vLLM/SGLang/PyTorch, and collaborate with architecture and compiler teams to shape hardware roadmaps.
The summary above was generated by AI
Job Details:

Job Description: 

We are looking for a performance-obsessed AI Infrastructure Engineer to push LLM inference to its absolute limits on Intel's next-generation GPU architectures.
In this role, you will dive deep into the inference stack and redefine peak performance. You will work end-to-end across the stack: profiling bottlenecks, writing custom GPU kernels, and upstreaming your optimizations directly into industry-standard serving frameworks like vLLM and SGLang. Your optimizations will be instrumental in unlocking the full potential of Intel hardware for state-of-the-art generative AI workloads.
What You Will Do
• Drive Inference Performance: Own the end-to-end optimization pipeline for running state-of-the-art LLMs on Intel GPUs.
• Deep Stack Optimization: Profile, diagnose, and resolve cross-stack performance bottlenecks.
• Kernel Development and Integration: Design, write, and optimize custom high-performance kernels for critical attention mechanisms, MoE, quantization, and operator fusions.
• Open Source Leadership: Upstream your architectural improvements and hardware backends directly into open-source repositories like vLLM, SGLang, and PyTorch, acting as a bridge between the hardware teams and the open-source community.
• Shape the Hardware Roadmap: Apply roofline analysis and systematic profiling to decompose bottlenecks. You will partner with our architecture and compiler teams to shape future GPU roadmaps based on real-world GenAI workload data.

• Show passion about AI infrastructure and performance optimization.

Qualifications:

Minimum Qualifications

• Bachelors Degree in Computer Science, Software Engineering, Artificial Intelligence/Machine Learning, or related field and 4+ years experience, Masters Degree and 3+ years, OR PhD.
• 3+ years of relevant software engineering experience in GPU computing, AI systems, or high-performance computing (HPC).
• Proficiency in modern C++ and Python. You are comfortable reading and modifying complex systems-level code.

Preferred Qualifications
• Understanding of CPU/GPU architecture.
• Understanding of modern LLM architectures and inference paradigms: attention mechanisms, KV caching, continuous batching, speculative decoding, and prefill-decode disaggregation.
• Prior open-source contributions to inference engines (vLLM, SGLang, PyTorch, llama.cpp).
• Hands-on experience writing and optimizing custom GPU kernels using Triton, SYCL, CUDA/CUTLASS, or other DSLs.
• Experience with scale-out inference orchestration across multi-node topologies.
• You leverage AI coding agents daily to accelerate your own workflow and benchmark generation.
Your expertise will play a vital role in advancing Intel's AI technology. We invite you to bring your skills, experience, and passion for AI to make an impact-apply today.

          

Job Type:Experienced Hire

Shift:Shift 1 (United States of America)

Primary Location: US, California, Santa Clara

Additional Locations:US, California, Folsom, US, Oregon, Hillsboro, US, Texas, Austin

Posting Statement:All qualified applicants will receive consideration for employment without regard to race, color, religion, religious creed, sex, national origin, ancestry, age, physical or mental disability, medical condition, genetic information, military and veteran status, marital status, pregnancy, gender, gender expression, gender identity, sexual orientation, or any other characteristic protected by local law, regulation, or ordinance.Position of TrustN/ABenefits

We offer a total compensation package that ranks among the best in the industry. It consists of competitive pay, stock bonuses, and benefit programs which include health, retirement, and vacation. Find out more about the benefits of working at Intel.



Annual Salary Range for jobs which could be performed in the US: $170,500.00-315,490.00 USD

The range displayed on this job posting reflects the minimum and maximum target compensation for the position across all US locations. Within the range, individual pay is determined by work location and additional factors, including job-related skills, experience, and relevant education or training. Your recruiter can share more about the specific compensation range for your preferred location during the hiring process.

Work Model for this Role

This role will be eligible for our hybrid work model which allows employees to split their time between working on-site at their assigned Intel site and off-site. * Job posting details (such as work model, location or time type) are subject to change.

*

ADDITIONAL INFORMATION: Intel is committed to Responsible Business Alliance (RBA) compliance and ethical hiring practices. We do not charge any fees during our hiring process. Candidates should never be required to pay recruitment fees, medical examination fees, or any other charges as a condition of employment. If you are asked to pay any fees during our hiring process, please report this immediately to your recruiter.
HQ

Intel Santa Clara, California, USA Office

Robert Noyce Building, Santa Clara, CA, United States, 95052

Intel Mountain View, California, USA Office

Mountain View, United States

Intel San Jose, California, USA Office

San Jose, United States

Intel Santa Clara, California, USA Office

2200 Mission College Blvd. , Santa Clara, CA, United States, 95054

Intel Sunnyvale, California, USA Office

Sunnyvale, United States

Similar Jobs

Mid level
Artificial Intelligence • Hardware • Software • Semiconductor
Design, implement, and maintain Python frameworks and services that orchestrate distributed engineering workflows across machines and clusters. Build scheduling, execution, resource management, failure recovery, and test infrastructure. Define APIs and abstractions, reason about concurrency and distributed-systems behavior, debug complex multi-system issues, write automated tests and documentation, and partner with platform, CI, release, QA, and product teams to deliver scalable infrastructure.
Top Skills: AsyncioBuild SystemsCi SystemsCluster SchedulersConcurrent.FuturesContainersKubernetesMultiprocessingPytestPythonRelease InfrastructureRemote Execution Systems
5 Days Ago
Remote or Hybrid
USA
140K-215K Annually
Senior level
140K-215K Annually
Senior level
Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
Design, build, and operate large-scale LLM infrastructure and data platforms for training, fine-tuning, and inference. Provision GPU clusters, optimize GPU utilization, implement model lifecycle management, deploy inference frameworks, create evaluation and observability systems, and collaborate with data scientists to productionize AI capabilities. Mentor engineers and enforce MLOps/DataOps best practices.
Top Skills: AirflowAnsibleAWSCudaDaskDockerFlinkGCPGpuJaxKubernetesLangchainLlamaindexMegatronMlflowNvidia DriversOciPythonPyTorchRaySagemakerSlurmSparkTerraformTpuTriton Inference ServerVertex AiVllm
11 Days Ago
In-Office
Senior level
Senior level
Information Technology • Robotics
Lead ML infrastructure engineer owning GPU inference performance for onboard real-time and high-throughput offboard systems. Improve and maintain C++ inference framework, optimize GPU execution, collaborate with applied ML teams, and expand ownership across ML pipelines and distributed infrastructure.
Top Skills: C++Distributed SystemsGpusMulti-ThreadingPyTorch

What you need to know about the San Francisco Tech Scene

San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.

Key Facts About San Francisco Tech

  • Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Google, Apple, Salesforce, Meta
  • Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
  • Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
  • Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account