AI Infrastructure Software Architect

Company Overview

KLA is a global leader in diversified electronics for the semiconductor manufacturing ecosystem. Virtually every electronic device in the world is produced using our technologies. No laptop, smartphone, wearable device, voice-controlled gadget, flexible screen, VR device or smart car would have made it into your hands without us. KLA invents systems and solutions for the manufacturing of wafers and reticles, integrated circuits, packaging, printed circuit boards and flat panel displays. The innovative ideas and devices that are advancing humanity all begin with inspiration, research and development. KLA focuses more than average on innovation and we invest 15% of sales back into R&D. Our expert teams of physicists, engineers, data scientists and problem-solvers work together with the world’s leading technology providers to accelerate the delivery of tomorrow’s electronic devices. Life here is exciting and our teams thrive on tackling really hard problems. There is never a dull moment with us.

Group/Division

KLA has always had a close relationship with physics and data. Our optical and electron beam inspection and measurement tools use cutting edge physics models, both for hardware design and as part of their algorithms. AI, including several traditional machine learning techniques and deep learning are routinely used to process this data to meet application requirements. The AI & Modeling Center of Excellence was setup with the mission of advancing KLA’s traditional strengths in physics and data and providing implementation solutions for multiple KLA Inspection and Metrology products targeted at the semiconductor manufacturing industry. The AI & Modeling Center of Excellence is part of the company’s Central Engineering organization providing product development expertise in a critical area for a wide variety KLA products. As a part of this group, you will be part of a world class team of physicists, HPC system designers, machine learning and application engineers who build cutting edge solutions for modeling complex imaging techniques and semiconductor processes. You will also work with a data scientists and AI infrastructure engineers whose mission is to build and scale machine learning based solutions for our semiconductor customers. We are looking for engineers in a few different fields. If you are passionate about Physics Modeling, High Performance Computing - HPC (including GPU), Machine Learning, Deep Learning, Data Sciences, or cutting-edge Cloud technologies – this is the place for you!

Job Description/Preferred Qualifications

Are you passionate about building the backbone of AI innovation? Join our team as a Sr. AI Infrastructure Software Engineer and help craft the next-generation software infrastructure that powers groundbreaking AI frameworks like CUDA, TensorFlow, PyTorch, and JAX!

This role is ideal for engineers who excel in system-level development and are eager to expand their impact in high-performance computing—driving innovation where complexity meets scale!

Key Responsibilities:

• Architect and implement robust software infrastructure to support AI/ML workloads across multiple frameworks and hardware platforms.
• Design and optimize system-level components using C, C++, and Python, ensuring high performance, scalability, and maintainability.
• Collaborate with multi-functional and cross-divisional teams to integrate AI frameworks (e.g., TensorFlow, PyTorch, JAX, ONNX) into a unified development environment.
• Lead the development of build systems and toolchains using Makefiles, CMake, Clang, and GCC.
• Stay ahead of modern software and AI trends, and guide the team in adopting standard processes and new technologies.
• Provide technical leadership and mentorship to junior engineers and chip in to long-term architectural decisions.

Required Qualifications:

• Education & Experience: Advanced degree in Computer Science, Electrical Engineering, or a related field, with a strong background in system-level software development.
• Programming & Tools: Proficient in C, modern C++, Python, and experienced with Linux development environments. Familiar with build tools (Makefile, CMake), compilers (Clang, GCC), and container technologies (e.g., Kubernetes).
• Technical Expertise: Deep understanding of software architecture, compiler toolchains, and runtime systems. Experience building infrastructure for AI/ML frameworks or high-performance computing environments.
• Specialized Skills: Hands-on experience with CUDA, GPU programming, and familiarity with TensorFlow and deep learning model interoperability is a strong plus.
• multi-functional Impact: Proven track record to develop scalable software infrastructure across multiple divisions or organizations.
• AI & HPC Knowledge: Strong grasp of modern AI trends, including model optimization, distributed training, and inference acceleration.
• Communication: Excellent written and verbal communication skills.

Preferred Qualifications

• Experience working with AI accelerators or heterogeneous computing environments.
• Contributions to open-source AI or systems software projects.
• Strong collaboration skills, with the ability to influence and align partners across teams and geographies.

Minimum Qualifications

Doctorate (Academic) Degree and related work experience of 5 years; Master's Level Degree and related work experience of 8 years; Bachelor's Level Degree and related work experience of 12 years

Base Pay Range: $180,000.00 - $306,000.00 Annually

Primary Location: USA-CA-Milpitas-KLA

KLA’s total rewards package for employees may also include participation in performance incentive programs and eligibility for additional benefits including but not limited to: medical, dental, vision, life, and other voluntary benefits, 401(K) including company matching, employee stock purchase program (ESPP), student debt assistance, tuition reimbursement program, development and career growth opportunities and programs, financial planning benefits, wellness benefits including an employee assistance program (EAP), paid time off and paid company holidays, and family care and bonding leave.

Interns are eligible for some of the benefits listed. Our pay ranges are determined by role, level, and location. The range displayed reflects the pay for this position in the primary location identified in this posting. Actual pay depends on several factors, including state minimum pay wage rates, location, job-related skills, experience, and relevant education level or training. We are committed to complying with all applicable federal and state minimum wage requirements where applicable. If applicable, your recruiter can share more about the specific pay range for your preferred location during the hiring process.

               

KLA is proud to be an Equal Opportunity Employer. We will ensure that qualified individuals with disabilities are provided reasonable accommodation to participate in the job application or interview process, to perform essential job functions, and to receive other benefits and privileges of employment. Please contact us at [email protected] or at +1-408-352-2808 to request accommodation.

Be aware of potentially fraudulent job postings or suspicious recruiting activity by persons that are currently posing as KLA employees.  KLA never asks for any financial compensation to be considered for an interview, to become an employee, or for equipment. Further, KLA does not work with any recruiters or third parties who charge such fees either directly or on behalf of KLA. Please ensure that you have searched KLA’s Careers website for legitimate job postings.  KLA follows a recruiting process that involves multiple interviews in person or on video conferencing with our hiring managers.  If you are concerned that a communication, an interview, an offer of employment, or that an employee is not legitimate, please send an email to [email protected] to confirm the person you are communicating with is an employee. We take your privacy very seriously and confidentially handle your information.