As an AI Kernel Engineering Intern, you will optimize GPU kernels for AI workloads and analyze memory layouts for performance improvements.
About Modular
What You Will Work On:
What You Will Learn:
What you bring to the table:
What Modular brings to the table:
At Modular, we’re on a mission to revolutionize AI infrastructure by systematically rebuilding the AI software stack from the ground up. Our team, made up of industry leaders and experts, is building cutting-edge, modular infrastructure that simplifies AI development and deployment. By rethinking the complexities of AI systems, we’re empowering everyone to unlock AI’s full potential and tackle some of the world’s most pressing challenges.
If you’re passionate about shaping the future of AI and creating tools that make a real difference in people’s lives, we want you on our team. You can read about our culture and careers to understand how we work and what we value.
As an AI Kernel Engineering Intern, you will work at the intersection of AI inference models and cutting edge, high-perform GPU kernels. You will help design, optimize, and benchmark low-level kernels that power modern AI workloads, with a focus on GPUs and emerging accelerators. Projects may include optimizing matrix operations, attention primitives, or custom operators; analyzing memory layouts and data movement; and collaborating with others to translate models into efficient, production-ready implementations.
LOCATION: Candidates based in the United States are welcome to apply. To support growth and collaboration, all interns will work in a hybrid capacity at our Los Altos, CA office (minimum 2 days per week on-site) with relocation assistance provided for out-of-state candidates.
What You Will Learn:
You will gain hands-on experience with the internals of AI frameworks and hardware-aware optimization. This includes understanding how deep learning operators map to GPU architectures, writing and tuning GPU kernels, and using profiling tools to identify performance bottlenecks. You’ll also learn best practices for performance-critical code, numerical correctness, and collaborating across teams to deliver impactful improvements.
- Currently pursuing a Bachelor’s, Master’s, or PhD in Computer Science, Math, Electrical Engineering, or a related field
- Strong foundation in parallel programming, performance optimization, memory subsystem, or computer architecture
- Machine learning fundamentals, AI inference models, and modern AI workloads
- Proficiency in Python, C/C++, or any object-oriented languages
- Experience with CUDA, or other accelerator programming models is a plus
- A publication record is a nice-to-have
- Curious, detail-oriented, and excited in a fast-paced startup environment
- Amazing Team. We are a progressive and agile team with some of the industry’s best engineering and product leaders.
- Competitive Compensation. We offer very strong compensation packages, including stock options. We want people to be focused on their best work and believe in tailoring compensation plans to meet the needs of our workforce.
- Team Building Events. We organize regular team onsites and local meetups in Los Altos, CA.
Working at Modular will enable you to grow quickly as you work alongside incredibly motivated and talented people who have high standards, possess a growth mindset, and a purpose to truly change the world.
The estimated base hourly range for this role is $47.00 - $65.00 USD.
The hourly rate for the successful applicant will depend on a variety of permissible, non-discriminatory job-related factors, which include but are not limited to education, training, work experience, business needs, or market demands. This range may be modified in the future.
For candidates who fall outside of the listed requirements, we nevertheless encourage you to apply as we may have openings that are lower/higher level than the ones advertised.
Similar Jobs
Artificial Intelligence • Big Data • Healthtech • Machine Learning • Analytics • Biotech • Generative AI
The role involves supporting research collaborations in oncology, engaging KOLs, managing study proposals, and contributing to medical writing and strategy development.
Top Skills:
AIGenomic Testing
Consumer Web • Coupons • Healthtech • Social Impact • Pharmaceutical
The Software Engineer III will design, implement, and maintain scalable systems, collaborate with cross-functional teams, write clean code, and utilize AI tools effectively.
Top Skills:
AWSCircleCICloudwatchCodefreshDatadogDynamoDBGithub ActionsGoGraphQLGrpcKubernetesMySQLPostgresPythonRedisSentrySumo Logic
Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
Lead Software Engineer responsible for backend services and API development, setting technical direction, and driving automation and mentoring engineers. Focus on improving health outcomes and software quality using AI tools.
Top Skills:
Ai ToolsAPIsCi/CdGoGraphQLRest
What you need to know about the San Francisco Tech Scene
San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.
Key Facts About San Francisco Tech
- Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Google, Apple, Salesforce, Meta
- Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
- Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
- Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine
