Work with engineers to design, implement, and deploy scalable inference solutions for top AI models. Implement and optimize models (Python, C++, CUDA, NCCL), monitor live services, develop features, fix bugs, participate in code reviews, and collaborate in agile teams.
DeepInfra is seeking talented and motivated Software Engineering Interns to join our team. As an intern, you will be working closely with our experienced engineering team to design, develop, and deploy the top open AI models at scale. This is an excellent opportunity to gain hands-on experience in building scalable and efficient software systems, while working on cutting-edge AI models and algorithms.
- Collaborate with the engineering team to design, develop, and test inference solutions for the top AI models.
- Implement and optimize AI models using Python, C++, CUDA, NCCL
- Monitor and maintain the live service.
- Work on feature development, bug fixing, and code reviews to ensure high-quality software delivery
- Participate in daily stand-ups, code reviews, and design discussions to ensure seamless collaboration
- Stay up-to-date with industry trends and advancements in AI and machine learning
- Try new things
- Ship stuff
- Currently pursuing a Bachelor's or Master's degree in Computer Science, Computer Engineering, or a related field
- Strong fundamental knowledge in computer science, including data structures, algorithms, and software design patterns
- Proficiency in Python, including experience with AI/ML libraries and frameworks (e.g., NumPy, pandas, SciPy, TensorFlow, PyTorch)
- Familiarity with AI models, Transformers and Diffusers
- Experience with version control systems (e.g., Git) and agile development methodologies
- Excellent problem-solving skills, with the ability to debug and optimize code
- Strong communication and teamwork skills, with the ability to effectively collaborate with cross-functional teams
- Work on cutting-edge AI model serving - the systems that power the next generation of LLMs and multimodal models.
- Small team, huge impact: your work ships directly to customers.
- Opportunity to learn from engineers building high-performance inference at scale.
- Fast-paced environment with ownership, autonomy, and end-to-end responsibility.
Three traits define the people who thrive here, and this role leans on all three.
Initiative. We take ownership and step in where we can add value. Whether it’s starting something new, improving what exists, or helping move ideas forward, we aim to be proactive and thoughtful in how we contribute.
Drive. We’re energized by hard problems. Building AI infrastructure is complex, and we lean into that. We care about doing things well, moving fast, and continuously improving — because solving meaningful challenges is what motivates us.
Grit. Things don’t always work on the first try — and that’s expected. We stay persistent, adapt quickly, and learn as we go. We take setbacks seriously, but not personally, and use them to get better.
Monthly range: 7000-8000/month USD
Deep Infra Inc. Palo Alto, California, USA Office
Palo Alto, California, United States, 94306
Similar Jobs
Artificial Intelligence • Hardware • Information Technology • Software
Supports compiler and runtime development for in-memory machine learning accelerators. Responsibilities include accelerating compiler development, static analysis of program properties, compiler optimization for ML model latency and bandwidth, and collaboration with QA teams.
Top Skills:
CC++IreeMlirRust
Aerospace • Artificial Intelligence • Hardware • Machine Learning • Software • Defense • Manufacturing
Leads and grows a perception AI engineering team building autonomous spacecraft capabilities, including synthetic data generation, multi-target tracking, sensor fusion, camera calibration, object detection, and edge deployment. Provides technical direction, defines validation standards, owns the team roadmap, coordinates cross-functional delivery, manages hiring and development, and ensures reliable performance under spacecraft compute, power, and operational constraints.
Top Skills:
BlenderComputer VisionDeep LearningEdge AiEmbedded SystemsFaster R-CnnGenerative AiHardware-In-The-Loop TestingKalman FilteringMulti-Object TrackingOnnxSensor FusionSynthetic Data GenerationTensorrtUnreal EngineVision TransformersYolo
Aerospace • Artificial Intelligence • Hardware • Machine Learning • Software • Defense • Manufacturing
Leads operations for an off-site aerospace test facility supporting propulsion, fluids, and structures testing. Manages engineers, technicians, staffing, campaigns, safety, regulatory compliance, facility readiness, maintenance, calibration, vendors, and test equipment. Serves as the on-site decision-maker for people, hardware, schedules, risks, and site readiness while coordinating with engineering, quality, and program management teams.
Top Skills:
Data Acquisition SystemsFluids SystemsHazardous Materials HandlingItarPressurized SystemsPropulsion SystemsStructural TestingTest Instrumentation
What you need to know about the San Francisco Tech Scene
San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.
Key Facts About San Francisco Tech
- Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Google, Apple, Salesforce, Meta
- Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
- Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
- Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine
