Design and develop inference solutions for AI models, optimize performance, and maintain production systems while owning end-to-end problems.
DeepInfra is looking for early-career Software Engineers to join our team. You’ll work on designing, building, and scaling infrastructure for serving top open-source AI models in production. This role is ideal for engineers who are already comfortable owning problems end-to-end and want to deepen their experience working on high-impact AI systems.
If you’re excited about AI/ML, have built and shipped projects, and are looking to work on real systems at scale — we’d love to meet you.
- Design, develop, and test inference solutions for state-of-the-art AI models
- Implement, optimize, and evaluate AI models using Python, C++, CUDA, and NCCL
- Own and operate production model-serving systems, including monitoring and debugging
- Build new features, improve system performance, and contribute to overall system design
- Participate in code reviews and technical discussions to maintain high engineering standards
- Explore and apply new AI/ML techniques to improve model performance and efficiency
- Take ideas from concept to production
- Bachelor’s or Master’s degree in Computer Science, Computer Engineering, or a related field
- 1–4 years of relevant experience, including early full-time roles or research
- Strong fundamentals in data structures, algorithms, and software design
- Proficiency in Python and experience working with AI/ML frameworks (e.g., PyTorch, TensorFlow)
- Hands-on experience building, shipping, and maintaining software systems
- Familiarity with AI models, Transformers, and Diffusers
- Experience working with version control (Git) and collaborative development workflows
- Ability to debug, optimize, and improve existing systems
- Strong communication skills and ability to work independently in a fast-paced environment
- Experience with C++, CUDA, or AI inference
- Contributions to open-source ML projects
- Work on cutting-edge AI model serving - the systems that power the next generation of LLMs and multimodal models.
- Small team, huge impact: your work ships directly to customers.
- Opportunity to learn from engineers building high-performance inference at scale.
- Fast-paced environment with ownership, autonomy, and end-to-end responsibility.
Annual base salary range
$150,000 - $195,000
Top Skills
C++
Cuda
Git
Nccl
Python
PyTorch
TensorFlow
Deep Infra Inc. Palo Alto, California, USA Office
Palo Alto, California, United States, 94306
Similar Jobs
Aerospace • Artificial Intelligence • Hardware • Machine Learning • Software • Defense • Manufacturing
The Software Engineer I, Full Stack will develop features across the full stack from frontend to backend, focusing on satellite control and mission systems while collaborating with cross-functional teams.
Top Skills:
ElixirGraphQLGrpcJestPostgresReactReact Testing LibraryRestfulTypescriptVitestWebsocket
Cloud • Healthtech • Social Impact • Software • Biotech
As a Software Engineer at Benchling, you'll build and enhance the developer platform, including APIs and services, while collaborating with cross-functional teams.
Top Skills:
APIsGraphQLRest
Aerospace • Artificial Intelligence • Hardware • Machine Learning • Software • Defense • Manufacturing
Lead the technical vision and architecture of simulation software for spacecraft, focusing on multi-physics modeling and real-time execution, while driving engineering standards and mentoring teams.
Top Skills:
BazelC++Ci/CdCmakeDockerPython
What you need to know about the San Francisco Tech Scene
San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.
Key Facts About San Francisco Tech
- Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Google, Apple, Salesforce, Meta
- Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
- Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
- Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine
