As a Software Engineer, you will collaborate on designing, developing, and testing AI models, maintain production systems, and explore new techniques within a small, impactful team.
DeepInfra is looking for early-career Software Engineers (0-2 years of experience, including internships) to join our team. You’ll work closely with our experienced engineers to design, build, and scale infrastructure for serving top open-source AI models. This role is ideal for recent graduates or junior engineers who want to grow quickly while working on high-impact, real production AI systems.
If you’re excited about AI/ML, have taken related courses or built projects, and want to learn how to ship things at scale - we’d love to meet you.
- Collaborate with engineers to design, develop, and test inference solutions for state-of-the-art AI models.
- Implement, optimize, and evaluate AI models using Python, C++, CUDA, and NCCL (previous exposure helpful - deep expertise not required).
- Monitor and maintain production model-serving systems.
- Work on new features, fix bugs, and contribute to code reviews.
- Participate in daily standups, design reviews, and team discussions.
- Explore new AI/ML techniques and tools, and experiment with improving model performance.
- Try new things. Ship stuff.
What You Bring
- Bachelor’s or Master’s degree in Computer Science, Computer Engineering, or a related field (completed or in final year).
- Strong fundamentals in data structures, algorithms, and software design.
- Proficiency in Python, including experience with AI/ML libraries and frameworks (e.g., NumPy, pandas, SciPy, TensorFlow, PyTorch).
- Experience with AI/ML through coursework, research, personal projects, full-time employment, or internships.
- Familiarity with AI models, Transformers and Diffusers.
- Experience with version control systems (e.g., Git) and agile development methodologies.
- Excellent problem-solving skills, with the ability to debug and optimize code.
- Strong communication and collaboration skills.
- Curiosity, willingness to learn, and desire to build real systems.
- Exposure to C++, CUDA, or AI inference.
- Contributions to open-source ML projects.
Why DeepInfra
- Work on cutting-edge AI model serving - the systems that power the next generation of LLMs and multimodal models.
- Small team, huge impact: your work ships directly to customers.
- Opportunity to learn from engineers building high-performance inference at scale.
- Fast-paced environment with ownership, autonomy, and end-to-end responsibility.
Annual base salary range
$140,000 - $150,000
Top Skills
C++
Cuda
Git
Nccl
Numpy
Pandas
Python
PyTorch
Scipy
TensorFlow
Deep Infra Inc. Palo Alto, California, USA Office
Palo Alto, California, United States, 94306
Similar Jobs
Aerospace • Artificial Intelligence • Hardware • Machine Learning • Software • Defense • Manufacturing
The Software Engineer I, Full Stack will develop features across the full stack from frontend to backend, focusing on satellite control and mission systems while collaborating with cross-functional teams.
Top Skills:
ElixirGraphQLGrpcJestPostgresReactReact Testing LibraryRestfulTypescriptVitestWebsocket
Cloud • Healthtech • Social Impact • Software • Biotech
As a Software Engineer at Benchling, you'll build and enhance the developer platform, including APIs and services, while collaborating with cross-functional teams.
Top Skills:
APIsGraphQLRest
Aerospace • Artificial Intelligence • Hardware • Machine Learning • Software • Defense • Manufacturing
Lead the technical vision and architecture of simulation software for spacecraft, focusing on multi-physics modeling and real-time execution, while driving engineering standards and mentoring teams.
Top Skills:
BazelC++Ci/CdCmakeDockerPython
What you need to know about the San Francisco Tech Scene
San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.
Key Facts About San Francisco Tech
- Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Google, Apple, Salesforce, Meta
- Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
- Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
- Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine
