SPREEAI Logo

SPREEAI

Software Engineer (AI Infrastructure / Training / Inference)

Posted Yesterday
In-Office
San Francisco, CA, USA
Entry level
In-Office
San Francisco, CA, USA
Entry level
Build and operate scalable AI infrastructure for multimodal model training and inference. Responsibilities include developing model-serving APIs, distributed GPU systems, backend services, deployment automation, observability, reliability improvements, and performance and cost optimization. The engineer will partner with applied science teams to productionize generative and vision models while improving platform usability and scalability.
The summary above was generated by AI

SPREEAI is a fast-growing, innovative AI company at the forefront of fashion and e-commerce, revolutionizing how consumers engage with fashion through lifelike photorealistic try-on technology and hyper-personalized shopping experiences. Our mission is to redefine the retail landscape with cutting-edge AI solutions that blend high fashion and technology. We thrive in a dynamic, fast-paced environment where creativity meets technology to drive real impact. If you are passionate about innovation and shaping the future of fashion, SPREEAI offers a platform to make your mark.

About the Role

We are hiring Software Engineers focused on AI Infrastructure to build the systems that enable frontier multimodal AI to operate reliably at production scale. This role exists because modern generative and vision models require infrastructure beyond traditional backend engineering — including GPU orchestration, large-scale inference systems, performance optimization, and developer platforms that allow applied scientists to move fast without sacrificing reliability or cost efficiency.

 

You will work on:

  • Scalable model serving and inference pipelines.
  • Distributed GPU infrastructure.
  • Performance and cost optimization.
  • Reliability, observability, and production readiness.

You will operate at the boundary between systems engineering and machine learning — building the “paved roads” that allow advanced AI systems to scale safely and efficiently.

What you'll do

  • Design and build scalable infrastructure supporting training and inference workflows.
  • Develop high-performance APIs and backend services for AI model serving.
  • Optimize GPU utilization, latency, and throughput for multimodal workloads.
  • Build distributed systems supporting large-scale generative models.
  • Improve observability, monitoring, and reliability of AI systems.
  • Partner closely with Applied Science teams to productionize research systems.
  • Drive improvements in deployment workflows, automation, and platform usability.


Qualifications

  • Degree in Computer Science, Engineering, or comparable combination of education and practical experience.
  • Strong object-oriented programming skills (Python, C++, Java, Go, or similar).
  • Strong data structures and algorithms foundations.
  • Experience building production backend or distributed systems.
  • Understanding of cloud infrastructure concepts and containerized systems.

 Preferred Qualifications

  • Experience with Kubernetes, Docker, or container orchestration.
  • Familiarity with GPU-based ML workloads or distributed training/inference systems.
  • Experience with model serving frameworks (vLLM, Triton, Ray Serve, or similar).
  • Experience with observability tools and performance debugging.
  • Familiarity with PyTorch or ML workflows.
  • Interest in optimizing systems for efficiency, scalability, and developer velocity.

Similar Jobs

26 Minutes Ago
In-Office
Sunnyvale, CA, USA
182K-242K Annually
Senior level
182K-242K Annually
Senior level
Cloud • Information Technology • Machine Learning
Design and build secure, high-performance sandboxed runtime environments for Kubernetes workloads. Develop GPU-aware scheduling, isolation, and resource-management strategies; integrate containers, lightweight virtual machines, and virtualization technologies; optimize container, VM, I/O, and GPU performance; conduct profiling and benchmarking; and contribute to Linux, runtime, virtualization, and GPU architecture decisions.
Top Skills: BashCC++Container OrchestrationContainer RuntimesGoGpu DriversGvisorKata ContainersKubernetesKubevirtLinuxQemuRustVirtualization
27 Minutes Ago
Hybrid
San Francisco, CA, USA
149K-213K Annually
Senior level
149K-213K Annually
Senior level
Cloud • Information Technology • Security • Software • Cybersecurity
Leads complex cybersecurity and networking migration and implementation projects for strategic customers. Owns project governance, scope, budgets, timelines, risks, resources, change control, executive reporting, and customer relationships from sales transition through closeout. Coordinates technical teams, partners, vendors, and stakeholders while developing scalable delivery methodologies. Uses AI tools to improve project workflows, reporting, risk identification, and productivity.
Top Skills: Ai ToolsAPIsCloudflareCybersecurityDnsJIRANetworkingProfessional Services Automation (Psa)SalesforceSaseZero Trust
27 Minutes Ago
Easy Apply
Hybrid
San Francisco, CA, USA
Easy Apply
127K-191K Annually
Senior level
127K-191K Annually
Senior level
Artificial Intelligence • Cloud • Information Technology • Machine Learning • Software • Big Data Analytics • Automation
The Senior HRIS Analyst administers and enhances PagerDuty’s Workday ecosystem across HCM, compensation, onboarding, benefits, payroll, and security. Responsibilities include configuration, troubleshooting, audits, release testing, AI feature implementation, automation, stakeholder collaboration, user adoption, and responsible AI governance. The role requires maintaining data integrity, evaluating new Workday capabilities, and partnering with Security, Legal, and IT on privacy, access controls, and change management.
Top Skills: AgileAi ToolsScrumWorkday

What you need to know about the San Francisco Tech Scene

San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.

Key Facts About San Francisco Tech

  • Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Google, Apple, Salesforce, Meta
  • Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
  • Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
  • Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account