Teams at Vast.ai

Deploys, fine-tunes, and serves open-source AI models on rented GPUs using tools such as vLLM and SGLang. Builds public example repositories, Docker templates, benchmarks, and live endpoints, then teaches through technical writing, videos, talks, livestreams, and community support. Reports product friction to engineering and product teams, represents Vast at hackathons and conferences, and serves as a highly credible technical voice across developer communities.

Design and scale infrastructure powering a global GPU marketplace. Responsibilities include GPU provisioning, workload scheduling, orchestration, provider onboarding, usage tracking, billing, pricing logic, resource management, and marketplace APIs. The engineer will optimize performance, reliability, security, fault tolerance, and multi-tenant cloud systems while collaborating with product and infrastructure teams. The role requires strong Python and C++ development, distributed systems expertise, and experience building large-scale compute platforms.

Lead approximately eight engineers across product and infrastructure teams while remaining hands-on in the codebase. Own platform delivery, engineering quality, reliability, incident response, hiring, team design, performance development, and execution cadence. Partner with the CEO on technical direction and product priorities, ship critical-path software, build a hiring plan for at least four senior engineers, and establish effective release and incident-review processes.