Customer-facing engineer who owns technical wins from POC to production: designs and runs reproducible inference benchmarks, tunes model-to-hardware deployments, conducts vendor bake-offs, handles security/compliance, drives post-signature account health, and produces reusable benchmark reports and reference architectures to accelerate sales and deployments.
About DeepInfra
Why this role matters
What You'll Do
What You Bring
Bonus
Why DeepInfra
How we work
DeepInfra is building the foundation for companies to use modern AI in production — simply, reliably, and at scale. Our team has deep experience building large systems that serve hundreds of millions of users, and we're bringing that same level of rigor to a rapidly evolving AI inference space. Our mission is to make advanced AI available to people and teams everywhere.
We're an early, tight-knit team where you can influence product direction, try bold ideas, and drive meaningful work forward quickly. If you want to join a fast-growing company at a defining moment, we'd love to talk.
DeepInfra is backed by leading investors including A.Capital, Felicis, 500 Global, Georges Harik, Samsung Next, Supermicro, Upper90, Peak6, SVAngel and Nvidia.
As DeepInfra's enterprise pipeline grows, our customers need a technical partner who can run rigorous evals, defend benchmarks, and speak fluently to both engineering and procurement — someone who can own the technical win from first call through production.
This is a pioneering role. You'll work closely with Sales, our co-founders, and the engineering team on the deals that matter most. You'll own the technical win end to end: running head-to-head bake-offs against leading AI providers, tuning deployments on the latest hardware, and turning what you learn into reusable assets that make every future deal faster to close. As our first FDE, you'll also define what the function looks like as GTM scales.
- Own the technical win and the POC timeline, working closely with Sales and Engineering, from call one.
- Design and run reproducible benchmark harnesses (TTFT, ITL, throughput/GPU, p95/p99) and quality-parity evals.
- Run head-to-head bake-offs against leading AI providers — and win them.
- Tune model-to-hardware deployments on B200/B300/GB300 NVL72.
- Build cost-per-token models and write migration plans.
- Handle enterprise security and compliance review, and get deployments to launch readiness.
- Own account health post-signature, driving usage reviews and expansion.
- Turn what you learn into reusable benchmark reports, reference architectures, and AE enablement material.
- Customer-facing engineering with an owned technical outcome at an infrastructure or ML platform company.
- Strong Python skills.
- Dual-audience presence with commercial instinct — credible with a skeptical staff engineer, clear with a CFO, and able to tell a technical objection from a procurement one.
- Hands-on experience with inference internals: vLLM, SGLang, or TRT-LLM, batching, KV cache math, quantization.
- Experience with agentic or coding-assistant workloads at scale.
- Prefix-cache-heavy long context workloads.
- Diffusion image/video, ASR/TTS, or multi-LoRA serving.
- Open-source contributions to vLLM or SGLang.
- Deep NVLink/InfiniBand topology knowledge.
- Define DeepInfra's Forward Deployed Engineering function from day one and have a direct impact on its direction.
- Work directly with co-founders and the inference team on the deals that matter most.
- Join a small, high-performing team where your work ships quickly and reaches customers around the world.
- Help shape how enterprises adopt some of the world's leading open-source AI models.
Three traits define the people who thrive here, and this role leans on all three.
Initiative. We take ownership and step in where we can add value. Whether it’s starting something new, improving what exists, or helping move ideas forward, we aim to be proactive and thoughtful in how we contribute.
Drive. We’re energized by hard problems. Building AI infrastructure is complex, and we lean into that. We care about doing things well, moving fast, and continuously improving — because solving meaningful challenges is what motivates us.
Grit. Things don’t always work on the first try — and that’s expected. We stay persistent, adapt quickly, and learn as we go. We take setbacks seriously, but not personally, and use them to get better.
CompensationThe base pay range for this role is $150,000 – $195,000 per year.
Deep Infra Inc. Palo Alto, California, USA Office
Palo Alto, California, United States, 94306
Similar Jobs
Fintech • Mobile • Software • Financial Services
Build and deploy AI-enabled workflows across internal departments, partnering with business leaders and subject-matter experts. Design agentic solutions, evaluations, integrations, tools, and reusable platform capabilities. Establish operating models for discovery, onboarding, adoption, production support, and continuous improvement. Translate deployment insights into enterprise AI platform investments while advising senior technical and business stakeholders.
Top Skills:
Agentic SystemsAi PlatformsDeveloper ToolsDistributed SystemsLarge Language ModelsWorkflow Systems
Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
Lead customer-facing design, deployment, and operation of agentic AI solutions on the ServiceNow platform. Analyze customer use cases, architect integrations and guardrails, validate reliability and safety, and guide production deployments. Establish reusable technical standards, reference architectures, and deployment patterns for the Forward Deployed Engineering group. Mentor engineers, advise customer stakeholders, and relay field insights to product and engineering teams.
Top Skills:
Agentic AiCpqCRMLarge Language Models (Llms)Machine LearningMonitoringRollback SystemsServicenowSystem Integrations
Artificial Intelligence • Cloud • Sales • Security • Software • Cybersecurity • Data Privacy
Leads technical customer engagements for strategic enterprise accounts, combining solution engineering, software implementation, consulting, and sales support. Responsibilities include discovering requirements, designing and documenting SailPoint solutions, conducting foundational implementations and proof-of-value engagements, educating customers on architecture and best practices, and developing AI-enabled demonstrations and agentic solutions. The role collaborates across sales, product, professional services, partners, and customer success, and may require up to 15% travel.
Top Skills:
Active DirectoryAgentic AiAngularApplication ServersArtificial IntelligenceAWSAzureCassandraClaude CodeCSSCursorDatabasesGCPGithub CopilotGoogle AntigravityHTMLJavaJavaScriptJSONKiroLdapLinuxMachine LearningMicrosoft Sql ServerMongoDBMySQLNode.jsOne IdentityOpenai CodexOracleOracle Identity ManagerPeoplesoftPowershellReactRedisRsa AveksaSaaSSailpointSAPSaviyntServicenowSoapSpmlSpring BootSpring MvcSQLSybaseTypescriptUnixVirtualizationVueWeb ServicesWindowsXML
What you need to know about the San Francisco Tech Scene
San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.
Key Facts About San Francisco Tech
- Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Google, Apple, Salesforce, Meta
- Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
- Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
- Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine
