NVIDIA Logo

NVIDIA

Senior Manager, Engineering - Enterprise AI and Automation

Reposted 20 Hours Ago
Be an Early Applicant
In-Office
Santa Clara, CA, USA
272K-431K Annually
Senior level
In-Office
Santa Clara, CA, USA
272K-431K Annually
Senior level
Lead NVIDIA’s agentic developer platform strategy and execution. Build scalable platform capabilities from emerging agent patterns, including RAG, vector databases, evaluation systems, governance, safety tooling, and GPU-optimized workflows. Integrate the AI Data Platform with NVIDIA’s on-prem AI Factory, improve distributed inference performance, and establish controls for data lineage, compliance, and Responsible AI. Grow a high-performing engineering team and drive adoption of reusable APIs, SDKs, components, and reference implementations across the company.
The summary above was generated by AI

As a Senior Engineering Manager for Agentic Systems & Platform Architecture, you will lead the strategy and execution for NVIDIA’s agentic developer platform—deeply understanding how teams across the company build, evaluate, and improve autonomous agents, and turning those evolving patterns into scalable platform capabilities. You will identify gaps and friction, drive rapid proof-of-concepts on emerging agent constructs and ecosystem tools, and operationalize the best approaches into reusable building blocks, integrations, and governance mechanisms that accelerate developer productivity and agent quality. If you’re passionate about staying at the forefront of agent architectures and turning experimentation into real business impact, this role offers a chance to build a platform. This platform helps teams safely ship more autonomous systems at NVIDIA scale.

What you will be doing:

  • Track and deeply understand evolving agent development patterns across NVIDIA and the broader ecosystem

  • Identify gaps and friction in current agent architectures, and translate insights into a platform strategy that boosts developer velocity and agent quality—backed by evaluations, benchmarking, and feedback loops

  • Assess and integrate open source and third-party tools where they add leverage; drive clear build-vs-use decisions

  • Architect and integrate high-performance data pipelines, RAG systems, vector databases, and GPU-optimized training and inference workflows.

  • Lead integration of the AI Data Platform into NVIDIA’s on-prem AI Factory, optimizing GPU-to-storage throughput, data locality, and distributed inference performance.

  • Establish and enforce robust Agent Governance policies across the platform, covering model/tool usage, data lineage, and ensuring adherence to compliance and Responsible AI frameworks.

  • Design, implement, and maintain a centralized Agent Safety Toolkit, providing developers with pre-vetted components for input/output guardrails and prompt injection defenses

  • Lead and grow a high-performing team along with a multi-functional community to standardize procedures and scale adoption

What we need to see:

  • Bachelor’s degree in CS/Engineering or equivalent experience

  • 10+ overall years in software engineering, including 4+ years managing high-performing teams

  • Strong hands-on experience with evolving agent architectures and open-source libraries; deep expertise in LLM/agent architectures—leading POCs and integrating them into real business use cases with measurable adoption/impact

  • Ability to turn fast-moving, ambiguous problem spaces into clear platform strategy, roadmap, and outcomes

  • Proven track record building multi-team developer platforms (APIs/SDKs, reusable components, reference implementations)

  • Experience building evaluation/benchmarking systems for agent workflows (metrics, regression, feedback loops)

  • Strong judgment integrating OSS/3P tools; clear build-vs-use decision-making and integration strategy

  • Product approach for safety and governance: controls, audit ability, monitoring, and risk management

  • Strong leadership and executive communication (engineering, product, security, research)

Ways to stand out from the crowd:

  • Experience implementing enterprise-grade governance for agent systems (controls, audit-ability, monitoring, policy enforcement) in production autonomous workflows

  • Demonstrated wins taking new/open-source agent constructs from POC to production adoption, with clear business impact (cycle time, quality, cost, reliability)

  • Built and scaled an agent platform or agent developer experience used by multiple teams (SDKs, templates, reference apps, reusable building blocks)

  • Clear point of view and real examples on build-vs-use decisions—when to adopt OSS/3P vs build internal primitives—and how to operationalize the choice

  • Deep experience with agent evaluation at scale (long-horizon tasks, tool correctness, reliability testing, automated regressions, offline/online feedback loops)

We have some of the most forward-thinking and hardworking people in the world working for us. If you're creative and autonomous, we want to hear from you! Ready to take your career to the next level? Apply now and join the innovation!

Your base salary will be determined based on your location, experience, and other objective job-related factors. The expected base salary range for this position is 272,000 USD – 431,250 USD.

You will also be eligible for equity and benefits.

Applications for this job will be accepted at least until November 3, 2026.

This posting is for an existing vacancy. 

NVIDIA uses AI tools in its recruiting processes.

NVIDIA is committed to fostering an inclusive work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

HQ

NVIDIA Santa Clara, California, USA Office

2701 San Tomas Expressway, Santa Clara, CA, United States, Santa Clara

NVIDIA San Francisco, California, USA Office

San Francisco, United States

NVIDIA San Jose, California, USA Office

San Jose, United States

Similar Jobs

45 Minutes Ago
Hybrid
San Francisco, CA, USA
150K-205K Annually
Senior level
150K-205K Annually
Senior level
Fintech • Machine Learning • Payments • Software • Financial Services
Develop and lead Workday Finance integrations and configurations across General Ledger, Fixed Assets, Expenses, Consolidation, Invoices, Payments, and Suppliers. Translate business priorities into resilient solutions, automate workflows, improve processes, conduct testing and code reviews, and collaborate with product owners and finance stakeholders using Agile methodologies. Lead integrators and configurators while maintaining platform performance, quality, and enterprise standards.
Top Skills: AgileEnterprise Interface Builder (Eib)RestSoapWorkdayWsdlXMLXslt
45 Minutes Ago
Hybrid
San Jose, CA, USA
219K-272K Annually
Junior
219K-272K Annually
Junior
Fintech • Machine Learning • Payments • Software • Financial Services
Conduct applied AI research and build foundation models, including vision-language models, across design, training, evaluation, validation, and deployment. Collaborate with data scientists, engineers, and product managers to deliver scalable AI products. Develop research methods, reproduce and extend published work, optimize training and inference, and contribute to technical reports and conference submissions. Own research problems and agendas while translating complex findings into business outcomes.
Top Skills: Aws UltraclustersHugging FaceLightningPyTorch
45 Minutes Ago
Hybrid
2 Locations
209K-286K Annually
Senior level
209K-286K Annually
Senior level
Fintech • Machine Learning • Payments • Software • Financial Services
Leads large-scale full-stack engineering initiatives, technical architecture, and developer teams building distributed, cloud-native systems. Designs reliable microservices and platform solutions using modern programming languages, databases, containers, and cloud services. Partners with product leaders and architects on technology roadmaps, mentors engineers, establishes engineering standards, drives observability and performance improvements, and leads cross-functional technical initiatives.
Top Skills: Ai Coding ToolsAPIsAutomated Testing FrameworksAWSAzureBitbucketC#Ci/CdDockerGCPGitGitGoIde CopilotsInfrastructure As CodeJavaJavaScriptKubernetesNode.jsNoSQLObservabilityOpen Source FrameworksPythonRdbmsRustScalaTypescript

What you need to know about the San Francisco Tech Scene

San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.

Key Facts About San Francisco Tech

  • Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Google, Apple, Salesforce, Meta
  • Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
  • Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
  • Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account