TwelveLabs Logo

TwelveLabs

Senior AI Engineer, Tools & Agents

Posted 7 Days Ago
Hybrid
San Francisco, CA, USA
200K-240K Annually
Senior level
Hybrid
San Francisco, CA, USA
200K-240K Annually
Senior level
Own the agent-facing integration layer (MCP server) that exposes multimodal video/image AI capabilities to developers and agents. Build auth (OAuth/OIDC/RBAC), multi-tenant isolation, usage tracking, rate limiting, and reliability for enterprise scale. Design API contracts, handle failure modes, and partner with research to productize video understanding features.
The summary above was generated by AI
Who we are

Video is 90% of the world's data. Most of it is invisible to machines.
TwelveLabs builds the intelligence layer to change that. Our multimodal AI models understand video the way humans do — across sight, sound, and motion — and power production-scale AI workloads across media, entertainment, sports, security, and government.


We have raised more than $210 million from NEA, Radical Ventures, Amazon, NVIDIA, Snowflake, Databricks, Index Ventures, NAVER Ventures, Korea Investment Partners, Quadrille Capital, Red Bull Ventures, and AI pioneers including Fei-Fei Li, Silvio Savarese, and Alexandr Wang.


We are a global company, headquartered in San Francisco with offices in Seoul, New York, and London, and employees around the world. We believe the differences in our cultural, educational, and life experiences make our products stronger. Building technology that understands the world in all its complexity requires people who see it from every angle. We are looking for individuals who are driven by hard problems and want their work to matter. Come build it with us!

About the Role

We're hiring a senior AI engineer to own the integration layer that makes TwelveLabs' video AI accessible to the world.

Jockey is TwelveLabs' multimodal agent for video and image understanding. It's built on a knowledge store of ingested content, retrieval primitives like search, and an agent layer that orchestrates those primitives: planning, calling them, and reasoning over results to return grounded, cited answers. The engineer in this role owns the surfaces that make this system accessible to external developers and AI agents.

Learn more about Jockey here.

The engineer in this role decides how AI agents and developers connect to these capabilities, and you'll build the agent harness and the supporting infrastructure that makes that connection trustworthy at enterprise scale.

The center of gravity is our MCP server. You'll own it end-to-end: how agents discover and invoke our capabilities, what the tool interfaces look like, how failure modes are handled, and how the surface evolves as the agentic ecosystem does. Everything else, auth, metering, rate limiting, is the substrate that makes that surface something an enterprise customer will trust.

Location: San Francisco. Onsite or hybrid. No fully remote option.

In this role, you will own
  • The agent-facing integration surface. TwelveLabs' MCP server and agent-to-agent interfaces are yours to design and operate. You'll decide how AI agents discover, connect to, and build on Jockey's retrieval and reasoning capabilities, and you'll be the person who knows what breaks and why.

  • The auth and access substrate. OAuth, RBAC, and multi-tenant isolation for enterprise customers. This is the work that turns a powerful capability into something a large organization will put in production. You'll design it from scratch rather than configure someone else's framework.

  • The enterprise-readiness layer. Per-API-key usage tracking, rate limiting grounded in real system constraints, and the reliability work that makes the platform trustworthy under real load. You'll define how the platform behaves under pressure before customers find out the hard way.

  • The research partnership. You'll work directly with our research team to turn frontier video and image understanding capabilities into durable product surfaces. The loop from research to what customers can build is short, and you're a key part of closing it.

You may be a good fit if you have
  • You've shipped real agentic or LLM-powered systems. Not demos, but production systems with real users and real failure modes you had to debug and fix. You can talk about what broke, why, and what you changed.

  • You understand how retrieval, reasoning, and agent orchestration fit together as a system. Jockey's architecture sits at that intersection, and the integration surfaces you build need to reflect how that system actually behaves under real conditions.

  • You've owned a developer-facing or external API end-to-end, with real decisions about contracts, versioning, and the experience of building on top of your surface.

  • You've built authentication and authorization in production, OAuth, OIDC, RBAC, or multi-tenant isolation, as a primary owner and not a consumer of someone else's framework.

  • You've thought seriously about enterprise-readiness: what it takes to go from a capability that works to a platform that a large customer will trust with their data and workflows.

  • You bring versatility across the full platform surface. We're not looking for a specialist in one of these areas. We're looking for someone who can own all of them and make good tradeoffs across them.

  • You've operated in a fast-moving environment before, a startup, a hypergrowth company, or an AI-first team where you shipped under ambiguity without heavy process support.

Preferred Qualifications
  • Experience with MCP, A2A protocols, or the broader agent ecosystem. You've contributed to or built on these surfaces and understand where they're headed.

  • Hypergrowth pedigree from a technically excellent startup.

Benefits and Perks

🤝 An open and inclusive culture and work environment.

🚀 Work closely with a collaborative, mission-driven team on cutting-edge AI technology.

🏥 Full health, dental, and vision benefits

✈️ Extremely flexible PTO and parental leave policy. Office closed the week of Christmas and New Years.

🛂 VISA support where applicable

HQ

TwelveLabs San Francisco, California, USA Office

55 Green St, San Francisco, California, United States, 94111

Similar Jobs

38 Minutes Ago
Remote or Hybrid
7 Locations
121K-213K Annually
Mid level
121K-213K Annually
Mid level
eCommerce • Fintech • Hardware • Payments • Software • Financial Services
Build and operate ingestion and reconciliation pipelines that match card-network and partner reports against internal transactions. Develop reporting products, produce standardized journals for accounting, support tax and regulatory filing systems, handle sensitive PII for compliance, debug production issues, and collaborate with finance, product, and data teams to automate and scale reconciliation and reporting.
Top Skills: Ai ToolsAirflowAWSBigQueryCi/CdDelta LakeGoHadoopIso-8583JavaKafkaKubernetesPysparkPythonSnowflakeSparkSQLTemporalTerraform
An Hour Ago
In-Office
San Jose, CA, USA
Senior level
Senior level
Artificial Intelligence • Cloud • Software • Big Data Analytics
Embed with strategic customers to prototype, build, and deploy production-grade AI and agentic applications on Cloudera; advise on AI strategy, codify repeatable architectures, mentor teams, and channel customer feedback to product.
Top Skills: Agentic SystemsAWSAzureClouderaContext EngineeringFine-TuningFoundation ModelsGCPGenerative AiIcebergInference OptimizationLlmopsMlopsModel ServingNifiNvidia GpusRetrieval-Augmented Generation (Rag)Semantic SearchSpark
An Hour Ago
Remote or Hybrid
88K-118K Annually
Senior level
88K-118K Annually
Senior level
Cloud • Fintech • Software • Business Intelligence • Consulting • Financial Services
The Senior Consultant develops and implements business process and technology solutions for clients, provides training, and manages project risks and deliverables while mentoring junior consultants.
Top Skills: Active DirectoryAzure

What you need to know about the San Francisco Tech Scene

San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.

Key Facts About San Francisco Tech

  • Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Google, Apple, Salesforce, Meta
  • Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
  • Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
  • Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account