Tensordyne Logo

Tensordyne

Director of Product Management

Reposted One Month Ago
Be an Early Applicant
In-Office
Sunnyvale, CA, USA
Senior level
In-Office
Sunnyvale, CA, USA
Senior level
The role involves leading the development of AI inference compute products, engaging with partners and customers, and managing product strategies and performance metrics.
The summary above was generated by AI

About Tensordyne:

Artificial intelligence (AI) is transforming our world. It can perform cognitive functions that previously only humans could do, such as perceiving interactions across different modalities and environments - with the ability to quickly learn and then solve complex problems. Tensordyne is an AI system solution company that builds very high-performance, low-power generative AI inference systems. Our mission, through the creation of custom silicon, hardware and software, is to enable multimodal Generative AI inference acceleration at scale, with safe, sustainable, high-performance systems for our hyperscaler and neocloud data center customers. We are at the leading edge of advancing the latest research and product improvements for generative Al inference solutions that will make Al even more advantageous for compelling new generative AI applications. Tensordyne is a well funded, fast-paced startup company with headquarters in both Sunnyvale, CA, and Munich, Germany. We also have many talented team members working remotely across North America and Europe. We take care of our people and their families with comprehensive benefits, competitive compensation, flexible spending options, and recognition programs, because building category-defining technology starts with a healthy, supported team. Come join us as we shape the future of multimodal generative artificial intelligence!

About the role:

To keep developing world-class AI Inference compute systems (from silicon to software), we're looking for an experienced (Sr.) Director of Technical Product Management who is passionate and deeply knowledgeable about Al inference compute in datacenters, across the entire stack (silicon, hardware and software). We need a self-starter reporting to the VP of product management, you will help focus  AI compute product efforts that will define the future of inference at customers of Tensordyne. The successful candidate will have a years-long background in engineering enabling them to have a profound technical understanding of most if not all dimensions of the product, along with experience in product management, business development, great communication and networking skills. If that's you, then we'd love to talk to you!

Where you'd help us: 

  • Leading the definition of Tensordyne's next generation of Al inference compute products, with an innovative yet pragmatic and well-communicated technology roadmap in, shaping the company’s GTM strategy
  • Engaging with our external technology partners, customers, Al industry researchers and internal engineering & business stakeholders to coalesce insights and requirements into winning Al product plans and strategies. 
  • Researching, defining and driving essential competitive analysis, key metrics tracking, cost modeling, customer demos, and product release schedules to ensure Tensordyne's superiority to alternative solutions. 
  • Overseeing and ensuring the success of key customers' projects, anticipating their software and hardware needs, while reacting as necessary to pertinent feedback. 
  • Working hand-in-hand with marketing to design marketing campaigns with the goal of promoting Tensordyne's Al technology, products and demonstrating thought leadership
  • Occasional external spokesperson (conferences etc.)

Qualifications:

Technical 

(NOTE: we do not expect candidates to cover 100% of the list below - it depicts nevertheless all areas that eventually will require them to gain deep understanding in for them to ultimately become fully effective in this role)

  • Deep understanding of the execution flow of modern AI inference systems, particularly large-scale Mixture-of-Experts (MoE) models, and world models
  • Strong knowledge of AI inference architectures, including:
    • Key-Value (KV) cache management and optimization
    • AI inference server architectures
    • Multi-user and multi-agent inference scheduling
    • Parallelization techniques (tensor, pipeline, expert, and data parallelism)
    • Compute disaggregation and resource orchestration
    • Modern AI inference system KPIs, performance metrics, Pareto optimization, and efficiency trade-offs.
    • Prefill vs. Decode design trade-offs (from silicon to business model)
  • Comprehensive understanding of AI compute infrastructure, including:
    • Silicon architectures and accelerator technologies
    • Hardware performance characteristics and architectural trade-offs
    • System architecture and rack-scale design
    • High-performance networking topologies
    • Optical interconnects and next-generation data center infrastructure
  • Strong understanding of AI software stacks, including AI model compilers, runtime environments, and inference optimization frameworks.
  • Demonstrated ability to connect low-level hardware capabilities with system-level performance and customer business outcomes.
Business & Commercial Acumen
  • Strong techno-economic understanding of AI compute platforms, including:
    • Cost-performance optimization
    • Infrastructure Total Cost of Ownership (TCO)
    • Performance-per-dollar analysis
    • Energy efficiency and utilization metrics
    • Business models supporting large-scale AI inference deployments
  • Ability to translate complex technical concepts into compelling customer value propositions.
  • Understanding of commercial drivers influencing enterprise AI infrastructure purchasing decisions.

Product Management & Strategic Skills

  • Proven ability to define and execute product strategy for complex technical products.
  • Experience developing product roadmaps informed by customer requirements, competitive analysis, and technology trends.
  • Strong systems-thinking approach with the ability to evaluate trade-offs across hardware, software, infrastructure, performance, and economics.
  • Highly structured and organized approach to product planning, prioritization, execution, and cross-functional coordination.
  • Experience managing highly technical products throughout the product lifecycle.
  • BS or MS degree in Computer Science, Computer Engineering, or similar field.

 Tensordyne's culture was built on the following values

  • Put people first. We only succeed when our people succeed.
  • Ethics and integrity always; Being open, honest, and respectful of everyone.
  • Think Big. Be ambitious and have audacious goals of global scale.
  • Aim for excellence. Quality and excellence count in everything we do.
  • Own it and get it done. Results matter!
  • Make each person better together, than they would be as an individual.
  • Embrace each others’ differences, and embrace that there will be differences.

Tensordyne is an equal opportunity employer. We believe that a diverse team is better at tackling complex problems and coming up with innovative solutions. All qualified applicants will receive consideration for employment without regard to age, color, gender identity or expression, marital status, national origin, disability, protected veteran status, race, religion, pregnancy, sexual orientation, or any other characteristic protected by applicable laws, regulations and ordinances.

A note to Recruitment Agencies: Please don’t reach out to Tensordyne employees or leaders about our roles -- we’ve got it covered. We don’t accept unsolicited agency resumes and we are not responsible for any fees related to unsolicited resumes. Thank you for your understanding.

HQ

Tensordyne San Jose, California, USA Office

San Jose, CA, United States

Similar Jobs

Yesterday
Easy Apply
Hybrid
Mountain View, CA, USA
Easy Apply
315K-350K Annually
Expert/Leader
315K-350K Annually
Expert/Leader
Computer Vision • Hardware • Machine Learning • Robotics • Software
Leads software product management across autonomy, simulation, platforms, cloud tools, and fleet operations. Builds and manages the product team, owns software vision and roadmap governance, defines commercial strategy, and oversees products from research through deployment and continuous improvement. Partners with engineering, AI, hardware, UX, safety, compliance, customers, and vendors on architecture, testing, release decisions, data strategy, lifecycle management, and build-versus-buy choices. Requires deep software product expertise, robotics or autonomous systems experience, cloud-to-edge knowledge, and extensive leadership experience.
Top Skills: Artificial IntelligenceAutonomous VehiclesAutonomyCloud ComputingEdge ComputingFleet Management SoftwareMachine LearningMiddlewareNavigationPerceptionRoboticsSaaSSimulation
8 Days Ago
Hybrid
San Jose, CA, USA
229K-329K Annually
Senior level
229K-329K Annually
Senior level
Aerospace • Artificial Intelligence • Cloud • Machine Learning • Software • Cybersecurity • Defense
Leads international product strategy, portfolio lifecycle management, roadmaps, commercialization, and growth for aerospace defense offerings spanning electronic warfare, RF detection, radar, and integrated RF solutions. Translates customer mission needs and evolving threats into product requirements, investment priorities, partnerships, and differentiated value propositions. Partners with engineering, finance, business development, and executive stakeholders to drive revenue, market share, profitability, innovation, and global market expansion.
Top Skills: AIAutonomyElectronic WarfareHoneywell Operating SystemIntegrated Defense SystemsRadarRf
Yesterday
Hybrid
199K-348K Annually
Expert/Leader
199K-348K Annually
Expert/Leader
Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
Lead strategy and execution for ServiceNow’s global cloud platform portfolio across commercial, sovereign, partner-hosted, and customer-operated environments. Drive cross-functional initiatives involving engineering, operations, security, compliance, legal, infrastructure, and go-to-market teams. Define product roadmaps, evaluate customer and market needs, support strategic customer engagements, and influence executive decisions. The role requires deep cloud and enterprise SaaS expertise, strong ownership, and the ability to deliver outcomes across organizational boundaries.
Top Skills: AIAWSCloud-Native Ai ServicesGoogle Cloud PlatformAzureSaaSServicenow Cloud

What you need to know about the San Francisco Tech Scene

San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.

Key Facts About San Francisco Tech

  • Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Google, Apple, Salesforce, Meta
  • Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
  • Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
  • Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account