Microsoft Logo

Microsoft

Senior AI Hardware Product Manager

Reposted 21 Days Ago
Be an Early Applicant
In-Office
Mountain View, CA, USA
120K-261K Annually
Senior level
In-Office
Mountain View, CA, USA
120K-261K Annually
Senior level
Leads product definition and development for next-generation AI hardware supporting Azure training and inference workloads. Identifies customer needs, market opportunities, and competitive gaps; translates them into product requirements, roadmaps, investment proposals, and hardware strategies. Drives technical programs from concept through execution while collaborating with architecture, engineering, business teams, customers, and senior leadership. Requires expertise in AI systems, GPU architecture, networking, data centers, reliability, and cloud infrastructure.
The summary above was generated by AI
Overview

Do you want to be at the forefront of innovating the latest hardware designs to propel Microsoft’s cloud growth? Are you seeking a unique career opportunity that combines technical capabilities, cross-team collaboration, with business insight and strategy?  

Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees, we come together with a growth mindset, innovate to empower others, and collaborate to achieve our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond. In alignment with our Microsoft values, we are committed to cultivating an inclusive work environment for all employees to positively impact our culture every day. 

Join the Systems Planning and Architecture (SPARC) team within Microsoft’s Azure Hardware Systems and Infrastructure (AHSI) organization, the team behind Microsoft’s expanding Cloud Infrastructure and for powering Microsoft’s “Intelligent Cloud” mission. Microsoft delivers more than 200 online services to more than one billion individuals worldwide, and AHSI is the team behind our expanding cloud infrastructure. We deliver the core infrastructure and foundational technologies for Microsoft's cloud businesses including Microsoft Azure, Bing, MSN, Office 365, OneDrive, Skype, Teams and Xbox Live.    

We are seeking a Senior AI Hardware Product Manager to join the AI Hardware Products Planning team to drive definition of the next generation hardware used in Azure to train and infer on the best-in-class AI models for a plethora of use cases.  This role will help define the future of Supercomputing systems at a planet scale. 


Responsibilities

Responsibilities: 

  • Collaborate with customers and partner organizations to define future generations of Artificial Intelligence (AI) Hardware for Azure at Microsoft.  

  • Identify and prioritize customer needs, market opportunities, and competitive gaps, and translate them into clear and actionable product requirements and specifications.  

  • Drive executive decision making for new investments, including competitive analysis, program goals and business requirements, architectural concepts, risk management strategies, financial analysis, schedule and hardware strategy.  

  • Lead technical programs from concept to execution, collaborating with architecture, engineering and business teams to develop and drive end-to-end product development  

  • Develop and maintain a high level of technical proficiency in AI workload requirements, AI technology landscape and AI Industry roadmaps. 

  • Engage with senior leadership, highlighting risks across functional teams and providing recommendations to support product level decisions.  

  • Operate effectively in ambiguity. Apply process where it creates value, and design process where it’s needed. Recognize the situations where each approach is most appropriate.


Qualifications

Required/Minimum Qualifications 

  • Bachelor's Degree AND 5+ years experience in product/service/program management or software development OR equivalent experience.

Other Requirements 

  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include but are not limited to the following specialized security screenings: Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud Background Check upon hire/transfer and every two years thereafter

Preferred Skills:

  • Bachelor's Degree AND 8+ years experience in product/service/program management or software development OR equivalent experience.
    2+ years experience taking a product, feature, or experience to market (e.g., design, addressing product market fit, and launch, internal tool/framework).
    4+ years experience improving product metrics for a product, feature, or experience in a market (e.g., growing customer base, expanding customer usage, avoiding customer churn).
    4+ years experience disrupting a market for a product, feature, or experience (e.g., competitive disruption, taking the place of an established competing product).
  • 2+ years of experience working on AI systems as an architect or a product manager 
  • Familiar with AI systems roadmaps from Nviida, AMD, Microsoft and AI infrastructure challenges 

  • Strong understanding of several of the below areas: GPU Architecture, Scale Up and Scale out networking, Data Center Specifications, Model Architecture and System Reliability 

  • 3+ years of technical product management experience, including products within datacenter Hardware systems and/or Cloud infrastructure.  

  • 3+ years experience creating product roadmap(s) from conception to launch, driving end-to-end program execution, defining product go-to-market strategy, and leading program direction discussions.  
     


Product Management IC4 - The typical base pay range for this role across the U.S. is USD $119,800 - $234,700 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $160,200 - $261,000 per year.

Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here:
https://careers.microsoft.com/us/en/us-corporate-pay


This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.



Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.

Microsoft Mountain View, California, USA Office

1065 La Avenida, Mountain View, CA 94043, Mountain View, United States, 94043

Microsoft Palo Alto, California, USA Office

Palo Alto, United States

Microsoft San Francisco, California, USA Office

835 Market Street, Suite 700, San Francisco, CA 94103, San Francisco, United States, 94103

Microsoft San Jose, California, USA Office

San Jose, United States

Microsoft Sunnyvale, California, USA Office

Sunnyvale, United States

Similar Jobs

Yesterday
Easy Apply
Remote or Hybrid
United States
Easy Apply
100K-166K Annually
Senior level
100K-166K Annually
Senior level
Artificial Intelligence • Cloud • Computer Vision • Hardware • Internet of Things • Software
Manage enterprise customer implementations of Samsara’s IoT platform, from deployment planning through adoption and value realization. Build launch roadmaps, track implementation and account health, train executives and end users, resolve challenges, and coordinate with Sales, Support, Sales Engineering, Product, and other teams. Mentor Customer Success and Support colleagues while managing multiple customer engagements and strengthening long-term customer relationships.
Top Skills: Enterprise SoftwareIotSaaS
Yesterday
Easy Apply
Remote or Hybrid
TX, USA
Easy Apply
109K-145K Annually
Mid level
109K-145K Annually
Mid level
Artificial Intelligence • Cloud • Computer Vision • Hardware • Internet of Things • Software
The Sales Engineer will modernize essential industries by promoting IoT solutions, support customers through technical assessments, and facilitate hardware installations, enhancing supply chain efficiency and safety.
Top Skills: AIAutomation And Control SystemsBashBusiness Systems IntegrationCloud SoftwareCloud-Connected HardwareComputer NetworkingElectronicsIotJavaScriptPython
Yesterday
Easy Apply
Remote or Hybrid
United States
Easy Apply
109K-129K Annually
Junior
109K-129K Annually
Junior
Artificial Intelligence • Cloud • Computer Vision • Hardware • Internet of Things • Software
Serve as a technical sales expert for Samsara’s IoT platform, supporting discovery, demonstrations, value assessments, proof-of-concepts, deployment planning, and customer integrations. Explain complex solutions to nontechnical stakeholders, advise installers, write API automation scripts, translate customer feedback to product teams, and support strategic sales cycles. The role is remote in the U.S. West region and requires travel up to 50%.
Top Skills: AIAutomation And Control SystemsBashBusiness Systems IntegrationCan BusCloud InfrastructureCloud SoftwareCloud-Connected HardwareComputer NetworkingComputer VisionElectrical SystemsElectronicsIotJavaScriptOpen ApiPto ApplicationsPython

What you need to know about the San Francisco Tech Scene

San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.

Key Facts About San Francisco Tech

  • Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Google, Apple, Salesforce, Meta
  • Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
  • Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
  • Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account