Microsoft Logo

Microsoft

Senior AI Hardware Product Manager

Reposted 4 Days Ago
Be an Early Applicant
In-Office
Austin, TX, USA
120K-261K Annually
Senior level
In-Office
Austin, TX, USA
120K-261K Annually
Senior level
Leads product definition and development for next-generation AI hardware supporting Azure training and inference workloads. Identifies customer needs, market opportunities, and competitive gaps; translates them into product requirements, roadmaps, investment proposals, and hardware strategies. Drives technical programs from concept through execution while collaborating with architecture, engineering, business teams, customers, and senior leadership. Requires expertise in AI systems, GPU architecture, networking, data centers, reliability, and cloud infrastructure.
The summary above was generated by AI
Overview

Do you want to be at the forefront of innovating the latest hardware designs to propel Microsoft’s cloud growth? Are you seeking a unique career opportunity that combines technical capabilities, cross-team collaboration, with business insight and strategy?  

Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees, we come together with a growth mindset, innovate to empower others, and collaborate to achieve our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond. In alignment with our Microsoft values, we are committed to cultivating an inclusive work environment for all employees to positively impact our culture every day. 

Join the Systems Planning and Architecture (SPARC) team within Microsoft’s Azure Hardware Systems and Infrastructure (AHSI) organization, the team behind Microsoft’s expanding Cloud Infrastructure and for powering Microsoft’s “Intelligent Cloud” mission. Microsoft delivers more than 200 online services to more than one billion individuals worldwide, and AHSI is the team behind our expanding cloud infrastructure. We deliver the core infrastructure and foundational technologies for Microsoft's cloud businesses including Microsoft Azure, Bing, MSN, Office 365, OneDrive, Skype, Teams and Xbox Live.    

We are seeking a Senior AI Hardware Product Manager to join the AI Hardware Products Planning team to drive definition of the next generation hardware used in Azure to train and infer on the best-in-class AI models for a plethora of use cases.  This role will help define the future of Supercomputing systems at a planet scale. 


Responsibilities

Responsibilities: 

  • Collaborate with customers and partner organizations to define future generations of Artificial Intelligence (AI) Hardware for Azure at Microsoft.  

  • Identify and prioritize customer needs, market opportunities, and competitive gaps, and translate them into clear and actionable product requirements and specifications.  

  • Drive executive decision making for new investments, including competitive analysis, program goals and business requirements, architectural concepts, risk management strategies, financial analysis, schedule and hardware strategy.  

  • Lead technical programs from concept to execution, collaborating with architecture, engineering and business teams to develop and drive end-to-end product development  

  • Develop and maintain a high level of technical proficiency in AI workload requirements, AI technology landscape and AI Industry roadmaps. 

  • Engage with senior leadership, highlighting risks across functional teams and providing recommendations to support product level decisions.  

  • Operate effectively in ambiguity. Apply process where it creates value, and design process where it’s needed. Recognize the situations where each approach is most appropriate.


Qualifications

Required/Minimum Qualifications 

  • Bachelor's Degree AND 5+ years experience in product/service/program management or software development OR equivalent experience.

Other Requirements 

  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include but are not limited to the following specialized security screenings: Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud Background Check upon hire/transfer and every two years thereafter

Preferred Skills:

  • Bachelor's Degree AND 8+ years experience in product/service/program management or software development OR equivalent experience.
    2+ years experience taking a product, feature, or experience to market (e.g., design, addressing product market fit, and launch, internal tool/framework).
    4+ years experience improving product metrics for a product, feature, or experience in a market (e.g., growing customer base, expanding customer usage, avoiding customer churn).
    4+ years experience disrupting a market for a product, feature, or experience (e.g., competitive disruption, taking the place of an established competing product).
  • 2+ years of experience working on AI systems as an architect or a product manager 
  • Familiar with AI systems roadmaps from Nviida, AMD, Microsoft and AI infrastructure challenges 

  • Strong understanding of several of the below areas: GPU Architecture, Scale Up and Scale out networking, Data Center Specifications, Model Architecture and System Reliability 

  • 3+ years of technical product management experience, including products within datacenter Hardware systems and/or Cloud infrastructure.  

  • 3+ years experience creating product roadmap(s) from conception to launch, driving end-to-end program execution, defining product go-to-market strategy, and leading program direction discussions.  
     


Product Management IC4 - The typical base pay range for this role across the U.S. is USD $119,800 - $234,700 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $160,200 - $261,000 per year.

Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here:
https://careers.microsoft.com/us/en/us-corporate-pay


This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.



Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.

Similar Jobs

20 Minutes Ago
Hybrid
Senior level
Senior level
Consumer Web • eCommerce • Information Technology • Retail • Software • Analytics • App development
Drives sales growth for strategic Lowe’s Pro accounts through consultative selling, relationship management, market research, customer visits, jobsite meetings, pricing negotiations, and account planning. The role manages sales opportunities, coordinates with store and district teams, supports customer purchasing processes, conducts regular sales calls, and develops product and service solutions for large business customers.
Top Skills: CRM
An Hour Ago
Remote or Hybrid
TX, USA
17-25 Hourly
Entry level
17-25 Hourly
Entry level
Artificial Intelligence • Automotive • Greentech • Information Technology • Machine Learning • Software • Cybersecurity
Processes and audits fleet service invoices, performs VMRS coding and costing, resolves discrepancies with service providers, manages invoice workflows, processes rebills, verifies approval limits, and handles purchase order inquiries. The role requires accurate high-volume data entry, effective communication, and attention to detail in a fast-paced billing environment.
Top Skills: TmcareVmrsWorkflow System
An Hour Ago
Remote or Hybrid
United States
17-25 Hourly
Entry level
17-25 Hourly
Entry level
Artificial Intelligence • Automotive • Greentech • Information Technology • Machine Learning • Software • Cybersecurity
Processes, codes, audits, and indexes service-provider invoices for fleet billing operations. Responsibilities include resolving invoice discrepancies, verifying approval limits, completing WACC requirements, processing rebills, performing VMRS coding and costing, managing purchase-order inquiries, and responding to overflow calls. The role requires accurate high-volume data entry, attention to detail, and communication with service providers and internal teams.
Top Skills: TmcareVmrs

What you need to know about the Austin Tech Scene

Austin has a diverse and thriving tech ecosystem thanks to home-grown companies like Dell and major campuses for IBM, AMD and Apple. The state’s flagship university, the University of Texas at Austin, is known for its engineering school, and the city is known for its annual South by Southwest tech and media conference. Austin’s tech scene spans many verticals, but it’s particularly known for hardware, including semiconductors, as well as AI, biotechnology and cloud computing. And its food and music scene, low taxes and favorable climate has made the city a destination for tech workers from across the country.

Key Facts About Austin Tech

  • Number of Tech Workers: 180,500; 13.7% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Dell, IBM, AMD, Apple, Alphabet
  • Key Industries: Artificial intelligence, hardware, cloud computing, software, healthtech
  • Funding Landscape: $4.5 billion in VC funding in 2024 (Pitchbook)
  • Notable Investors: Live Oak Ventures, Austin Ventures, Hinge Capital, Gigafund, KdT Ventures, Next Coast Ventures, Silverton Partners
  • Research Centers and Universities: University of Texas, Southwestern University, Texas State University, Center for Complex Quantum Systems, Oden Institute for Computational Engineering and Sciences, Texas Advanced Computing Center

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account