Interested in this AI Product Manager role at Amazon Web Services?
Apply Now →Skills & Technologies
About This Role
DESCRIPTION
---------------
Want to help drive the success of Machine Learning technologies at AWS? Do you have the skills and motivation to own the infrastructure that enables peer teams to ship high\-quality ML networking software? We want to talk to you!
We seek a Senior Software Development Engineer for the Machine Learning (ML) Infrastructure team to own and evolve the platforms used to guarantee top performance of AWS ML and High Performance Computing (HPC) technologies developed by our organization. Our performance data directly influences launch decisions for new EC2 instance types and has visibility at the highest levels of the company. Bring your exceptional knowledge of CI/CD automation, cluster management, and ML/HPC workloads to bear on the cutting\-edge software we develop. Join us as we expand the AWS offerings for AI, including Trainium, Neuron and the Elastic Fabric Adapter (EFA).
Key job responsibilities
Own the infrastructure that monitors and reports on functionality and performance of massive testing workloads run at scale across multiple GPU instance types. Build and operate CI/CD systems using Jenkins, internal Amazon tools, Linux, and public AWS products to automate the testing and delivery of ML networking libraries — including collective communication frameworks, network transport layers, and GPU communication libraries. Write Python code that orchestrates large clusters, runs benchmarks and ML applications across a wide matrix of instance types, operating systems, and software stack versions. Use AWS Managed Grafana and Athena to digest the massive amount of performance data generated by these workloads and build dashboards and alarms that catch functional and performance regressions before they reach customers. Build intelligent automation using LLMs to analyze test failures, perform root cause analysis, deduplicate regressions, and generate reports — reducing manual toil and accelerating issue resolution. Drive cross\-team readiness for new instance type launches by delivering the performance data that shapes go/no\-go decisions. Manage GPU compute capacity planning and provisioning across the organization. Own the complexity of infrastructure that covers many instance types, software stacks, Linux operating systems, and cutting\-edge releases — and make it easy to evolve.
A day in the life
You write Python to orchestrate test workloads across large GPU clusters and TypeScript with CDK to ensure all infrastructure is code, reviewed and committed to automated pipelines. You manage shared development clusters using SLURM and AWS ParallelCluster, supporting multiple teams of developers while keeping costs down. You build AI\-powered automation that analyzes nightly test results and surfaces actionable insights to developers. You write crisp designs for your projects, drive cross\-team alignment, and make architectural decisions that affect how the organization tests and releases software.
About the team
We are part of Annapurna Labs, a subsidiary in AWS that builds software and hardware that make ML on EC2 work. Our organization is a dedicated group of innovators that have invented new networks, new silicon, new software suites, and combined those to entice customers to move immense ML and HPC workloads to the cloud. The ML Infrastructure team is laser focused on making AWS the best and most cost\-effective place for customers to do AI at scale. Our work directly enables the launch of new GPU instance types — the performance data we produce reaches senior leadership and shapes strategic decisions.
BASIC QUALIFICATIONS
------------------------
- 5\+ years of leading design or architecture (design patterns, reliability and scaling) of new and existing systems experience
- 5\+ years of full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations experience
- Experience as a mentor, tech lead or leading an engineering team
\- \- 5\+ years of non\-internship professional software development experience
\- \- 5\+ years of programming with at least one software programming language experience
\- \- Experience coding in Python, TypeScript, CDKPREFERRED QUALIFICATIONS
----------------------------
- Bachelor's degree in computer science or equivalent
\- \- Experience with HPC job schedulers (SLURM), Jenkins, or GPU compute infrastructure
\- \- Experience with AWS infrastructure services (EC2, CDK, CloudFormation, Step Functions)
\- \- Familiarity with ML/HPC networking or collective communication libraries (NCCL, MPI, libfabric)
\- \- Experience building automation or tooling using large language models (LLMs)
Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.
Los Angeles County applicants: Job duties for this position include: work safely and cooperatively with other employees, supervisors, and staff; adhere to standards of excellence despite stressful conditions; communicate effectively and respectfully with employees, supervisors, and staff to ensure exceptional customer service; and follow all federal, state, and local laws and Company policies. Criminal history may have a direct, adverse, and negative relationship with some of the material job duties of this position. These include the duties and responsibilities listed above, as well as the abilities to adhere to company policies, exercise sound judgment, effectively manage stress and work safely and respectfully with others, exhibit trustworthiness and professionalism, and safeguard business operations and the Company’s reputation. Pursuant to the Los Angeles County Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records.
Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit https://amazon.jobs/content/en/how\-we\-hire/accommodations for more information. If the country/region you’re applying in isn’t listed, please contact your Recruiting Partner.
The base salary range for this position is listed below. Your Amazon package will include sign\-on payments and restricted stock units (RSUs). Final compensation will be determined based on factors including experience, qualifications, and location. Amazon also offers comprehensive benefits including health insurance (medical, dental, vision, prescription, Basic Life \& AD\&D insurance and option for Supplemental life plans, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement coverage), 401(k) matching, paid time off, and parental leave. Learn more about our benefits at https://amazon.jobs/en/benefits.
USA, CA, Cupertino \- 193,300\.00 \- 261,500\.00 USD annually
Salary Context
This $193K-$261K range is above the 75th percentile for AI Product Manager roles in our dataset (median: $189K across 161 roles with salary data).
View full AI Product Manager salary data →Role Details
About This Role
AI Product Managers define what AI features get built and why. They translate business problems into ML-solvable tasks, work with engineering to scope model requirements, and own the metrics that determine if an AI feature is working. The role requires a rare combination of technical fluency and product instinct.
Unlike traditional product management, AI PM work involves managing uncertainty at a fundamental level. Your model might work 90% of the time. What happens the other 10%? What's the user experience when the AI is wrong? How do you measure 'good enough' for a probabilistic system? These questions don't have easy answers, and the AI PM is the person responsible for finding them.
Across the 3,823 AI roles we're tracking, AI Product Manager positions make up 5% of the market. At Amazon Web Services, this role fits into their broader AI and engineering organization.
AI Product Manager roles are growing as companies realize that shipping AI features requires different product thinking than traditional software. The best candidates combine product management experience with enough technical depth to have productive conversations with ML engineers about model capabilities and limitations.
What the Work Looks Like
A typical week includes: reviewing model evaluation results with the ML team, defining success metrics for a new AI feature, conducting user research on how customers respond to AI-generated outputs, writing product requirements that include accuracy thresholds and fallback behaviors, and presenting the AI roadmap to leadership. You're the translator between technical capability and business value.
AI Product Manager roles are growing as companies realize that shipping AI features requires different product thinking than traditional software. The best candidates combine product management experience with enough technical depth to have productive conversations with ML engineers about model capabilities and limitations.
Skills Required
Technical fluency with ML concepts is essential, though you won't be writing models. Expect to understand training data, evaluation metrics, model limitations, and responsible AI practices. SQL and basic Python are increasingly expected. Experience with A/B testing, data analysis, and product analytics is baseline. Understanding LLM capabilities and limitations is now a core requirement.
The differentiator is AI-specific product thinking: knowing when to use ML vs. heuristics, understanding the cost of training data collection, designing graceful degradation for model failures, and building products that improve with usage data. Experience with AI safety, bias mitigation, and responsible AI deployment is increasingly important.
Strong postings describe specific AI products the PM will own, mention the ML team structure, and talk about measurement methodology. Look for companies that have already shipped AI features. Roles at companies that are 'exploring AI' often mean you'll spend a year defining the strategy before any building happens.
Compensation Benchmarks
AI Product Manager roles pay a median of $213,800 based on 583 positions with disclosed compensation. Senior-level AI roles across all categories have a median of $227,400. This role's midpoint ($227K) sits 6% above the category median. Disclosed range: $193K to $261K.
Across all AI roles, the market median is $200,100. Top-quartile compensation starts at $253,500. The 90th percentile reaches $307,500. For comparison, the highest-paying categories include AI Engineering Manager ($275,000) and AI Safety ($274,200). By seniority level: Entry: $97,880; Mid: $165,000; Senior: $227,400; Director: $247,800; VP: $250,000.
Amazon Web Services AI Hiring
Amazon Web Services has 78 open AI roles right now. They're hiring across AI/ML Engineer, AI Agent Developer, Research Scientist, AI Product Manager. Positions span Seattle, WA, US, San Francisco, CA, US, Arlington, VA, US. Compensation range: $177K - $295K.
Location Context
Across all AI roles, 15% (590 positions) offer remote work, while 3,217 require on-site attendance. Top AI hiring metros: New York (2,643 roles, $211,000 median); San Francisco (2,168 roles, $253,000 median); Los Angeles (1,792 roles, $191,580 median).
Career Path
Common paths into AI Product Manager roles include Product Manager, Data Analyst, Technical Program Manager.
From here, career progression typically leads toward Director of AI Product, VP Product, Head of AI.
The most effective path is PM experience plus self-directed AI education. Take Andrew Ng's courses, build a small ML project, and learn enough Python to read model evaluation code. The goal isn't to become an ML engineer. It's to have credibility in technical conversations and to understand what's possible, what's hard, and what's a bad idea.
What to Expect in Interviews
AI interviews typically combine coding challenges (Python-focused), system design questions tailored to the role, and discussions about your experience with relevant tools and frameworks. Strong candidates demonstrate both technical depth and the ability to make pragmatic engineering tradeoffs. Prepare portfolio projects that demonstrate end-to-end capability rather than isolated skills.
When evaluating opportunities: Strong postings describe specific AI products the PM will own, mention the ML team structure, and talk about measurement methodology. Look for companies that have already shipped AI features. Roles at companies that are 'exploring AI' often mean you'll spend a year defining the strategy before any building happens.
AI Hiring Overview
The AI job market has 3,823 open positions tracked in our dataset. By seniority: 112 entry-level, 1,798 mid-level, 1,516 senior, and 397 leadership roles (Director, VP, C-Level). Remote roles make up 15% of the market (590 positions). The remaining 3,217 roles require on-site or hybrid attendance.
The market median for AI roles is $200,100. Top-quartile compensation starts at $253,500. The 90th percentile reaches $307,500. Highest-paying categories: AI Engineering Manager ($275,000 median, 41 roles); AI Safety ($274,200 median, 55 roles); Research Engineer ($260,000 median, 434 roles).
AI Product Manager roles are growing as companies realize that shipping AI features requires different product thinking than traditional software. The best candidates combine product management experience with enough technical depth to have productive conversations with ML engineers about model capabilities and limitations.
The AI Job Market Today
The AI job market spans 3,823 open positions across 15 role categories. The largest categories by volume: AI/ML Engineer (2,629), Data Scientist (322), AI Software Engineer (279). These three account for the majority of open positions, though smaller categories often have higher per-role compensation because of specialized skill requirements.
The seniority mix tells a story about where AI teams are in their maturity. Entry-level roles (112) are outnumbered by mid-level (1,798) and senior (1,516) positions, reflecting that most companies are past the 'build a team from scratch' phase and need experienced engineers who can ship production systems. Leadership roles (Director, VP, C-Level) total 397 positions, representing the bottleneck between technical execution and organizational strategy.
Remote work availability sits at 15% of all AI roles (590 positions), with 3,217 requiring on-site or hybrid attendance. The remote share has stabilized after the post-pandemic correction. Senior and specialized roles (Research Scientist, ML Architect) are more likely to be remote-eligible than entry-level positions, partly because experienced hires have more negotiating power and partly because these roles require less hands-on mentorship.
AI compensation is structured in clear tiers. The market median sits at $200,100. Top-quartile roles start at $253,500, and the 90th percentile reaches $307,500. These figures include base salary with disclosed compensation. Total compensation (including equity, bonuses, and sign-on) runs 20-40% higher at companies that offer those components.
Category matters for compensation. AI Engineering Manager roles lead at $275,000 median, while Prompt Engineer roles sit at $140,000. The spread between highest and lowest-paying categories reflects the premium on specialized technical skills versus broader analytical roles.
The most in-demand skills across all AI postings: Python (1,979 postings), Aws (1,190 postings), Azure (899 postings), Rag (839 postings), Gcp (726 postings), Pytorch (595 postings), Prompt Engineering (595 postings), Claude (540 postings). Python dominates, appearing in the vast majority of role descriptions regardless of category. Cloud platform experience (AWS, GCP, Azure) is the second most common requirement. The newer entrants to the top skills list (RAG, vector databases, LLM APIs) reflect the shift from traditional ML toward generative AI applications.
Frequently Asked Questions
Get Weekly AI Career Intelligence
Salary data, skills demand, and market signals from 16,000+ AI job postings. Every Monday.