Interested in this AI Product Manager role at Amazon Web Services?
Apply Now →Skills & Technologies
About This Role
DESCRIPTION
Annapurna Labs designs the silicon behind AWS machine learning acceleration. Trainium and Inferentia servers train and serve the largest models our customers run, and before any of that hardware carries customer traffic it has to prove it works. MLA Vetting owns that gate. We build the diagnostic tests that every accelerator server runs before it becomes sellable, and we decide which failures block a host, which route to a technician for repair, and which are noise.
That gate only works if we can see through it. We are hiring a Software Development Engineer II to build the data and analytics systems that tell us what our tests are actually doing across the fleet. You will build the pipelines that ingest diagnostic results from tens of thousands of servers, the dashboards that make test behavior legible, and the metrics and alarms that tell us a test has started failing on a hardware generation before it costs us a week of capacity. When the team decides whether a diagnostic has enough evidence to move from observation into blocking production, your data answers that question.
This is a software engineering role, not a reporting role. You will write and operate production code, own the alarms and metrics that page us, and build detection for trends nobody is watching yet. You will work directly with hardware, firmware, provisioning, and data center operations teams who act on what you build.
You are fluent in Python and SQL and have built production data pipelines at scale. Experience with Amazon Redshift, Apache Spark, workflow orchestration, and dashboarding in Grafana or QuickSight maps directly to what you will work on here. Experience with telemetry or diagnostic data from a large server fleet, or with defining metrics and anomaly detection on operational time-series data, will have you productive faster. Familiarity with server hardware or data center operations is a plus, not a requirement — we will teach you the hardware.
Key job responsibilities
Design, build, and operate production data pipelines that ingest diagnostic, telemetry, and repair-ticket data from the Trainium and Inferentia fleet into a warehouse other teams query with confidence.
Build and own the metrics, alarms, and anomaly detection that surface test regressions, failure-rate shifts, and new failure signatures across hardware generations without a human going looking for them.
Build dashboards and visualizations that make fleet and test health legible to engineers, hardware partners, and leadership, covering failure rates, failure-signature breakdowns, first pass yield, and repair latency.
Analyze large-scale fleet data to find root cause behind failure trends, and separate genuine hardware faults from software defects and test noise — a distinction that decides whether a failure reaches a technician or an engineer.
Define the evidence standard that gates operational decisions, including whether a diagnostic has soaked long enough and cleanly enough in the fleet to move from observation mode into blocking production.
Improve data quality and pipeline reliability so downstream consumers trust the numbers without re-deriving them.
Write clear analyses and design documents for technical and non-technical readers, including leadership.
A day in the life
You start by checking an alarm that fired overnight: a diagnostic's failure rate climbed on one server generation. You query the failure signatures, find the increase concentrates in one component and one data center, and hand the breakdown to the hardware team by mid-morning. The rest of the day goes to a pipeline you are building to join repair outcomes against diagnostic results, so the team can measure how often a repair actually fixes the fault it was dispatched for. You close the day reviewing a teammate's code review and answering an operations partner who needs a new cut of yield data.
About the team
MLA Vetting sits between hardware manufacturing and customer-ready capacity. We own the diagnostic test suites and the triage framework that turn a raw hardware failure into a specific, actionable repair, and we own the fleet-scale evidence that drives hardware and firmware improvements upstream. Our work is measured in how fast a server reaches sellable and how often it gets there on the first try.
BASIC QUALIFICATIONS
- 3+ years of non-internship professional software development experience
- 2+ years of non-internship design or architecture (design patterns, reliability and scaling) of new and existing systems experience
- Bachelor's degree or foreign equivalent in Computer Science, Engineering, Mathematics, or a related field
- Experience programming with at least one software programming language
PREFERRED QUALIFICATIONS
- 3+ years of full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations experience
- Bachelor's degree in computer science or equivalent
Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.
Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit https://amazon.jobs/content/en/how-we-hire/accommodations for more information. If the country/region you’re applying in isn’t listed, please contact your Recruiting Partner.
The base salary range for this position is listed below. Your Amazon package will include sign-on payments and restricted stock units (RSUs). Final compensation will be determined based on factors including experience, qualifications, and location. Amazon also offers comprehensive benefits including health insurance (medical, dental, vision, prescription, Basic Life & AD&D insurance and option for Supplemental life plans, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement coverage), 401(k) matching, paid time off, and parental leave. Learn more about our benefits at https://amazon.jobs/en/benefits.
USA, TX, Austin - 143,700.00 - 194,400.00 USD annually
Salary Context
This $143K-$194K range is below the median for AI Product Manager roles in our dataset (median: $194K across 123 roles with salary data).
View full AI Product Manager salary data →Role Details
About This Role
AI Product Managers define what AI features get built and why. They translate business problems into ML-solvable tasks, work with engineering to scope model requirements, and own the metrics that determine if an AI feature is working. The role requires a rare combination of technical fluency and product instinct.
Unlike traditional product management, AI PM work involves managing uncertainty at a fundamental level. Your model might work 90% of the time. What happens the other 10%? What's the user experience when the AI is wrong? How do you measure 'good enough' for a probabilistic system? These questions don't have easy answers, and the AI PM is the person responsible for finding them.
Across the 9,079 AI roles we're tracking, AI Product Manager positions make up 5% of the market. At Amazon Web Services, this role fits into their broader AI and engineering organization.
AI Product Manager roles are growing as companies realize that shipping AI features requires different product thinking than traditional software. The best candidates combine product management experience with enough technical depth to have productive conversations with ML engineers about model capabilities and limitations.
What the Work Looks Like
A typical week includes: reviewing model evaluation results with the ML team, defining success metrics for a new AI feature, conducting user research on how customers respond to AI-generated outputs, writing product requirements that include accuracy thresholds and fallback behaviors, and presenting the AI roadmap to leadership. You're the translator between technical capability and business value.
AI Product Manager roles are growing as companies realize that shipping AI features requires different product thinking than traditional software. The best candidates combine product management experience with enough technical depth to have productive conversations with ML engineers about model capabilities and limitations.
Skills Required
Technical fluency with ML concepts is essential, though you won't be writing models. Expect to understand training data, evaluation metrics, model limitations, and responsible AI practices. SQL and basic Python are increasingly expected. Experience with A/B testing, data analysis, and product analytics is baseline. Understanding LLM capabilities and limitations is now a core requirement.
The differentiator is AI-specific product thinking: knowing when to use ML vs. heuristics, understanding the cost of training data collection, designing graceful degradation for model failures, and building products that improve with usage data. Experience with AI safety, bias mitigation, and responsible AI deployment is increasingly important.
Strong postings describe specific AI products the PM will own, mention the ML team structure, and talk about measurement methodology. Look for companies that have already shipped AI features. Roles at companies that are 'exploring AI' often mean you'll spend a year defining the strategy before any building happens.
Compensation Benchmarks
AI Product Manager roles pay a median of $220,200 based on 947 positions with disclosed compensation. Mid-level AI roles across all categories have a median of $193,200. This role's midpoint ($169K) sits 23% below the category median. Disclosed range: $143K to $194K.
Across all AI roles, the market median is $213,000. Top-quartile compensation starts at $263,911. The 90th percentile reaches $318,400. For comparison, the highest-paying categories include AI Safety ($256,000) and Research Engineer ($252,000). By seniority level: Entry: $111,000; Mid: $193,200; Senior: $229,300; Director: $272,300; VP: $235,830.
Amazon Web Services AI Hiring
Amazon Web Services has 64 open AI roles right now. They're hiring across AI/ML Engineer, AI Product Manager, Research Scientist, AI Software Engineer. Positions span New York, NY, US, San Francisco, CA, US, Cupertino, CA, US. Compensation range: $160K - $299K.
Location Context
AI roles in Austin pay a median of $209,100 across 306 tracked positions.
Career Path
Common paths into AI Product Manager roles include Product Manager, Data Analyst, Technical Program Manager.
From here, career progression typically leads toward Director of AI Product, VP Product, Head of AI.
The most effective path is PM experience plus self-directed AI education. Take Andrew Ng's courses, build a small ML project, and learn enough Python to read model evaluation code. The goal isn't to become an ML engineer. It's to have credibility in technical conversations and to understand what's possible, what's hard, and what's a bad idea.
What to Expect in Interviews
AI interviews typically combine coding challenges (Python-focused), system design questions tailored to the role, and discussions about your experience with relevant tools and frameworks. Strong candidates demonstrate both technical depth and the ability to make pragmatic engineering tradeoffs. Prepare portfolio projects that demonstrate end-to-end capability rather than isolated skills.
When evaluating opportunities: Strong postings describe specific AI products the PM will own, mention the ML team structure, and talk about measurement methodology. Look for companies that have already shipped AI features. Roles at companies that are 'exploring AI' often mean you'll spend a year defining the strategy before any building happens.
AI Hiring Overview
The AI job market has 9,079 open positions tracked in our dataset. By seniority: 106 entry-level, 4,384 mid-level, 3,343 senior, and 1,246 leadership roles (Director, VP, C-Level). Remote roles make up 6% of the market (531 positions). The remaining 8,478 roles require on-site or hybrid attendance.
The market median for AI roles is $213,000. Top-quartile compensation starts at $263,911. The 90th percentile reaches $318,400. Highest-paying categories: AI Safety ($256,000 median, 66 roles); Research Engineer ($252,000 median, 457 roles); AI Engineering Manager ($251,622 median, 55 roles).
AI Product Manager roles are growing as companies realize that shipping AI features requires different product thinking than traditional software. The best candidates combine product management experience with enough technical depth to have productive conversations with ML engineers about model capabilities and limitations.
The AI Job Market Today
The AI job market spans 9,079 open positions across 16 role categories. The largest categories by volume: AI/ML Engineer (6,862), AI Product Manager (453), AI Software Engineer (451). These three account for the majority of open positions, though smaller categories often have higher per-role compensation because of specialized skill requirements.
The seniority mix tells a story about where AI teams are in their maturity. Entry-level roles (106) are outnumbered by mid-level (4,384) and senior (3,343) positions, reflecting that most companies are past the 'build a team from scratch' phase and need experienced engineers who can ship production systems. Leadership roles (Director, VP, C-Level) total 1,246 positions, representing the bottleneck between technical execution and organizational strategy.
Remote work availability sits at 6% of all AI roles (531 positions), with 8,478 requiring on-site or hybrid attendance. The remote share has stabilized after the post-pandemic correction. Senior and specialized roles (Research Scientist, ML Architect) are more likely to be remote-eligible than entry-level positions, partly because experienced hires have more negotiating power and partly because these roles require less hands-on mentorship.
AI compensation is structured in clear tiers. The market median sits at $213,000. Top-quartile roles start at $263,911, and the 90th percentile reaches $318,400. These figures include base salary with disclosed compensation. Total compensation (including equity, bonuses, and sign-on) runs 20-40% higher at companies that offer those components.
Category matters for compensation. AI Safety roles lead at $256,000 median, while Prompt Engineer roles sit at $141,440. The spread between highest and lowest-paying categories reflects the premium on specialized technical skills versus broader analytical roles.
The most in-demand skills across all AI postings: Python (1,649 postings), Aws (898 postings), Azure (723 postings), Rag (671 postings), Gcp (536 postings), Pytorch (434 postings), Claude (410 postings), Kubernetes (406 postings). Python dominates, appearing in the vast majority of role descriptions regardless of category. Cloud platform experience (AWS, GCP, Azure) is the second most common requirement. The newer entrants to the top skills list (RAG, vector databases, LLM APIs) reflect the shift from traditional ML toward generative AI applications.
Frequently Asked Questions
Get Weekly AI Career Intelligence
Salary data, skills demand, and market signals from 16,000+ AI job postings. Every Monday.