Technical Program Manager III, AI Agents Development, Cloud Infrastructure

$163K - $237K New York, NY, US Mid Level AI Agent Developer

Interested in this AI Agent Developer role at Google?

Apply Now →

Skills & Technologies

Rag

About This Role

AI job market dashboard showing open roles by category

Note: By applying to this position you will have an opportunity to share your preferred working location from the following: Reston, VA, USA; Council Bluffs, IA, USA; Clarksville, TN, USA; New Albany, OH, USA; Midlothian, TX, USA; Sterling, VA, USA; Moncks Corner, SC 29461, USA; New York, NY, USA; Pryor Creek, OK 74361, USA; Austell, GA, USA; Lenoir, NC, USA; Papillion, NE, USA.### Minimum qualifications:

  • Bachelor's degree in a technical field, or equivalent practical experience.
  • 5 years of experience in program management.
  • Experience driving technical software programs in an engineering organization.
  • Experience building or deploying AI agents.

### Preferred qualifications:

  • 5 years of experience managing cross\-functional or cross\-team projects.
  • Prior experience working within hyperscale data center operations, building automation tools, or interacting with DCIM/CMMS environments.
  • Track record of launching production\-grade AI Agents that execute multi\-step reasoning, tool usage, and real\-time decision\-making.
  • Excellent capability to navigate extreme ambiguity, drive technical alignment across highly matrixed organizations, and translate complex operational needs into structured engineering backlogs.

About the job

-----------------

A problem isn’t truly solved until it’s solved for all. That’s why Googlers build products that help create opportunities for everyone, whether down the street or across the globe. As a Technical Program Manager at Google, you’ll use your technical expertise to lead complex, multi\-disciplinary projects from start to finish. You’ll work with stakeholders to plan requirements, identify risks, manage project schedules, and communicate clearly with cross\-functional partners across the company. You're equally comfortable explaining your team's analyses and recommendations to executives as you are discussing the technical tradeoffs in product development with engineers.

The Central Ops team globally manages programs and standards across the Data Center Operations fleet. The functions provide operational execution support (e.g., Incident Management, Fleet Deployment, Spares, and Maintenance Planning) along with program oversight (e.g., Operational Assessments, Data Quality, Business Process support) and transformation program partnership with the field operations. The team supports new product introductions into the fleet.

We are transitioning from static traditional tools to active, multi\-agent AI workflows. These agents will autonomously diagnose equipment anomalies, optimize liquid and traditional cooling loops in real\-time, orchestrate server swap\-out logistics, and automate complex incident resolution paths across our physical and digital fleet.

As the AI Agents Development Technical Program Manager, you will lead the end\-to\-end execution, delivery, and scaling of autonomous, decision\-making AI systems designed to optimize global data center operations.

In this high\-impact, cross\-functional role, you will sit at the intersection of physical infrastructure and software engineering. You will partner closely with software developers, systems architects, site operations leads, and hardware engineering teams to build robust, reliable, and production\-grade operational software.

Behind everything our users see online is the architecture built by the Technical Infrastructure team to keep it running. From developing and maintaining our data centers to building the next generation of Google platforms, we make Google's product portfolio possible. We're proud to be our engineers' engineers and love voiding warranties by taking things apart so we can rebuild them. We keep our networks up and running, ensuring our users have the best and fastest experience possible.

Individual pay is determined by factors including job\-related skills, experience, and relevant education or training.

US: $163000 \- $237000 (USD) \+ 15% bonus target \+ equity \+ benefits

Learn more about benefits at Google.Responsibilities

--------------------

  • Drive the execution of our DCOps AI Agent roadmap, from initial concept and architecture design through deployment, evaluation, and scaling.
  • Manage complex, cross\-functional dependencies across Software Engineering, Hardware Logistics, Facility Operations, and Security teams to ensure seamless integration of AI agents into active DCOps systems.
  • Manage release processes for AI Agent deployment, ensuring smooth transitions from development and testing to physical production environments.
  • Collaborate with system architects to design scalable agentic platforms (including multi\-agent coordination, Retrieval\-Augmented Generation (RAG) pipelines, and Tool Use/MCP integration).
  • Identify and resolve systemic bottlenecks, model drift, data pipeline delays, and operational risks associated with deploying autonomous systems in high\-stakes environments.

Google is proud to be an equal opportunity workplace and is an affirmative action employer. We are committed to equal employment opportunity regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity or Veteran status. We also consider qualified applicants regardless of criminal histories, consistent with legal requirements. See also Google's EEO Policy and EEO is the Law. If you have a disability or special need that requires accommodation, please let us know by completing our Accommodations for Applicants form.

Salary Context

This $163K-$237K range is above the median for AI Agent Developer roles in our dataset (median: $200K across 33 roles with salary data).

View full AI Agent Developer salary data →

Role Details

Company Google
Title Technical Program Manager III, AI Agents Development, Cloud Infrastructure
Location New York, NY, US
Experience Mid Level
Salary $163K - $237K
Remote No

About This Role

AI Agent Developers build autonomous systems that can reason, plan, and take actions. They design multi-step workflows, tool-use frameworks, and orchestration layers that let LLMs interact with external systems. This is the frontier of applied AI engineering.

Agent development is where the most interesting (and hardest) problems in applied AI live right now. Making an LLM answer a question is straightforward. Making it reliably execute a 15-step workflow that involves calling APIs, reading databases, making decisions, and recovering from errors is an unsolved problem. You're building systems that have to work despite the fact that the underlying model is non-deterministic.

Across the 4,317 AI roles we're tracking, AI Agent Developer positions make up 1% of the market. At Google, this role fits into their broader AI and engineering organization.

AI Agent Developer is one of the newest and fastest-growing AI role categories. The market is early but accelerating as companies move beyond simple chatbots toward AI systems that can take real actions. Compensation is high because the skill set is rare and the business impact is potentially enormous.

What the Work Looks Like

A typical week includes: designing the action space and tool definitions for a new agent use case, debugging why the agent chose the wrong action sequence on a specific input, building evaluation frameworks that test agent reliability across hundreds of scenarios, optimizing the prompt chain for cost and latency, and implementing safety guardrails to prevent the agent from taking destructive actions. The work is equal parts engineering and empirical science.

AI Agent Developer is one of the newest and fastest-growing AI role categories. The market is early but accelerating as companies move beyond simple chatbots toward AI systems that can take real actions. Compensation is high because the skill set is rare and the business impact is potentially enormous.

Skills Required

Rag (21% of roles)

Deep experience with LLM APIs and agent frameworks (LangChain, CrewAI, AutoGen). Strong understanding of prompt engineering, function calling, and error handling for non-deterministic systems. Python is standard. Experience with orchestration patterns, state management, and workflow engines adds significant value.

The best agent developers think like systems engineers. They design for failure modes, build observability into every step, and understand that agent reliability is the product. Expertise in evaluation methodology for non-deterministic systems is the differentiator. Can you measure whether your agent works 'well enough'? Can you find the edge cases where it breaks?

Look for roles that describe specific agent use cases, mention evaluation methodology, and talk about production deployment. Early-stage companies exploring agents can be exciting, but be prepared for ambiguity. The most valuable roles are at companies that have already shipped a v1 and need to make it reliable.

Compensation Benchmarks

AI Agent Developer roles pay a median of $240,000 based on 96 positions with disclosed compensation. Mid-level AI roles across all categories have a median of $194,400. This role's midpoint ($200K) sits 17% below the category median. Disclosed range: $163K to $237K.

Across all AI roles, the market median is $215,000. Top-quartile compensation starts at $266,300. The 90th percentile reaches $320,790. For comparison, the highest-paying categories include AI Safety ($287,500) and Research Engineer ($272,100). By seniority level: Entry: $110,000; Mid: $194,400; Senior: $227,400; Director: $274,554; VP: $241,000.

Google AI Hiring

Google has 134 open AI roles right now. They're hiring across AI Software Engineer, AI/ML Engineer, AI Agent Developer, Research Scientist. Positions span Sunnyvale, CA, US, New York, NY, US, Mountain View, CA, US. Compensation range: $144K - $365K.

Location Context

AI roles in New York pay a median of $220,000 across 1,650 tracked positions.

Career Path

Common paths into AI Agent Developer roles include Software Engineer, LLM Engineer, Prompt Engineer.

From here, career progression typically leads toward AI Architect, Principal Engineer, Head of AI Engineering.

Build agents. That's the portfolio. Take an open-source agent framework, build something that completes a non-trivial multi-step task, evaluate it rigorously, and document what you learned about reliability, cost, and failure modes. The field is new enough that practical experience counts for more than credentials.

What to Expect in Interviews

Interviews focus on systems thinking and reliability engineering. Expect questions about agent architecture: how you'd design a multi-step workflow with error recovery, how you'd evaluate agent performance, and how you'd prevent agents from taking destructive actions. Coding exercises often involve building a simple agent with tool use and evaluating its behavior across different scenarios. Discussion of safety and guardrails is increasingly common.

When evaluating opportunities: Look for roles that describe specific agent use cases, mention evaluation methodology, and talk about production deployment. Early-stage companies exploring agents can be exciting, but be prepared for ambiguity. The most valuable roles are at companies that have already shipped a v1 and need to make it reliable.

AI Hiring Overview

The AI job market has 4,317 open positions tracked in our dataset. By seniority: 138 entry-level, 2,071 mid-level, 1,655 senior, and 453 leadership roles (Director, VP, C-Level). Remote roles make up 15% of the market (635 positions). The remaining 3,657 roles require on-site or hybrid attendance.

The market median for AI roles is $215,000. Top-quartile compensation starts at $266,300. The 90th percentile reaches $320,790. Highest-paying categories: AI Safety ($287,500 median, 34 roles); Research Engineer ($272,100 median, 227 roles); AI Engineering Manager ($244,000 median, 23 roles).

AI Agent Developer is one of the newest and fastest-growing AI role categories. The market is early but accelerating as companies move beyond simple chatbots toward AI systems that can take real actions. Compensation is high because the skill set is rare and the business impact is potentially enormous.

The AI Job Market Today

The AI job market spans 4,317 open positions across 15 role categories. The largest categories by volume: AI/ML Engineer (3,004), Data Scientist (345), AI Software Engineer (309). These three account for the majority of open positions, though smaller categories often have higher per-role compensation because of specialized skill requirements.

The seniority mix tells a story about where AI teams are in their maturity. Entry-level roles (138) are outnumbered by mid-level (2,071) and senior (1,655) positions, reflecting that most companies are past the 'build a team from scratch' phase and need experienced engineers who can ship production systems. Leadership roles (Director, VP, C-Level) total 453 positions, representing the bottleneck between technical execution and organizational strategy.

Remote work availability sits at 15% of all AI roles (635 positions), with 3,657 requiring on-site or hybrid attendance. The remote share has stabilized after the post-pandemic correction. Senior and specialized roles (Research Scientist, ML Architect) are more likely to be remote-eligible than entry-level positions, partly because experienced hires have more negotiating power and partly because these roles require less hands-on mentorship.

AI compensation is structured in clear tiers. The market median sits at $215,000. Top-quartile roles start at $266,300, and the 90th percentile reaches $320,790. These figures include base salary with disclosed compensation. Total compensation (including equity, bonuses, and sign-on) runs 20-40% higher at companies that offer those components.

Category matters for compensation. AI Safety roles lead at $287,500 median, while Prompt Engineer roles sit at $145,000. The spread between highest and lowest-paying categories reflects the premium on specialized technical skills versus broader analytical roles.

The most in-demand skills across all AI postings: Python (2,249 postings), Aws (1,224 postings), Azure (938 postings), Rag (915 postings), Gcp (660 postings), Pytorch (640 postings), Prompt Engineering (624 postings), Kubernetes (559 postings). Python dominates, appearing in the vast majority of role descriptions regardless of category. Cloud platform experience (AWS, GCP, Azure) is the second most common requirement. The newer entrants to the top skills list (RAG, vector databases, LLM APIs) reflect the shift from traditional ML toward generative AI applications.

Frequently Asked Questions

Based on 96 roles with disclosed compensation, the median salary for AI Agent Developer positions is $240,000. Actual compensation varies by seniority, location, and company stage.
Deep experience with LLM APIs and agent frameworks (LangChain, CrewAI, AutoGen). Strong understanding of prompt engineering, function calling, and error handling for non-deterministic systems. Python is standard. Experience with orchestration patterns, state management, and workflow engines adds significant value.
About 15% of the 4,317 AI roles we track offer remote work. Remote availability varies by company and seniority level, with senior and leadership roles more likely to offer location flexibility.
Google is among the companies actively hiring for AI and ML talent. Check our company profiles for detailed breakdowns of open roles, salary ranges, and hiring trends.
Common next steps from AI Agent Developer positions include AI Architect, Principal Engineer, Head of AI Engineering. Progression depends on whether you lean toward technical depth, people management, or product strategy.

Get Weekly AI Career Intelligence

Salary data, skills demand, and market signals from 16,000+ AI job postings. Every Monday.