AI Jobs with RAG Experience

Find AI jobs requiring Retrieval-Augmented Generation (RAG) experience. LLM engineer and AI architect positions.

959
Open Positions
$206K
Avg. Salary
124
Remote Roles

Data updated weekly. Last refreshed 2026-10-24.

AI/ML Engineer
Cybersecurity Office Manager, AI Security Engineering
Metropolitan Transportation Authority
$148K - $196K New York, NY, US
View Role →
AI/ML Engineer
Cybersecurity Office Manager, AI Security Enablement
Metropolitan Transportation Authority
$148K - $196K New York, NY, US
View Role →
AI Architect
Executive Product Solutions Director (Data, AI & GenAI Architecture)
JPMorganChase
$166K - $260K New York, NY, US
View Role →
AI/ML Engineer
Forward Deployed AI Engineer
Talkdesk
$180K - $225K Remote
View Role →
AI Agent Developer
Staff Applied AI Agent Engineer
Google
$207K - $300K Kirkland, WA, US
View Role →
AI/ML Engineer
Senior Full-Stack & AI Engineer
Calidad software
$104K - $166K Remote
View Role →
AI/ML Engineer
Associate Director, Applied AI Platform Engineering (PxE Platforms)
Deloitte
$130K - $268K Morristown, NJ, US
View Role →
AI/ML Engineer
AI Engineer / Search Engineer
Unicorn Technologies LLC
$60K - $80K Atlanta, GA, US
View Role →
AI/ML Engineer
AI Implementation Engineer
AVISO
$150K - $170K Fremont, CA, US
View Role →
AI/ML Engineer
AI Software Developer
Inoxoft
$105K - $140K Philadelphia, PA, US
View Role →
AI/ML Engineer
AI Architech
Meeru AI Inc
Pleasanton, CA, US
View Role →
AI/ML Engineer
VP-Distinguished Engineer of Generative AI Engineering
Slate Auto
$222K - $370K Troy, MI, US
View Role →
Data Engineer
Generative AI Data Engineer
Embedded Alliance
$120K - $210K Herndon, VA, US
View Role →
AI/ML Engineer
Senior Internal Audit Manager — Technology Risk, Cybersecurity & AI Assurance
Applied Materials
$140K - $192K Austin, TX, US
View Role →
AI/ML Engineer
Senior Full Stack Developer - Java + TypeScript/React + AI
Penn River
$94K - $140K Remote
View Role →
AI/ML Engineer
GTM Enablement Program Manager - AI Content Infrastructure
Wiz Soluções
$136K - $185K Remote
View Role →
AI/ML Engineer
Forward Deployed Engineer Associate (AI Capability Center) - Internal Facing
Huron Consulting Group
$105K - $149K Chicago, IL, US
View Role →
AI/ML Engineer
OM AI Program Management Lead VP
Citi
$103K - $155K Tampa, FL, US
View Role →
Data Scientist
Data Scientist - SME
Accenture Federal Services
$109K - $213K Chantilly, VA, US
View Role →
Data Engineer
Sr AI/ML Data Engineer Remote or Office-Based in MN/DC
Optum
$120K - $214K Remote
View Role →
Data Scientist
Senior Data Scientist, AI
Baylor Scott & White Health
Remote
View Role →
AI/ML Engineer
Azure Cloud & AI Solutions Architect
Cyclotron
$200K - $250K Remote
View Role →
AI/ML Engineer
AI Solution Architect
AMD
San Jose, CA, US
View Role →
AI/ML Engineer
Forward Deployed Engineer (AI Capability Center) - Internal Facing - Multiple Openings!
Huron Consulting Group
$120K - $171K Chicago, IL, US
View Role →
AI/ML Engineer
Senior Lead Business Execution Consultant Data, AI & Platform Management Lead – COO AI Product
Wells Fargo
Charlotte, NC, US
View Role →
AI/ML Engineer
AI Native Engineer - Remote (6351)
itD Tech
Remote
View Role →
AI/ML Engineer
Vice President, AI Engineer
Ares Management
$250K - $270K New York, NY, US
View Role →
AI/ML Engineer
Gen AI & Python Enterprise Architect
Deloitte
$105K - $188K New York, NY, US
View Role →
AI/ML Engineer
Agentic AI Delivery Consultant
Deloitte
$71K - $118K Mechanicsburg, PA, US
View Role →
AI/ML Engineer
AI Coding Product Leader
Stellantis
Auburn Hills, MI, US
View Role →
AI/ML Engineer
AI Platform Engineer
Harley Ellis Devereaux
$120K - $170K Addison, TX, US
View Role →
AI/ML Engineer
AI Software Developer
Advantive
Tampa, FL, US
View Role →
Data Scientist
Lead Data Scientist, Transparency & Observability - Trust and Safety
TikTok
$219K - $353K New York, NY, US
View Role →
AI/ML Engineer
Applied AI Engineer (Full-Stack)
PineCone
$190K - $270K New York, NY, US
View Role →
AI Architect
AI Architect
Katalyst Healthcares & Life Sciences
Bellevue, WA, US
View Role →
AI/ML Engineer
AI/ML Engineer - Senior
Halvik
$200K - $220K McLean, VA, US
View Role →
AI/ML Engineer
Forward Deployed AI Engineer
The Andersons
Maumee, OH, US
View Role →
AI/ML Engineer
Senior Software ML Engineer, AI/ML GenAI, Gemini Enterprise
Google
$174K - $252K Sunnyvale, CA, US
View Role →
AI/ML Engineer
Cleared AI Engineer - SME
Accenture Federal Services
$109K - $224K Chantilly, VA, US
View Role →
AI Software Engineer
AI/ML Software Engineer
KLA
$105K - $180K Ann Arbor, MI, US
View Role →
AI/ML Engineer
AI Engineer II
Blue Cross of Idaho
$96K - $144K Meridian, ID, US
View Role →
AI/ML Engineer
Data & AI Forward Deployed Engineer
Revstar
Washington, DC, US
View Role →
AI/ML Engineer
AI Foundation Architect
Keyrus USA
$145K - $180K New York, NY, US
View Role →
AI Software Engineer
Senior AI Software Engineer (Healthcare)
The Phia Group
Remote
View Role →
AI/ML Engineer
Data & AI Engineer
THIRD
$140K - $170K Remote
View Role →
AI/ML Engineer
AI Engineer II
Computer Services
Remote
View Role →
AI/ML Engineer
Senior AI Solutions Engineer
Miami University
$100K - $120K Oxford, OH, US
View Role →
AI Engineering Manager
AI Engineering Manager (AI Capability Center) - Internal Facing - 3 Openings Remaining
Huron Consulting Group
$140K - $204K Chicago, IL, US
View Role →
AI/ML Engineer
AI Solutions Developer (Remote)
Geotab
$83K - $102K Remote
View Role →
AI/ML Engineer
Sr AI Solution Engineer - Onsite, Minneapolis, MN
Medtronic
$97K - $146K Minneapolis, MN, US
View Role →

Showing 50 of 959 jobs

About This Role

AI job market dashboard showing open roles by category

AI/ML Engineers build and deploy machine learning models in production. They work across the full ML lifecycle: data pipelines, model training, evaluation, and serving infrastructure. The role has evolved significantly over the past two years. Where ML Engineers once spent most of their time on model architecture, the job now tilts heavily toward inference optimization, cost management, and integrating LLM capabilities into existing systems. Companies want engineers who can ship production systems, and the experimenter-only role is fading fast.

Day-to-day, you're writing training pipelines, debugging data quality issues, setting up evaluation frameworks, and figuring out why your model performs differently in staging than it did on your dev set. The best ML engineers are obsessive about reproducibility and measurement. They instrument everything. They know that a model is only as good as the data feeding it and the infrastructure serving it.

Across the 11,520 AI roles we're tracking, AI/ML Engineer positions make up 76% of the market.

Demand for AI/ML Engineers has been strong and consistent. Unlike some AI roles that spike with hype cycles, ML engineering is a foundational need. Every company deploying AI models needs people who can keep them running, and the gap between research prototypes and production systems keeps growing.

Compensation Benchmarks

AI/ML Engineer roles pay a median of $212,040 based on 13,780 positions with disclosed compensation.

Across all AI roles, the market median is $213,480. Top-quartile compensation starts at $264,000. The 90th percentile reaches $318,400. For comparison, the highest-paying categories include AI Safety ($266,050) and AI Engineering Manager ($253,461). By seniority level: Entry: $112,320; Mid: $193,200; Senior: $230,000; Director: $272,250; VP: $235,830.

AI Hiring Overview

The AI job market has 11,520 open positions tracked in our dataset. By seniority: 140 entry-level, 5,630 mid-level, 4,176 senior, and 1,574 leadership roles (Director, VP, C-Level). Remote roles make up 6% of the market (708 positions). The remaining 10,737 roles require on-site or hybrid attendance.

The market median for AI roles is $213,480. Top-quartile compensation starts at $264,000. The 90th percentile reaches $318,400. Highest-paying categories: AI Safety ($266,050 median, 70 roles); AI Engineering Manager ($253,461 median, 58 roles); Research Engineer ($252,000 median, 476 roles).

Demand for AI/ML Engineers has been strong and consistent. Unlike some AI roles that spike with hype cycles, ML engineering is a foundational need. Every company deploying AI models needs people who can keep them running, and the gap between research prototypes and production systems keeps growing.

Career Path

Common paths into AI/ML Engineer roles include Data Scientist, Software Engineer, Research Engineer.

From here, career progression typically leads toward ML Architect, AI Engineering Manager, Principal ML Engineer.

The fastest path into ML engineering is through software engineering with a self-directed ML education. A CS degree helps, but production engineering skills matter more than academic credentials. Build something that works, deploy it, and measure it. That portfolio project is worth more than a Coursera certificate. For career growth, the fork comes around the senior level: go deep on technical complexity (staff/principal track) or move into managing ML teams.

The AI Job Market Today

The AI job market spans 11,520 open positions across 16 role categories. The largest categories by volume: AI/ML Engineer (8,769), AI Software Engineer (586), AI Product Manager (511). These three account for the majority of open positions, though smaller categories often have higher per-role compensation because of specialized skill requirements.

The seniority mix tells a story about where AI teams are in their maturity. Entry-level roles (140) are outnumbered by mid-level (5,630) and senior (4,176) positions, reflecting that most companies are past the 'build a team from scratch' phase and need experienced engineers who can ship production systems. Leadership roles (Director, VP, C-Level) total 1,574 positions, representing the bottleneck between technical execution and organizational strategy.

Remote work availability sits at 6% of all AI roles (708 positions), with 10,737 requiring on-site or hybrid attendance. The remote share has stabilized after the post-pandemic correction. Senior and specialized roles (Research Scientist, ML Architect) are more likely to be remote-eligible than entry-level positions, partly because experienced hires have more negotiating power and partly because these roles require less hands-on mentorship.

AI compensation is structured in clear tiers. The market median sits at $213,480. Top-quartile roles start at $264,000, and the 90th percentile reaches $318,400. These figures include base salary with disclosed compensation. Total compensation (including equity, bonuses, and sign-on) runs 20-40% higher at companies that offer those components.

Category matters for compensation. AI Safety roles lead at $266,050 median, while Prompt Engineer roles sit at $140,000. The spread between highest and lowest-paying categories reflects the premium on specialized technical skills versus broader analytical roles.

The most in-demand skills across all AI postings: Python (2,267 postings), Aws (1,178 postings), Azure (972 postings), Rag (924 postings), Gcp (715 postings), Pytorch (586 postings), Claude (572 postings), Kubernetes (559 postings). Python dominates, appearing in the vast majority of role descriptions regardless of category. Cloud platform experience (AWS, GCP, Azure) is the second most common requirement. The newer entrants to the top skills list (RAG, vector databases, LLM APIs) reflect the shift from traditional ML toward generative AI applications.

Frequently Asked Questions

AI Pulse currently tracks 959 AI job openings that require AI with RAG Experience skills. 124 of these are remote positions.
RAG (Retrieval-Augmented Generation) appears in 74% of LLM-focused AI engineering roles. It's the single most requested LLM-specific skill. Companies need engineers who can build production retrieval systems, not just call LLM APIs.
Pinecone is most commonly requested, followed by Weaviate and Chroma. However, the concepts transfer between databases. Focus on understanding embeddings, similarity metrics, and chunking strategies rather than one specific tool.
AI roles requiring AI with RAG Experience pay an average of $206K based on disclosed compensation. Specialized skills like AI with RAG Experience combined with production experience typically command 10-20% premiums over general AI roles.

Get Weekly AI Career Intelligence

Salary data, skills demand, and market signals from 16,000+ AI job postings. Every Monday.