AI Jobs with RAG Experience

Find AI jobs requiring Retrieval-Augmented Generation (RAG) experience. LLM engineer and AI architect positions.

937
Open Positions
$210K
Avg. Salary
140
Remote Roles

Data updated weekly. Last refreshed 2026-08-20.

AI/ML Engineer
Application Architect - Enterprise & AI
Rippling
$120K - $130K Melville, NY, US
View Role →
AI/ML Engineer
Senior AI/ML Engineer - Research Data AI and Predictive Modeling (Vaccine R&D)
Pfizer
$139K - $231K Pearl River, NY, US
View Role →
AI/ML Engineer
AI / ML Engineer
DEPLOY
$85K - $199K Huntsville, AL, US
View Role →
AI Software Engineer
Software Engineer Senior-Ai Engineer
PNC Financial Services Group
Pittsburgh, PA, US
View Role →
AI/ML Engineer
AI Engineering & Enablement Lead
EVERSANA
$178K - $213K Overland Park, KS, US
View Role →
AI/ML Engineer
AI Application Architect
Alchemy
$0K - $0K Santa Clara, CA, US
View Role →
AI/ML Engineer
AGILE AI ENGAGEMENT STEWARD
Fitness Interface LLC
Las Vegas, NV, US
View Role →
AI Product Manager
Product Manager, Enterprise AI & Portfolio Management Platforms
Salesforce
$148K - $223K Seattle, WA, US
View Role →
AI Architect
Lead Data Engineer - GCP AI Architect
Capgemini
$144K - $190K Chicago, IL, US
View Role →
AI/ML Engineer
Enterprise AI Solutions Engineer
Alvarez & Marsal
$195K - $230K New York, NY, US
View Role →
Data Scientist
AI Data Scientist
nan
US
View Role →
AI/ML Engineer
Agentic AI Engineering Architect (Remote -US)
OMG Technology
Remote
View Role →
AI Architect
Principal AI Architect
LPL Financial
$155K - $259K Fort Mill, SC, US
View Role →
AI Engineering Manager
Sr Manager, IT AI Engineering
Information Technology Senior Management Forum
Fort Worth, TX, US
View Role →
AI/ML Engineer
Specialist Solutions Architect - AI/ML
Databricks
$180K - $247K US
View Role →
AI/ML Engineer
Machine Learning Engineer
Crowe
$62K - $100K Livingston, NJ, US
View Role →
AI/ML Engineer
Enterprise Architect- AI
Avance Services
$166K - $176K Salt Lake City, UT, US
View Role →
Data Scientist
Data Scientist
Nestlé Purina
$88K - $123K St. Louis, MO, US
View Role →
Prompt Engineer
Prompt Engineer / AI Specialist / Tech Analyst
Capgemini
$66K - $104K Alpharetta, GA, US
View Role →
AI/ML Engineer
Forward Deployed Engineer- AI Implementation
Aptean
Alpharetta, GA, US
View Role →
AI/ML Engineer
SENIOR AI ENGINEER
Coforge
Oaks, PA, US
View Role →
AI/ML Engineer
Senior AI Security Engineer
World Wide Technology
$116K - $145K Remote
View Role →
AI/ML Engineer
Senior AI Engineer I - Global Dining
American Express
$123K - $215K New York, NY, US
View Role →
AI/ML Engineer
Senior Data & AI Engineer
Meadows & Ohly
Alpharetta, GA, US
View Role →
AI/ML Engineer
AI Platform and Ops Lead, Vice President
State Street
$120K - $202K Quincy, MA, US
View Role →
Data Engineer
Senior Principal AI Data Engineer
General Dynamics Information Technology
$174K - $235K Arlington, VA, US
View Role →
AI/ML Engineer
Sr. AI Developer, Engineering
EVERSANA
$122K - $207K Chicago, IL, US
View Role →
AI/ML Engineer
Manager, AI Products & GIS
John Staurulakis
US
View Role →
AI Engineering Manager
Sr Manager, IT AI Engineering
American Airlines
Fort Worth, TX, US
View Role →
AI/ML Engineer
Director AI Data Coordination
AmeriHealth Caritas
US
View Role →
AI/ML Engineer
GCP Generative AI Application Engineer
DATA PULSE TECH AI LLC
$145K - $187K Remote
View Role →
AI/ML Engineer
AI Engineer
Cognizant
$100K - $145K Pleasanton, CA, US
View Role →
Research Engineer
Lead Research Engineer, Search & Retrieval
Thomson Reuters
$137K - $293K New York, NY, US
View Role →
AI Product Manager
Product Manager, AI Entities
EvenUp
$177K - $209K San Francisco, CA, US
View Role →
AI Architect
Data / AI Architect
Cloud and Things
$104K - $124K New York, NY, US
View Role →
AI/ML Engineer
AI PLATFORM ENGINEER
Acuhuman
$166K - $187K Remote
View Role →
AI/ML Engineer
Associate AI Engineer
Pogue Construction
McKinney, TX, US
View Role →
AI/ML Engineer
Applied AI/ML Engineer
CONFIDO
$200K - $250K New York, NY, US
View Role →
AI/ML Engineer
Applied AI Strategist - Senior Manager - Location OPEN
EY
$150K - $390K Chicago, IL, US
View Role →
Data Scientist
Databricks Data Scientist
nan
$113K - $188K Washington, DC, US
View Role →
Data Scientist
(USA) Distinguished, Data Scientist
Walmart
$130K - $338K Bentonville, AR, US
View Role →
Research Scientist
Applied Scientist
Adobe
$120K - $238K San Jose, CA, US
View Role →
AI/ML Engineer
Senior AI Engineer/Software Developer - TS/SCI with Polygraph
General Dynamics Information Technology
$164K - $218K Chantilly, VA, US
View Role →
AI/ML Engineer
Senior Principal Agentic AI/ML Engineer
General Dynamics Information Technology
$191K - $258K Arlington, VA, US
View Role →
AI Software Engineer
Principal Agentic AI Full Stack Software Engineer
General Dynamics Information Technology
$148K - $201K Arlington, VA, US
View Role →
AI/ML Engineer
Sr. Staff Engineer AI Incubation
Albertsons
$144K - $188K Pleasanton, CA, US
View Role →
AI Software Engineer
Lead Software Engineer - Cloud/AI Engineer
JPMorganChase
Plano, TX, US
View Role →
AI/ML Engineer
AI-Ready Context Engineer/ Ontologist
KeyBank
$96K - $181K Brooklyn, OH, US
View Role →
AI/ML Engineer
Senior Electrical Engineer – MV AI UPS Data Centers & Storage
ONENERGY
Remote
View Role →
AI/ML Engineer
Principal Product Manager, Agentic Experiences
Newfold Digital
$150K - $190K US
View Role →

Showing 50 of 937 jobs

About This Role

AI job market dashboard showing open roles by category

AI/ML Engineers build and deploy machine learning models in production. They work across the full ML lifecycle: data pipelines, model training, evaluation, and serving infrastructure. The role has evolved significantly over the past two years. Where ML Engineers once spent most of their time on model architecture, the job now tilts heavily toward inference optimization, cost management, and integrating LLM capabilities into existing systems. Companies want engineers who can ship production systems, and the experimenter-only role is fading fast.

Day-to-day, you're writing training pipelines, debugging data quality issues, setting up evaluation frameworks, and figuring out why your model performs differently in staging than it did on your dev set. The best ML engineers are obsessive about reproducibility and measurement. They instrument everything. They know that a model is only as good as the data feeding it and the infrastructure serving it.

Across the 4,317 AI roles we're tracking, AI/ML Engineer positions make up 70% of the market.

Demand for AI/ML Engineers has been strong and consistent. Unlike some AI roles that spike with hype cycles, ML engineering is a foundational need. Every company deploying AI models needs people who can keep them running, and the gap between research prototypes and production systems keeps growing.

Compensation Benchmarks

AI/ML Engineer roles pay a median of $214,900 based on 6,420 positions with disclosed compensation.

Across all AI roles, the market median is $215,000. Top-quartile compensation starts at $266,300. The 90th percentile reaches $320,790. For comparison, the highest-paying categories include AI Safety ($287,500) and Research Engineer ($272,100). By seniority level: Entry: $110,000; Mid: $194,400; Senior: $227,400; Director: $274,554; VP: $241,000.

AI Hiring Overview

The AI job market has 4,317 open positions tracked in our dataset. By seniority: 138 entry-level, 2,071 mid-level, 1,655 senior, and 453 leadership roles (Director, VP, C-Level). Remote roles make up 15% of the market (635 positions). The remaining 3,657 roles require on-site or hybrid attendance.

The market median for AI roles is $215,000. Top-quartile compensation starts at $266,300. The 90th percentile reaches $320,790. Highest-paying categories: AI Safety ($287,500 median, 34 roles); Research Engineer ($272,100 median, 227 roles); AI Engineering Manager ($244,000 median, 23 roles).

Demand for AI/ML Engineers has been strong and consistent. Unlike some AI roles that spike with hype cycles, ML engineering is a foundational need. Every company deploying AI models needs people who can keep them running, and the gap between research prototypes and production systems keeps growing.

Career Path

Common paths into AI/ML Engineer roles include Data Scientist, Software Engineer, Research Engineer.

From here, career progression typically leads toward ML Architect, AI Engineering Manager, Principal ML Engineer.

The fastest path into ML engineering is through software engineering with a self-directed ML education. A CS degree helps, but production engineering skills matter more than academic credentials. Build something that works, deploy it, and measure it. That portfolio project is worth more than a Coursera certificate. For career growth, the fork comes around the senior level: go deep on technical complexity (staff/principal track) or move into managing ML teams.

The AI Job Market Today

The AI job market spans 4,317 open positions across 15 role categories. The largest categories by volume: AI/ML Engineer (3,004), Data Scientist (345), AI Software Engineer (309). These three account for the majority of open positions, though smaller categories often have higher per-role compensation because of specialized skill requirements.

The seniority mix tells a story about where AI teams are in their maturity. Entry-level roles (138) are outnumbered by mid-level (2,071) and senior (1,655) positions, reflecting that most companies are past the 'build a team from scratch' phase and need experienced engineers who can ship production systems. Leadership roles (Director, VP, C-Level) total 453 positions, representing the bottleneck between technical execution and organizational strategy.

Remote work availability sits at 15% of all AI roles (635 positions), with 3,657 requiring on-site or hybrid attendance. The remote share has stabilized after the post-pandemic correction. Senior and specialized roles (Research Scientist, ML Architect) are more likely to be remote-eligible than entry-level positions, partly because experienced hires have more negotiating power and partly because these roles require less hands-on mentorship.

AI compensation is structured in clear tiers. The market median sits at $215,000. Top-quartile roles start at $266,300, and the 90th percentile reaches $320,790. These figures include base salary with disclosed compensation. Total compensation (including equity, bonuses, and sign-on) runs 20-40% higher at companies that offer those components.

Category matters for compensation. AI Safety roles lead at $287,500 median, while Prompt Engineer roles sit at $145,000. The spread between highest and lowest-paying categories reflects the premium on specialized technical skills versus broader analytical roles.

The most in-demand skills across all AI postings: Python (2,249 postings), Aws (1,224 postings), Azure (938 postings), Rag (915 postings), Gcp (660 postings), Pytorch (640 postings), Prompt Engineering (624 postings), Kubernetes (559 postings). Python dominates, appearing in the vast majority of role descriptions regardless of category. Cloud platform experience (AWS, GCP, Azure) is the second most common requirement. The newer entrants to the top skills list (RAG, vector databases, LLM APIs) reflect the shift from traditional ML toward generative AI applications.

Frequently Asked Questions

AI Pulse currently tracks 937 AI job openings that require AI with RAG Experience skills. 140 of these are remote positions.
RAG (Retrieval-Augmented Generation) appears in 74% of LLM-focused AI engineering roles. It's the single most requested LLM-specific skill. Companies need engineers who can build production retrieval systems, not just call LLM APIs.
Pinecone is most commonly requested, followed by Weaviate and Chroma. However, the concepts transfer between databases. Focus on understanding embeddings, similarity metrics, and chunking strategies rather than one specific tool.
AI roles requiring AI with RAG Experience pay an average of $210K based on disclosed compensation. Specialized skills like AI with RAG Experience combined with production experience typically command 10-20% premiums over general AI roles.

Get Weekly AI Career Intelligence

Salary data, skills demand, and market signals from 16,000+ AI job postings. Every Monday.