Senior Software Engineer II, AI Labs & Foundations

$230K - $242K Remote Senior AI Software Engineer

Interested in this AI Software Engineer role at Instacart?

Apply Now →

Skills & Technologies

AwsClaudeDockerFaissFine TuningGcpKubernetesPineconeRagVector Search

About This Role

AI job market dashboard showing open roles by category

We're transforming the grocery industry

At Instacart, we invite the world to share love through food because we believe everyone should have access to the food they love and more time to enjoy it together. Where others see a simple need for grocery delivery, we see exciting complexity and endless opportunity to serve the varied needs of our community. We work to deliver an essential service that customers rely on to get their groceries and household goods, while also offering safe and flexible earnings opportunities to Instacart Personal Shoppers.

Instacart has become a lifeline for millions of people, and we’re building the team to help push our shopping cart forward. If you’re ready to do the best work of your life, come join our table.

Instacart is a Flex First team

There’s no one\-size fits all approach to how we do our best work. Our employees have the flexibility to choose where they do their best work—whether it’s from home, an office, or your favorite coffee shop—while staying connected and building community through regular in\-person events. Learn more about our flexible approach to where we work.

Overview

------------

Join Instacart's mission to transform grocery shopping through frontier AI. As a Senior Software Engineer on AI Labs \& Foundations, you will design, build, and operate the high\-scale production systems that power our most ambitious AI experiences—from Cart Assistant, our conversational shopping agent, to voice AI interactions and beyond. This is a high\-impact opportunity to work at the intersection of robust software engineering and cutting\-edge production AI/ML, directly shaping products used by millions of customers every day.

We are hiring a Senior Software Engineer who will participate in the design and delivery of production AI systems, identify high\-leverage technical opportunities, and contribute hands\-on to AI\-native products across Instacart's platform. We value bottom\-up ideas, high engineering quality, and close partnership with Product, Data Science, ML, and Infrastructure teams. If you enjoy inventing, navigating ambiguity, prototyping fast, and turning wild ideas into real, scalable products, this is the team for you.

AI Labs \& Foundations sits at the intersection of frontier AI research and production engineering. Our portfolio spans the full stack of AI innovation at Instacart, including building and launching Cart Assistant, pioneering voice AI interactions, and constructing the foundational systems that power these cutting\-edge experiences. We are a fast\-moving, collaborative team that thrives on 0\-to\-1 thinking, shares learnings openly, and ships with urgency by prototyping fast and testing rigorously.

About the Job

-----------------

  • Design, build, and operate production AI\-powered systems and agentic experiences (including Cart Assistant and voice AI) that directly impact how millions of customers shop.
  • Build foundational systems for cutting\-edge AI experiences, ranging from embedding infrastructure and voice AI pipelines, to client facing components and integrations, by prototyping bold ideas and productizing what works.
  • Integrate foundation models via APIs and open\-source frameworks; apply techniques like retrieval\-augmented generation and vector search where appropriate.
  • Own projects end\-to\-end: requirements, technical design, implementation, testing, deployment, observability, and iterative improvement focused on reliability, latency, and cost efficiency.
  • Collaborate with cross\-functional partners in product, design, data science, and infrastructure to ship AI features end\-to\-end.
  • Drive engineering excellence, including thoughtful system design, rigorous code review, and technical leadership that includes defining and promoting best practices for AI/ML production engineering across the team.

About You

-------------

Minimum Qualifications:

  • Proven senior software engineer who has built, shipped, and operated production systems at scale. You make architectural calls, own what you build, and deliver through ambiguity.
  • Hands\-on experience with AI or ML in production. You've shipped LLM\-powered features or integrated foundation model APIs into a live product, demonstrating the necessary expertise at the intersection of robust software engineering and deep production ML.
  • Experience owning services end\-to\-end, including CI/CD, automated testing, observability (logging, metrics, tracing), and on\-call participation.
  • Strong communicator who partners well across disciplines \- you want to get to the right answer, not just defend the first one.
  • Excitement and ability to leverage cutting\-edge development tools, including AI assistance (e.g., Copilot, Cursor, Claude), to maximize velocity.

Preferred Qualifications:

  • 5 to 8\+ years of industry experience.
  • A track record of 0\-to\-1 work taking unconventional ideas from prototype through rapid iteration to production.
  • Experience building conversational agents, multi\-turn dialogue systems, or agentic LLM applications.
  • Experience with STT/TTS or natural language interfaces, LLM fine tuning, ML transfer learning, model training and the vocabulary of measurement of model performance.
  • Experience with embedding systems, vector search, or retrieval\-augmented generation (RAG) with vector databases (e.g., Pinecone, Weaviate, FAISS, or Elasticsearch).
  • Experience with cloud platforms (AWS or GCP), containers (Docker), and orchestration (Kubernetes).
  • Experience with event\-driven or distributed systems (e.g., Kafka).
  • Demonstrated mentorship and technical leadership within cross\-functional teams.

\#LI\-Remote

Instacart provides highly market\-competitive compensation and benefits in each location where our employees work. This role is remote and the base pay range for a successful candidate is dependent on their permanent work location. Please review our Flex First remote work policy here.

Offers may vary based on many factors, such as candidate experience and skills required for the role. Additionally, this role is eligible for a new hire equity grant as well as annual refresh grants. Please read more about our benefits offerings here.

For US based candidates, the base pay ranges for a successful candidate are listed below.

CA, NY, CT, NJ

$230,000 \- $242,000 USD

WA

$220,000 \- $232,000 USD

OR, DE, ME, MA, MD, NH, RI, VT, DC, PA, VA, CO, TX, IL, HI

$211,000 \- $222,000 USD

All other states

$192,000 \- $202,000 USD

Salary Context

This $230K-$242K range is above the 75th percentile for AI Software Engineer roles in our dataset (median: $190K across 251 roles with salary data).

Role Details

Company Instacart
Title Senior Software Engineer II, AI Labs & Foundations
Location Remote, US
Category AI Software Engineer
Experience Senior
Salary $230K - $242K
Remote Yes

About This Role

AI Software Engineers build the applications and systems that AI models run inside. They own the API layers, data pipelines, frontend integrations, and infrastructure that turn a model into a product users interact with. Every AI company needs engineers who can build the software around the AI.

The challenge is building reliable systems around inherently unreliable components. Models are probabilistic. They'll give different answers to the same question. They hallucinate. They're slow. They're expensive. Your job is to build an application layer that handles all of this gracefully while delivering a product that users trust and enjoy.

Across the 4,133 AI roles we're tracking, AI Software Engineer positions make up 8% of the market. At Instacart, this role fits into their broader AI and engineering organization.

AI Software Engineer roles are among the most numerous in the AI job market. Every company deploying AI needs software engineers who understand AI integration patterns. The demand is broad, spanning startups to enterprises, across every industry adopting AI capabilities.

What the Work Looks Like

A typical week includes: building API endpoints that serve model inference with caching and fallback logic, designing the data pipeline that feeds context to a RAG system, implementing streaming responses in the frontend, debugging a race condition in the async inference pipeline, and optimizing database queries for the vector search layer. It's full-stack engineering with AI at the center.

AI Software Engineer roles are among the most numerous in the AI job market. Every company deploying AI needs software engineers who understand AI integration patterns. The demand is broad, spanning startups to enterprises, across every industry adopting AI capabilities.

Skills Required

Aws (32% of roles) Claude (14% of roles) Docker (11% of roles) Faiss (1% of roles) Fine Tuning (1% of roles) Gcp (20% of roles) Kubernetes (13% of roles) Pinecone (3% of roles) Rag (22% of roles) Vector Search (2% of roles)

Full-stack engineering skills with AI integration experience. Python and TypeScript are the most common requirements. You'll need to understand API design, database architecture, and how to build reliable systems around probabilistic outputs. Experience with streaming, async processing, and caching patterns is increasingly important as real-time AI applications proliferate.

Knowledge of vector databases, embedding APIs, and LLM integration patterns (function calling, structured outputs, retry logic) differentiates AI software engineers from general software engineers. Understanding cost optimization (caching strategies, model routing, batched inference) is valuable since inference costs can dominate application economics.

Strong postings describe the product you'll be building, the AI integration patterns you'll work with, and the scale requirements. Look for companies that have existing AI features and need engineers to improve and expand them, not companies that are 'planning to add AI' someday.

Compensation Benchmarks

AI Software Engineer roles pay a median of $232,000 based on 863 positions with disclosed compensation. Senior-level AI roles across all categories have a median of $227,400. Disclosed range: $230K to $242K.

Across all AI roles, the market median is $200,700. Top-quartile compensation starts at $254,000. The 90th percentile reaches $307,500. For comparison, the highest-paying categories include AI Safety ($274,200) and AI Engineering Manager ($268,700). By seniority level: Entry: $97,760; Mid: $165,778; Senior: $227,400; Director: $250,000; VP: $250,000.

Instacart AI Hiring

Instacart has 16 open AI roles right now. They're hiring across AI/ML Engineer, AI Software Engineer, Data Scientist, Research Scientist. Positions span Remote, US, San Francisco, CA, US. Compensation range: $204K - $330K.

Remote Work Context

Remote AI roles pay a median of $173,300 across 2,012 positions. About 14% of all AI roles offer remote work.

Career Path

Common paths into AI Software Engineer roles include Software Engineer, Full-Stack Developer, Backend Engineer.

From here, career progression typically leads toward Staff Engineer, AI Architect, Engineering Manager.

If you're a software engineer, you're already 80% there. Learn the AI integration patterns: RAG, streaming inference, function calling, structured outputs. Build a project that demonstrates you can wrap an AI model in a production-quality application with proper error handling, caching, and user experience. That's the portfolio piece that gets you hired.

What to Expect in Interviews

Technical screens look like standard software engineering interviews with an AI twist. Expect system design questions about building reliable applications around probabilistic models: handling streaming responses, implementing retry logic for API failures, and designing caching strategies for LLM outputs. Coding rounds test standard algorithms plus practical integration patterns like async processing and rate limiting.

When evaluating opportunities: Strong postings describe the product you'll be building, the AI integration patterns you'll work with, and the scale requirements. Look for companies that have existing AI features and need engineers to improve and expand them, not companies that are 'planning to add AI' someday.

AI Hiring Overview

The AI job market has 4,133 open positions tracked in our dataset. By seniority: 106 entry-level, 1,901 mid-level, 1,663 senior, and 463 leadership roles (Director, VP, C-Level). Remote roles make up 14% of the market (583 positions). The remaining 3,532 roles require on-site or hybrid attendance.

The market median for AI roles is $200,700. Top-quartile compensation starts at $254,000. The 90th percentile reaches $307,500. Highest-paying categories: AI Safety ($274,200 median, 57 roles); AI Engineering Manager ($268,700 median, 42 roles); Research Engineer ($260,000 median, 442 roles).

AI Software Engineer roles are among the most numerous in the AI job market. Every company deploying AI needs software engineers who understand AI integration patterns. The demand is broad, spanning startups to enterprises, across every industry adopting AI capabilities.

The AI Job Market Today

The AI job market spans 4,133 open positions across 15 role categories. The largest categories by volume: AI/ML Engineer (2,865), Data Scientist (339), AI Software Engineer (313). These three account for the majority of open positions, though smaller categories often have higher per-role compensation because of specialized skill requirements.

The seniority mix tells a story about where AI teams are in their maturity. Entry-level roles (106) are outnumbered by mid-level (1,901) and senior (1,663) positions, reflecting that most companies are past the 'build a team from scratch' phase and need experienced engineers who can ship production systems. Leadership roles (Director, VP, C-Level) total 463 positions, representing the bottleneck between technical execution and organizational strategy.

Remote work availability sits at 14% of all AI roles (583 positions), with 3,532 requiring on-site or hybrid attendance. The remote share has stabilized after the post-pandemic correction. Senior and specialized roles (Research Scientist, ML Architect) are more likely to be remote-eligible than entry-level positions, partly because experienced hires have more negotiating power and partly because these roles require less hands-on mentorship.

AI compensation is structured in clear tiers. The market median sits at $200,700. Top-quartile roles start at $254,000, and the 90th percentile reaches $307,500. These figures include base salary with disclosed compensation. Total compensation (including equity, bonuses, and sign-on) runs 20-40% higher at companies that offer those components.

Category matters for compensation. AI Safety roles lead at $274,200 median, while Prompt Engineer roles sit at $140,000. The spread between highest and lowest-paying categories reflects the premium on specialized technical skills versus broader analytical roles.

The most in-demand skills across all AI postings: Python (2,128 postings), Aws (1,324 postings), Azure (1,003 postings), Rag (916 postings), Gcp (817 postings), Pytorch (655 postings), Prompt Engineering (639 postings), Claude (571 postings). Python dominates, appearing in the vast majority of role descriptions regardless of category. Cloud platform experience (AWS, GCP, Azure) is the second most common requirement. The newer entrants to the top skills list (RAG, vector databases, LLM APIs) reflect the shift from traditional ML toward generative AI applications.

Frequently Asked Questions

Based on 863 roles with disclosed compensation, the median salary for AI Software Engineer positions is $232,000. Actual compensation varies by seniority, location, and company stage.
Full-stack engineering skills with AI integration experience. Python and TypeScript are the most common requirements. You'll need to understand API design, database architecture, and how to build reliable systems around probabilistic outputs. Experience with streaming, async processing, and caching patterns is increasingly important as real-time AI applications proliferate.
About 14% of the 4,133 AI roles we track offer remote work. Remote availability varies by company and seniority level, with senior and leadership roles more likely to offer location flexibility.
Instacart is among the companies actively hiring for AI and ML talent. Check our company profiles for detailed breakdowns of open roles, salary ranges, and hiring trends.
Common next steps from AI Software Engineer positions include Staff Engineer, AI Architect, Engineering Manager. Progression depends on whether you lean toward technical depth, people management, or product strategy.

Get Weekly AI Career Intelligence

Salary data, skills demand, and market signals from 16,000+ AI job postings. Every Monday.