Interested in this AI Software Engineer role at Midi Health?
Apply Now →Skills & Technologies
About This Role
Location: Hybrid- San Francisco OR Palo Alto Office, Tuesday/Thursday
Job Type: Full-time W2
About Midi Health
Midi Health is the largest virtual care clinic for women in midlife navigating perimenopause, menopause, and other hormonal transitions. We combine expert clinicians, evidence-based protocols, and a modern technology platform to deliver care that has historically been underserved by the healthcare system. We're a fast-growing, mission-driven company building the infrastructure and products that define this new category of care.
How We Work
- Hybrid by design. Two days a week in-office (Tuesday and Thursday) in Palo Alto or San Francisco. We believe high-trust teams are built in person and scaled remotely.
- AI-native engineering. We expect every engineer to be fluent with modern AI coding tools (Claude Code, Cursor, Copilot, and similar) and to actively push the frontier of how we build software.
- Low-ego, high-curiosity. We approach disagreement with humility and technical rigor, not politics. We invest in each other's growth.
- Outcome-oriented. We move fast, own our work end-to-end, and balance speed with the durability that healthcare demands.
The Difference You Will Make
AI is reshaping how clinical care is delivered, and Midi is building the products at the frontier of that shift. You'll build AI-powered features and systems that genuinely change clinician and patient experience — from clinical workflow automation to patient-facing assistants to back-office intelligence — grounded in the realities of healthcare-grade safety and evaluation.
What You Will Do
- Design, build, and ship LLM-powered features end-to-end: prompt design, retrieval, tool use, agents, evaluation, and production operations
- Build the evaluation harnesses and feedback loops that let us ship AI features responsibly
- Integrate AI capabilities deeply into patient, clinician, and operational workflows
- Partner with clinical, product, and safety stakeholders to define what "good" looks like
- Contribute to our internal AI-for-engineering practices and tooling
- Stay close to the research and ecosystem; bring the best of it back to the team
About You
- 6+ years of software engineering experience, with meaningful recent time building production LLM / ML features
- Strong hands-on coding skills in Python; comfortable across the full stack when the feature demands it
- Seasoned at system design for AI systems: retrieval, orchestration, caching, evaluation, cost and latency tradeoffs
- Deep, hands-on command of modern AI coding tools — you're a strong follower of the frontier and apply new techniques quickly
- Good mentorship instincts; generous with what you learn
- Rigorous about evaluation and safety; allergic to vibes-only launches
- Strong communicator; comfortable explaining model behavior to non-technical stakeholders
- Low-ego, curious, humble
Nice to Have
- Experience with healthcare, clinical NLP, or regulated AI deployments
- Experience building agentic systems or production RAG at scale
Interview Process
- Recruiter Screen (30 min)
- Hiring Manager Screen (45 min)
- Live Technical Assessment (3 sessions: 150 min)
- On-Site Interview and Lunch (4 sessions: 150 min)
While you are waiting for us to review your resume, here is some fun content to check out.
Midi 2024 in Review
Women Leaders Invest in Midi
Patient Testimonials
At Midi Health, we are committed to pay transparency and equity. The estimated salary range for this role is $170,000-$210,000 per year, based on factors such as experience and skills. In addition to base salary, employees are eligible for a wide range of benefits and equity in the company,
We believe in fair and competitive compensation practices that align with our values of equity and inclusion. If you have any questions about how we determine pay, we're happy to discuss further in the hiring process.
#li-ps1
At this time, Midi is unable to provide visa sponsorship. All Candidates must be authorized to work in the United States without current or future sponsorship needs.
Please note that all official communication from Midi Health will come from an @joinmidi.com email address. We will never ask for payment of any kind during the application or hiring process. If you receive any suspicious communication claiming to be from Midi Health, please report it immediately by emailing us at [email protected].
Midi Health is an Equal Opportunity Employer. We are committed to pay equity and ensure that all qualified applicants receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or protected veteran status. Our compensation philosophy is based on fair, objective criteria and the impact of the role, regardless of an applicant's salary history.
Please find our CCPA Privacy Notice for California Candidates here.
Salary Context
This $170K-$210K range is below the median for AI Software Engineer roles in our dataset (median: $192K across 146 roles with salary data).
Role Details
About This Role
AI Software Engineers build the applications and systems that AI models run inside. They own the API layers, data pipelines, frontend integrations, and infrastructure that turn a model into a product users interact with. Every AI company needs engineers who can build the software around the AI.
The challenge is building reliable systems around inherently unreliable components. Models are probabilistic. They'll give different answers to the same question. They hallucinate. They're slow. They're expensive. Your job is to build an application layer that handles all of this gracefully while delivering a product that users trust and enjoy.
Across the 8,943 AI roles we're tracking, AI Software Engineer positions make up 4% of the market. At Midi Health, this role fits into their broader AI and engineering organization.
AI Software Engineer roles are among the most numerous in the AI job market. Every company deploying AI needs software engineers who understand AI integration patterns. The demand is broad, spanning startups to enterprises, across every industry adopting AI capabilities.
What the Work Looks Like
A typical week includes: building API endpoints that serve model inference with caching and fallback logic, designing the data pipeline that feeds context to a RAG system, implementing streaming responses in the frontend, debugging a race condition in the async inference pipeline, and optimizing database queries for the vector search layer. It's full-stack engineering with AI at the center.
AI Software Engineer roles are among the most numerous in the AI job market. Every company deploying AI needs software engineers who understand AI integration patterns. The demand is broad, spanning startups to enterprises, across every industry adopting AI capabilities.
Skills Required
Full-stack engineering skills with AI integration experience. Python and TypeScript are the most common requirements. You'll need to understand API design, database architecture, and how to build reliable systems around probabilistic outputs. Experience with streaming, async processing, and caching patterns is increasingly important as real-time AI applications proliferate.
Knowledge of vector databases, embedding APIs, and LLM integration patterns (function calling, structured outputs, retry logic) differentiates AI software engineers from general software engineers. Understanding cost optimization (caching strategies, model routing, batched inference) is valuable since inference costs can dominate application economics.
Strong postings describe the product you'll be building, the AI integration patterns you'll work with, and the scale requirements. Look for companies that have existing AI features and need engineers to improve and expand them, not companies that are 'planning to add AI' someday.
Compensation Benchmarks
AI Software Engineer roles pay a median of $220,000 based on 1,448 positions with disclosed compensation. Senior-level AI roles across all categories have a median of $228,700. This role's midpoint ($190K) sits 14% below the category median. Disclosed range: $170K to $210K.
Across all AI roles, the market median is $213,380. Top-quartile compensation starts at $264,148. The 90th percentile reaches $319,310. For comparison, the highest-paying categories include AI Safety ($253,100) and Research Engineer ($252,000). By seniority level: Entry: $110,408; Mid: $193,200; Senior: $228,700; Director: $272,250; VP: $235,000.
Midi Health AI Hiring
Midi Health has 2 open AI roles right now. They're hiring across AI/ML Engineer, AI Software Engineer. Positions span Palo Alto, CA, San Francisco, CA, US. Compensation range: $210K - $210K.
Location Context
AI roles in San Francisco pay a median of $263,811 across 2,416 tracked positions. That's 24% above the national median.
Career Path
Common paths into AI Software Engineer roles include Software Engineer, Full-Stack Developer, Backend Engineer.
From here, career progression typically leads toward Staff Engineer, AI Architect, Engineering Manager.
If you're a software engineer, you're already 80% there. Learn the AI integration patterns: RAG, streaming inference, function calling, structured outputs. Build a project that demonstrates you can wrap an AI model in a production-quality application with proper error handling, caching, and user experience. That's the portfolio piece that gets you hired.
What to Expect in Interviews
Technical screens look like standard software engineering interviews with an AI twist. Expect system design questions about building reliable applications around probabilistic models: handling streaming responses, implementing retry logic for API failures, and designing caching strategies for LLM outputs. Coding rounds test standard algorithms plus practical integration patterns like async processing and rate limiting.
When evaluating opportunities: Strong postings describe the product you'll be building, the AI integration patterns you'll work with, and the scale requirements. Look for companies that have existing AI features and need engineers to improve and expand them, not companies that are 'planning to add AI' someday.
AI Hiring Overview
The AI job market has 8,943 open positions tracked in our dataset. By seniority: 175 entry-level, 4,132 mid-level, 3,268 senior, and 1,368 leadership roles (Director, VP, C-Level). Remote roles make up 6% of the market (521 positions). The remaining 8,351 roles require on-site or hybrid attendance.
The market median for AI roles is $213,380. Top-quartile compensation starts at $264,148. The 90th percentile reaches $319,310. Highest-paying categories: AI Safety ($253,100 median, 57 roles); Research Engineer ($252,000 median, 419 roles); AI Engineering Manager ($251,622 median, 51 roles).
AI Software Engineer roles are among the most numerous in the AI job market. Every company deploying AI needs software engineers who understand AI integration patterns. The demand is broad, spanning startups to enterprises, across every industry adopting AI capabilities.
The AI Job Market Today
The AI job market spans 8,943 open positions across 16 role categories. The largest categories by volume: AI/ML Engineer (6,739), AI Product Manager (403), AI Software Engineer (402). These three account for the majority of open positions, though smaller categories often have higher per-role compensation because of specialized skill requirements.
The seniority mix tells a story about where AI teams are in their maturity. Entry-level roles (175) are outnumbered by mid-level (4,132) and senior (3,268) positions, reflecting that most companies are past the 'build a team from scratch' phase and need experienced engineers who can ship production systems. Leadership roles (Director, VP, C-Level) total 1,368 positions, representing the bottleneck between technical execution and organizational strategy.
Remote work availability sits at 6% of all AI roles (521 positions), with 8,351 requiring on-site or hybrid attendance. The remote share has stabilized after the post-pandemic correction. Senior and specialized roles (Research Scientist, ML Architect) are more likely to be remote-eligible than entry-level positions, partly because experienced hires have more negotiating power and partly because these roles require less hands-on mentorship.
AI compensation is structured in clear tiers. The market median sits at $213,380. Top-quartile roles start at $264,148, and the 90th percentile reaches $319,310. These figures include base salary with disclosed compensation. Total compensation (including equity, bonuses, and sign-on) runs 20-40% higher at companies that offer those components.
Category matters for compensation. AI Safety roles lead at $253,100 median, while Prompt Engineer roles sit at $141,440. The spread between highest and lowest-paying categories reflects the premium on specialized technical skills versus broader analytical roles.
The most in-demand skills across all AI postings: Python (1,422 postings), Aws (808 postings), Azure (638 postings), Rag (555 postings), Gcp (457 postings), Pytorch (433 postings), Claude (341 postings), Kubernetes (337 postings). Python dominates, appearing in the vast majority of role descriptions regardless of category. Cloud platform experience (AWS, GCP, Azure) is the second most common requirement. The newer entrants to the top skills list (RAG, vector databases, LLM APIs) reflect the shift from traditional ML toward generative AI applications.
Frequently Asked Questions
Get Weekly AI Career Intelligence
Salary data, skills demand, and market signals from 16,000+ AI job postings. Every Monday.