Staff Software Engineer I, AI Transformation

$208K - $258K New York, NY, US Senior AI Software Engineer

Interested in this AI Software Engineer role at Spring Health?

Apply Now →

Skills & Technologies

AwsPrompt EngineeringPythonTypescript

About This Role

AI job market dashboard showing open roles by category

Our mission: eliminating every barrier to mental health.

Spring Health is a global mental health company on a mission to eliminate every barrier to mental health. We're building a world where getting support is simple, personal, and built around the person, so care can continue through every job, move, health plan, and life stage.

Our AI-native platform helps us deliver personalized support across self-guided tools, coaching, therapy, medication management, and specialty care. With outcomes independently validated by JAMA Network Open and the Validation Institute, Spring Health reaches more than 170 million people worldwide through leading employers, health plans, and partners.

As an AI-native company, we believe technology should expand the reach, quality, and humanity of care. Every Spring Health team member is expected to use AI tools thoughtfully, apply human judgment to AI outputs, and keep building AI fluency in ways that support their role and our mission.

Reporting to the Senior Manager, Engineering, AI Tooling & Enablement, this Staff Software Engineer will lead architecture and technical strategy for AI transformation. You will translate broad product and organizational visions into scalable, modular system architectures, and act as a critical partner to Product, Engineering, and cross-functional leaders to build scalable, future-proof platform capabilities with speed, quality, and precision. This role is part of the AI Transformation & Platform Engineering team and is instrumental in modernizing our technologies through AI-driven capabilities spanning UI, harnesses, models, connectors, and governance accelerating delivery and business impact across the org.

Please note that this is a hybrid role based in New York City, with an expectation to be in the office 2–3 days per week at our 60 Madison Avenue location. Candidates must be based in the NYC metro area or able to relocate independently within 90 days of their start date. Occasional travel will be required for team on-sites.

What you’ll do

  • Lead hands-on experimentation, evaluation, and production rollout of modern AI capabilities, frameworks, and workflows (LLMs, model gateways, retrieval systems) across the engineering & enterprise platforms
  • Identify recurring systemic breakdowns in the software development lifecycle and design simpler, faster, higher-quality approaches to raise the bar for code quality, system resilience, and operational health
  • Take ownership of a team’s architecture—providing system-wide design guidance, decomposing software architecture into discrete components, and ensuring sound tradeoffs across competing dimensions.
  • Produce architecture that is exemplary in terms of efficiency, stability, extensibility, and the ability to evolve; designs reflect strategic vision, awareness of non-functional requirements, and future product flexibility.
  • Use AI to explore and validate architectural patterns and decisions; design AI-augmented workflows (e.g., automated code generation, incident analysis) that multiply team output and enable engineers at all levels to work more effectively.
  • Establish guardrails for safe and responsible AI usage across your team, covering security, compliance, and output correctness.
  • Drive best practices across the organization; lead initiatives to eliminate tech debt and prepare the codebase for future roadmap requirements.
  • Critically influence large, cross-team projects—ensuring execution without delay or compromise, and anticipating and removing barriers of all kinds.
  • Bring critical thinking and drive shared understanding in ambiguous situations; given a clear vision, create a strategy; given a clear strategy, define a sequence of objectives.
  • Provide a system-wide view to the engineers you work with; share architectural improvements across the tech org to build buy-in and drive broad implementation.
  • Develop strong working relationships cross-functionally and with business stakeholders; make sound tradeoffs between competing needs across short- and long-term horizons.
  • Empower engineers to set ambitious goals and turn vision into reality; mentor and develop engineers across the organization, not just your immediate team.
  • Handle operational escalations reliably; lead high-stakes investigations calmly and communicate progress clearly to stakeholders.
  • Participate in an on-call rotation; push for better preparation and planning to reduce the frequency and impact of production incidents.
  • Serve as a trusted technical thought leader across Engineering, Product, Security, IT, and other functional stakeholders—aligning partners early, clarifying tradeoffs, and navigating project dependencies and risks

AI Fluency Expectations

  • Uses AI to explore and validate architectural patterns and decisions that improve system scalability and reliability, and reduce operational cost
  • Multiplies team output by enabling others to effectively use AI
  • Designs and implements AI-augmented workflows (e.g., automated code generation, incident analysis) that materially reduce the amount of time, manual overhead and cost required for teams to ship code
  • Maintains R&D context for AI best practices and approaches
  • Actively directs AI strategy and resources to build, ship, or accelerate enterprise initiatives, ensuring material business impact is delivered as defined by their leveling expectations.
  • Understands AI's strategic implications for software engineering: how AI shifts development velocity, quality expectations, and the skills a high-performing engineering team needs
  • Familiar with the enterprise AI tooling landscape: what categories of tools exist (coding assistants, test generators, AI ops platforms), how to evaluate them, what governance they require
  • Understands AI risk at the organizational level: security, compliance, quality, and reputational considerations for enterprise-wide AI use in engineering
  • Knows what AI-native engineering organizations look like and can articulate where Spring Health stands in that landscape

What success looks like in this role

  • Architectural Ownership – You are responsible for a team’s architecture. Your designs are exemplary—others reference them as the standard for engineering excellence across the org.
  • AI-Augmented Engineering – You design workflows and tooling that make AI a force multiplier for your team. You establish guardrails that keep AI usage safe, compliant, and high-quality.
  • Strategic Clarity – You turn vision into strategy and strategy into objectives. You bring structure and shared understanding to the most ambiguous problems on your team and across the org.
  • Cross-Org Influence – You drive best practices beyond your immediate team. Engineers and leaders across the organization seek your input on the hardest technical problems.
  • Engineering Excellence – You lead large-scale initiatives to reduce tech debt, improve architecture, and raise the quality bar. You leave every system better than you found it.
  • People & Org Health – You empower engineers to do their best work—providing proper context, mentoring across levels, and fostering an inclusive, high-trust culture.
  • Operational Reliability – You handle escalations reliably and lead high-stakes investigations with calm, clear communication. You drive systemic improvements to reduce future incidents.

What you’ll bring

  • 10+ years of professional software engineering experience
  • Deep expertise in Python, prompt engineering, developing AI agents, and AWS cloud infrastructure; experience with our tech stack of TypeScript, React and Ruby on Rails is preferred
  • Proven experience designing and owning Fullstack platform architecture at scale
  • Uses AI to explore and validate architectural decisions, design AI-augmented engineering workflows, and establish quality and safety guardrails for AI-assisted work across a team
  • Track record of technical leadership: creating clarity from ambiguity, defining strategy from vision, and driving org-wide architectural improvements
  • Experience leading and influencing cross-functional teams and stakeholders at multiple levels
  • Demonstrated ability to mentor and develop engineers across the organization
  • Adept at covering the breadth of technology while diving deep into architectural complexity and scalability
  • At least 2+ years of hands-on experience experimenting with, integrating, or architecting modern AI tools, LLMs, model gateways, or retrieval systems into software applications
  • At least 2+ years leading architectural direction and project teams that span across multiple domains & functions
  • Bonus: Prior experience building technology within regulated or complex domains (healthcare or adjacent industries preferred)

Note: We have even more benefits than listed here and below, your recruiter will provide more in-depth information as you continue in the interview process. Benefits are subject to individual plan requirements and eligibility criteria.

  • Health, Dental, Vision benefits start on your first day at Spring. You and your dependents also receive access to One Medicalaccounts HSA and FSA plans are also available, with Spring contributing up to $1K for HSAs, depending on your plan type.
  • Employer sponsored 401(k) match of up to 2% for retirement planning
  • A yearly allotment of no cost visits to the Spring Health network of therapists, coaches, and medication management providers for you and your dependents.
  • We offer competitive paid time off policies including vacation, sick leave and company holidays.
  • At 6 months tenure with Spring, we offer parental leave of 18 weeks for birthing parents and 16 weeks for non-birthing parents.
  • Access to Noom, a weight management program—based in psychology, that’s tailored to your unique needs and goals.
  • Access to fertility care support through Carrot, in addition to $4,000 reimbursement for related fertility expenses.
  • Access toWellhub, which connects employees to the best options for fitness, mindfulness, nutrition, and sleep in one subscription
  • Access to BrightHorizons, which provides sponsored child care, back-up care, and elder care
  • Up to $1,000 Professional Development Reimbursement a year.
  • $200 per year donation matching to support your favorite causes.

Not sure if you meet every requirement? Research shows that women and people from historically underrepresented communities often hesitate to apply for roles unless they meet every qualification compared to other similarly-qualified candidates. At Spring Health, we are committed to fostering a workplace where everyone feels valued, empowered, and supported to Thrive. If this role excites you, we encourage you to apply.

Our privacy policy: https://springhealth.com/privacy-policy/

Spring Health is proud to be an equal opportunity employer. We do not discriminate in hiring or any employment decision based on race, color, religion, national origin, age, sex, marital status, ancestry, disability, genetic information, veteran status, gender identity or expression, sexual orientation, pregnancy, or other applicable legally protected characteristic. We also consider qualified applicants regardless of criminal histories, consistent with applicable legal requirements. Spring Health is also committed to providing reasonable accommodations for qualified individuals with disabilities and disabled veterans. If you have a disability or special need that requires accommodation, please let us know.

Compensation Range: $208K - $258K

Salary Context

This $208K-$258K range is above the median for AI Software Engineer roles in our dataset (median: $209K across 224 roles with salary data).

Role Details

Company Spring Health
Title Staff Software Engineer I, AI Transformation
Location New York, NY, US
Category AI Software Engineer
Experience Senior
Salary $208K - $258K
Remote No

About This Role

AI Software Engineers build the applications and systems that AI models run inside. They own the API layers, data pipelines, frontend integrations, and infrastructure that turn a model into a product users interact with. Every AI company needs engineers who can build the software around the AI.

The challenge is building reliable systems around inherently unreliable components. Models are probabilistic. They'll give different answers to the same question. They hallucinate. They're slow. They're expensive. Your job is to build an application layer that handles all of this gracefully while delivering a product that users trust and enjoy.

Across the 10,419 AI roles we're tracking, AI Software Engineer positions make up 5% of the market. At Spring Health, this role fits into their broader AI and engineering organization.

AI Software Engineer roles are among the most numerous in the AI job market. Every company deploying AI needs software engineers who understand AI integration patterns. The demand is broad, spanning startups to enterprises, across every industry adopting AI capabilities.

What the Work Looks Like

A typical week includes: building API endpoints that serve model inference with caching and fallback logic, designing the data pipeline that feeds context to a RAG system, implementing streaming responses in the frontend, debugging a race condition in the async inference pipeline, and optimizing database queries for the vector search layer. It's full-stack engineering with AI at the center.

AI Software Engineer roles are among the most numerous in the AI job market. Every company deploying AI needs software engineers who understand AI integration patterns. The demand is broad, spanning startups to enterprises, across every industry adopting AI capabilities.

Skills Required

Aws (11% of roles) Prompt Engineering (5% of roles) Python (23% of roles) Typescript (4% of roles)

Full-stack engineering skills with AI integration experience. Python and TypeScript are the most common requirements. You'll need to understand API design, database architecture, and how to build reliable systems around probabilistic outputs. Experience with streaming, async processing, and caching patterns is increasingly important as real-time AI applications proliferate.

Knowledge of vector databases, embedding APIs, and LLM integration patterns (function calling, structured outputs, retry logic) differentiates AI software engineers from general software engineers. Understanding cost optimization (caching strategies, model routing, batched inference) is valuable since inference costs can dominate application economics.

Strong postings describe the product you'll be building, the AI integration patterns you'll work with, and the scale requirements. Look for companies that have existing AI features and need engineers to improve and expand them, not companies that are 'planning to add AI' someday.

Compensation Benchmarks

AI Software Engineer roles pay a median of $224,000 based on 1,983 positions with disclosed compensation. Senior-level AI roles across all categories have a median of $230,000. Disclosed range: $208K to $258K.

Across all AI roles, the market median is $214,834. Top-quartile compensation starts at $266,000. The 90th percentile reaches $321,730. For comparison, the highest-paying categories include AI Safety ($274,500) and Research Engineer ($252,000). By seniority level: Entry: $114,400; Mid: $193,200; Senior: $230,000; Director: $272,100; VP: $235,000.

Spring Health AI Hiring

Spring Health has 6 open AI roles right now. They're hiring across AI Software Engineer, AI/ML Engineer, MLOps Engineer, Data Scientist. Positions span New York, NY, US, New York, NY, San Francisco, CA. Compensation range: $179K - $258K.

Location Context

AI roles in New York pay a median of $222,480 across 3,785 tracked positions. That's 4% above the national median.

Career Path

Common paths into AI Software Engineer roles include Software Engineer, Full-Stack Developer, Backend Engineer.

From here, career progression typically leads toward Staff Engineer, AI Architect, Engineering Manager.

If you're a software engineer, you're already 80% there. Learn the AI integration patterns: RAG, streaming inference, function calling, structured outputs. Build a project that demonstrates you can wrap an AI model in a production-quality application with proper error handling, caching, and user experience. That's the portfolio piece that gets you hired.

What to Expect in Interviews

Technical screens look like standard software engineering interviews with an AI twist. Expect system design questions about building reliable applications around probabilistic models: handling streaming responses, implementing retry logic for API failures, and designing caching strategies for LLM outputs. Coding rounds test standard algorithms plus practical integration patterns like async processing and rate limiting.

When evaluating opportunities: Strong postings describe the product you'll be building, the AI integration patterns you'll work with, and the scale requirements. Look for companies that have existing AI features and need engineers to improve and expand them, not companies that are 'planning to add AI' someday.

AI Hiring Overview

The AI job market has 10,419 open positions tracked in our dataset. By seniority: 117 entry-level, 4,975 mid-level, 3,840 senior, and 1,487 leadership roles (Director, VP, C-Level). Remote roles make up 6% of the market (580 positions). The remaining 9,776 roles require on-site or hybrid attendance.

The market median for AI roles is $214,834. Top-quartile compensation starts at $266,000. The 90th percentile reaches $321,730. Highest-paying categories: AI Safety ($274,500 median, 90 roles); Research Engineer ($252,000 median, 580 roles); AI Engineering Manager ($250,811 median, 72 roles).

AI Software Engineer roles are among the most numerous in the AI job market. Every company deploying AI needs software engineers who understand AI integration patterns. The demand is broad, spanning startups to enterprises, across every industry adopting AI capabilities.

The AI Job Market Today

The AI job market spans 10,419 open positions across 16 role categories. The largest categories by volume: AI/ML Engineer (7,849), AI Product Manager (516), AI Software Engineer (513). These three account for the majority of open positions, though smaller categories often have higher per-role compensation because of specialized skill requirements.

The seniority mix tells a story about where AI teams are in their maturity. Entry-level roles (117) are outnumbered by mid-level (4,975) and senior (3,840) positions, reflecting that most companies are past the 'build a team from scratch' phase and need experienced engineers who can ship production systems. Leadership roles (Director, VP, C-Level) total 1,487 positions, representing the bottleneck between technical execution and organizational strategy.

Remote work availability sits at 6% of all AI roles (580 positions), with 9,776 requiring on-site or hybrid attendance. The remote share has stabilized after the post-pandemic correction. Senior and specialized roles (Research Scientist, ML Architect) are more likely to be remote-eligible than entry-level positions, partly because experienced hires have more negotiating power and partly because these roles require less hands-on mentorship.

AI compensation is structured in clear tiers. The market median sits at $214,834. Top-quartile roles start at $266,000, and the 90th percentile reaches $321,730. These figures include base salary with disclosed compensation. Total compensation (including equity, bonuses, and sign-on) runs 20-40% higher at companies that offer those components.

Category matters for compensation. AI Safety roles lead at $274,500 median, while Prompt Engineer roles sit at $140,000. The spread between highest and lowest-paying categories reflects the premium on specialized technical skills versus broader analytical roles.

The most in-demand skills across all AI postings: Python (2,350 postings), Aws (1,173 postings), Azure (1,030 postings), Rag (986 postings), Gcp (714 postings), Pytorch (649 postings), Kubernetes (583 postings), Claude (581 postings). Python dominates, appearing in the vast majority of role descriptions regardless of category. Cloud platform experience (AWS, GCP, Azure) is the second most common requirement. The newer entrants to the top skills list (RAG, vector databases, LLM APIs) reflect the shift from traditional ML toward generative AI applications.

Frequently Asked Questions

Based on 1,983 roles with disclosed compensation, the median salary for AI Software Engineer positions is $224,000. Actual compensation varies by seniority, location, and company stage.
Full-stack engineering skills with AI integration experience. Python and TypeScript are the most common requirements. You'll need to understand API design, database architecture, and how to build reliable systems around probabilistic outputs. Experience with streaming, async processing, and caching patterns is increasingly important as real-time AI applications proliferate.
About 6% of the 10,419 AI roles we track offer remote work. Remote availability varies by company and seniority level, with senior and leadership roles more likely to offer location flexibility.
Spring Health is among the companies actively hiring for AI and ML talent. Check our company profiles for detailed breakdowns of open roles, salary ranges, and hiring trends.
Common next steps from AI Software Engineer positions include Staff Engineer, AI Architect, Engineering Manager. Progression depends on whether you lean toward technical depth, people management, or product strategy.

Get Weekly AI Career Intelligence

Salary data, skills demand, and market signals from 16,000+ AI job postings. Every Monday.