Software Engineer - ML Ops (R37)

Mid Level MLOps Engineer

Interested in this MLOps Engineer role at R1 RCM?

Apply Now →

Skills & Technologies

DockerKubernetes

About This Role

AI job market dashboard showing open roles by category

At R1, we’re transforming how healthcare works by combining nearly two decades of revenue cycle expertise with advanced technology, including analytics, AI, intelligent automation and workflow orchestration. We pair that technology with the irreplaceable expertise of our people to help hospitals, health systems and medical groups improve financial performance, simplify administrative complexity and create better experiences for patients and providers.

All Together Better defines our culture and the way we work. We’re a diverse, global team united by a shared mission to make healthcare work better for all. Across technology, operations and support functions, our people bring deep expertise, empathy and ingenuity to the work we do. Here, collaboration fuels progress, adaptability sparks innovation and every voice can help shape what’s next for R1 and the future of healthcare.

About R37 R37 is R1’s AI innovation lab, building technology to transform healthcare.

Our flagship platform, Phare OS, uses AI and automation to improve critical pre-bill workflows, including authorization, utilization management, documentation and coding. By identifying and resolving issues before claims are submitted, Phare OS helps prevent denials, improve reimbursement and move revenue cycle work upstream.

What Makes R37 Different Is The Opportunity To Build Advanced AI At Real-world Scale. R1 Works Across 95 Of The Top 100 U.S. Health Systems, Giving R37 Access To The Data, Workflows And Reach Needed To Make An Immediate Impact

  • 180M+ claims
  • 550M+ patient encounters
  • 1.2B+ workflow actions and outcomes annually

This is startup-level ownership with enterprise-level impact. You’ll build technology that moves from idea to real healthcare environments, solving complex problems at scale and changing how healthcare works.

As a Software Engineer for the ML Ops team, you will help own the production runtime for Phare’s ML stack - deploying, serving, and scaling models across inference endpoints and batch/streaming workflows.

Every day you will build progressive delivery pipelines with automated rollouts and rollbacks, manage SLOs for latency and availability, and instrument end-to-end observability (metrics, logs, traces, drift, regression). You’ll harden the platform with Terraform, Kubernetes, and CI/CD, ensuring reproducible, auditable ML releases.

To thrive in this role, you must have a background in operating ML systems at scale, where uptime and feedback loops matter as much as accuracy.

We prefer this role to be Hybrid (3 days onsite) at our SOHO Office Hub in New York City. Required Skills:

  • Production ML: You’ve deployed and operated models running on GPUs in production - APIs and batch/streaming inference
  • Platform engineering: Strong with Docker/Kubernetes, IaaC (e.g., Terraform), and CI/CD for services and model artifacts; you maintain environment parity, reproducible releases, and robust model/experiment versioning with data lineage
  • System Reliability: You use progressive delivery with automated rollouts/rollbacks, and you build end-to-end observability (metrics, logs, traces, and model telemetry for drift/regression) plus actionable alerting, runbooks, and incident response
  • Post-training lifecycles: You manage model registries and stage gates, design scheduled or event-driven retraining when appropriate, and enforce RBAC, secrets management, encryption, and audit logs

Bonus if you have: Experience in regulated environments (e.g., Healthcare, Finance)

Role Leveling We are looking for candidates at various levels, ranging from Level 2 to Staff

  • L2: Independently delivers a complete end-to-end project, owning design, implementation, and delivery of scoped work (Compensation Range for L2: $140k - $200k)
  • L3: Leads delivery of larger projects, handling increased technical complexity and ambiguity, providing light guidance to L2s on shared work (Compensation Range for L3: $140k - $253k)
  • Senior: Team Lead responsible for managing a portfolio of projects that contribute to major technical initiatives. (Compensation Range for Senior: $140k - $294k)
  • Staff: Impact at the organizational level. Responsible for leading multiple teams or multiple broad initiatives simultaneously, ensuring that high-level technical goals are met across the entire organization. (Compensation Range for Staff: $140k - $350k)

Benefits

  • Top-of-market compensation, including bonus that starts at 10%
  • Flexible PTO
  • Comprehensive health benefits
  • 401(k) matching
  • Inspiring, brilliant, mission-driven teammates

For this US-based position, the base pay range is $140,000.00 - $270,000.00 per year . Individual pay is determined by role, level, location, job-related skills, experience, and relevant education or training.

This job is eligible to participate in our annual bonus plan at a target of 10.00%

The healthcare system is always evolving — and it’s up to us to use our shared expertise to find new solutions that can keep up. On our growing team you’ll find the opportunity to constantly learn, collaborate across groups and explore new paths for your career.

Our associates are given the chance to contribute, think boldly and create meaningful work that makes a difference in the communities we serve around the world. We go beyond expectations in everything we do. Not only does that drive customer success and improve patient care, but that same enthusiasm is applied to giving back to the community and taking care of our team — including offering a competitive benefits package.

R1 RCM Inc. (“the Company”) is dedicated to the fundamentals of equal employment opportunity. The Company’s employment practices , including those regarding recruitment, hiring, assignment, promotion, compensation, benefits, training, discipline, and termination shall not be based on any person’s age, color, national origin, citizenship status, physical or mental disability, medical condition, race, religion, creed, gender, sex, sexual orientation, gender identity and/or expression, genetic information, marital status, status with regard to public assistance, veteran status or any other characteristic protected by federal, state or local law. Furthermore, the Company is dedicated to providing a workplace free from harassment based on any of the foregoing protected categories.

If you have a disability and require a reasonable accommodation to complete any part of the job application process, please contact us at 312-496-7709 for assistance.

CA PRIVACY NOTICE: California resident job applicants can learn more about their privacy rights California Consent

To learn more, visit: R1RCM.com

Visit us on Facebook

Role Details

Company R1 RCM
Title Software Engineer - ML Ops (R37)
Location Not specified
Category MLOps Engineer
Experience Mid Level
Salary Not disclosed
Remote No

About This Role

MLOps Engineers build the infrastructure that keeps ML models running in production. They own CI/CD pipelines for model deployment, monitoring for data drift and model degradation, and the tooling that lets data scientists ship faster. If ML Engineers build the models, MLOps Engineers build the roads those models travel on.

The job is fundamentally about reliability and velocity. Data scientists want to iterate fast. Product teams want stable predictions. Your job is to make both happen simultaneously. That means building deployment pipelines that catch regressions before they hit production, monitoring systems that alert on data drift before it degrades model performance, and self-service tooling that lets data scientists deploy without filing a ticket.

Across the 10,419 AI roles we're tracking, MLOps Engineer positions make up 2% of the market. At R1 RCM, this role fits into their broader AI and engineering organization.

MLOps demand tracks closely with production ML adoption. As more companies move models from notebooks to production, the need for MLOps grows. The role is well-established at large tech companies and growing fast at mid-stage startups that are hitting the 'our models work in notebooks but break in production' phase.

What the Work Looks Like

A typical week involves: debugging a model deployment that's serving stale predictions, building a new monitoring dashboard for a feature team, writing Terraform for GPU-enabled inference clusters, reviewing pull requests for the ML platform's CI/CD pipeline, and meeting with data scientists to understand their pain points. You're the bridge between ML and infrastructure.

MLOps demand tracks closely with production ML adoption. As more companies move models from notebooks to production, the need for MLOps grows. The role is well-established at large tech companies and growing fast at mid-stage startups that are hitting the 'our models work in notebooks but break in production' phase.

Skills Required

Docker (4% of roles) Kubernetes (6% of roles)

Kubernetes, Docker, and cloud infrastructure are baseline. Most roles want experience with ML-specific tooling: MLflow, Kubeflow, Weights & Biases, or similar. Strong DevOps fundamentals matter more than ML theory. You need to understand model serving (TorchServe, Triton, vLLM), monitoring (Prometheus, Grafana), and infrastructure-as-code (Terraform, Pulumi).

GPU infrastructure knowledge is increasingly valuable as LLM inference becomes a major cost center. Understanding GPU scheduling, multi-node training setups, and inference optimization (quantization, batching, caching) puts you in the top tier. Experience with model registries and feature stores rounds out the profile.

Good MLOps postings specify their ML stack, infrastructure scale, and the problems they're solving (deployment velocity, cost optimization, monitoring gaps). Red flag: companies that want MLOps but don't have any models in production yet. You'll end up doing general DevOps instead.

Compensation Benchmarks

MLOps Engineer roles pay a median of $206,600 based on 205 positions with disclosed compensation. Mid-level AI roles across all categories have a median of $193,200.

Across all AI roles, the market median is $214,834. Top-quartile compensation starts at $266,000. The 90th percentile reaches $321,730. For comparison, the highest-paying categories include AI Safety ($274,500) and Research Engineer ($252,000). By seniority level: Entry: $114,400; Mid: $193,200; Senior: $230,000; Director: $272,100; VP: $235,000.

R1 RCM AI Hiring

R1 RCM has 3 open AI roles right now. They're hiring across MLOps Engineer, AI/ML Engineer.

Location Context

Across all AI roles, 6% (580 positions) offer remote work, while 9,776 require on-site attendance. Top AI hiring metros: New York (3,785 roles, $222,480 median); San Francisco (3,262 roles, $261,300 median); Los Angeles (1,896 roles, $210,000 median).

Career Path

Common paths into MLOps Engineer roles include DevOps Engineer, Platform Engineer, Data Engineer.

From here, career progression typically leads toward ML Platform Lead, Infrastructure Architect, Engineering Manager.

DevOps engineers with ML curiosity have the shortest path. You already understand deployment, monitoring, and infrastructure. Add ML-specific knowledge (model serving, data pipelines, experiment tracking) and you're competitive. The career ceiling is high: ML Platform Lead roles at top companies pay well because the infrastructure complexity is enormous.

What to Expect in Interviews

Interviews emphasize infrastructure and reliability. Expect questions about CI/CD for ML models, monitoring for data drift, and how you'd design a model serving platform that handles 10K requests per second. Coding rounds focus on Python and infrastructure-as-code (Terraform, Helm). Be ready to discuss tradeoffs between different model serving frameworks and how you'd handle rollback when a new model degrades performance.

When evaluating opportunities: Good MLOps postings specify their ML stack, infrastructure scale, and the problems they're solving (deployment velocity, cost optimization, monitoring gaps). Red flag: companies that want MLOps but don't have any models in production yet. You'll end up doing general DevOps instead.

AI Hiring Overview

The AI job market has 10,419 open positions tracked in our dataset. By seniority: 117 entry-level, 4,975 mid-level, 3,840 senior, and 1,487 leadership roles (Director, VP, C-Level). Remote roles make up 6% of the market (580 positions). The remaining 9,776 roles require on-site or hybrid attendance.

The market median for AI roles is $214,834. Top-quartile compensation starts at $266,000. The 90th percentile reaches $321,730. Highest-paying categories: AI Safety ($274,500 median, 90 roles); Research Engineer ($252,000 median, 580 roles); AI Engineering Manager ($250,811 median, 72 roles).

MLOps demand tracks closely with production ML adoption. As more companies move models from notebooks to production, the need for MLOps grows. The role is well-established at large tech companies and growing fast at mid-stage startups that are hitting the 'our models work in notebooks but break in production' phase.

The AI Job Market Today

The AI job market spans 10,419 open positions across 16 role categories. The largest categories by volume: AI/ML Engineer (7,849), AI Product Manager (516), AI Software Engineer (513). These three account for the majority of open positions, though smaller categories often have higher per-role compensation because of specialized skill requirements.

The seniority mix tells a story about where AI teams are in their maturity. Entry-level roles (117) are outnumbered by mid-level (4,975) and senior (3,840) positions, reflecting that most companies are past the 'build a team from scratch' phase and need experienced engineers who can ship production systems. Leadership roles (Director, VP, C-Level) total 1,487 positions, representing the bottleneck between technical execution and organizational strategy.

Remote work availability sits at 6% of all AI roles (580 positions), with 9,776 requiring on-site or hybrid attendance. The remote share has stabilized after the post-pandemic correction. Senior and specialized roles (Research Scientist, ML Architect) are more likely to be remote-eligible than entry-level positions, partly because experienced hires have more negotiating power and partly because these roles require less hands-on mentorship.

AI compensation is structured in clear tiers. The market median sits at $214,834. Top-quartile roles start at $266,000, and the 90th percentile reaches $321,730. These figures include base salary with disclosed compensation. Total compensation (including equity, bonuses, and sign-on) runs 20-40% higher at companies that offer those components.

Category matters for compensation. AI Safety roles lead at $274,500 median, while Prompt Engineer roles sit at $140,000. The spread between highest and lowest-paying categories reflects the premium on specialized technical skills versus broader analytical roles.

The most in-demand skills across all AI postings: Python (2,350 postings), Aws (1,173 postings), Azure (1,030 postings), Rag (986 postings), Gcp (714 postings), Pytorch (649 postings), Kubernetes (583 postings), Claude (581 postings). Python dominates, appearing in the vast majority of role descriptions regardless of category. Cloud platform experience (AWS, GCP, Azure) is the second most common requirement. The newer entrants to the top skills list (RAG, vector databases, LLM APIs) reflect the shift from traditional ML toward generative AI applications.

Frequently Asked Questions

Based on 205 roles with disclosed compensation, the median salary for MLOps Engineer positions is $206,600. Actual compensation varies by seniority, location, and company stage.
Kubernetes, Docker, and cloud infrastructure are baseline. Most roles want experience with ML-specific tooling: MLflow, Kubeflow, Weights & Biases, or similar. Strong DevOps fundamentals matter more than ML theory. You need to understand model serving (TorchServe, Triton, vLLM), monitoring (Prometheus, Grafana), and infrastructure-as-code (Terraform, Pulumi).
About 6% of the 10,419 AI roles we track offer remote work. Remote availability varies by company and seniority level, with senior and leadership roles more likely to offer location flexibility.
R1 RCM is among the companies actively hiring for AI and ML talent. Check our company profiles for detailed breakdowns of open roles, salary ranges, and hiring trends.
Common next steps from MLOps Engineer positions include ML Platform Lead, Infrastructure Architect, Engineering Manager. Progression depends on whether you lean toward technical depth, people management, or product strategy.

Get Weekly AI Career Intelligence

Salary data, skills demand, and market signals from 16,000+ AI job postings. Every Monday.