Interested in this AI/ML Engineer role at ServiceNow?
Apply Now →Skills & Technologies
About This Role
Company Description
It all started when engineer Fred Luddy wrote code that automated a tedious task for his coworker, Phyllis. She cried tears of joy. That moment inspired Fred to build a company that could do that for everyone—freeing people from busywork so they could focus on meaningful work. Today, ServiceNow is the AI control tower for business reinvention. Our ServiceNow AI platform brings together any AI, any data, and any workflow— helping 85% of the Fortune 500® work smarter, faster, and better. We're building an AI-native culture where technology and talent are unstoppable together. And we're just getting started.
Join us to put AI to work for people.
Job Description
Senior Staff Software Engineer, Agentic Search Infrastructure About the Role
Join us as we build the next generation of enterprise search infrastructure powering AI agents. Our mission is to evolve from traditional product-specific search systems into a composable, agent-native platform that enables agents and applications to discover, retrieve, reason over, and recommend information across heterogeneous enterprise data sources.
As a Senior Staff Engineer, you will be the technical owner for foundational search infrastructure that serves as the backbone of our agentic platform. You will drive the architecture, scalability, and evolution of core indexing and retrieval systems while partnering closely with Search Ranking, ML, Platform, and AI teams to deliver production-grade search capabilities that power agent experiences across the company.
What You'll Do Own Core Search Infrastructure
- Lead the design, development, and operation of critical search infrastructure components, including indexing systems, ingestion pipelines, metadata enrichment frameworks, and retrieval foundations that support a growing ecosystem of AI agents.
- Drive technical strategy and architectural decisions across multiple search infrastructure domains, ensuring the platform scales to support future agent use cases and expanding enterprise datasets.
- Serve as the technical authority for the end-to-end search lifecycle, from content ingestion through retrieval and ranking.
Build Next-Generation Indexing Systems
- Design and operate large-scale hybrid indexing architectures that combine sparse retrieval, dense vector search, semantic retrieval, and emerging indexing approaches.
- Establish clean abstractions and interfaces that allow downstream ranking systems and AI agents to leverage search capabilities consistently across multiple retrieval paradigms.
- Drive innovations that improve search quality, latency, scalability, and cost efficiency across billions of indexed entities.
Lead Enterprise Data Intelligence
- Architect high-throughput ingestion and enrichment pipelines that transform enterprise content into rich, permission-aware representations optimized for agent consumption.
- Define strategies for content parsing, chunking, embedding generation, entity extraction, metadata enrichment, and access control enforcement.
- Ensure consistency between index-time representations and query-time retrieval mechanisms to provide reliable foundations for agent reasoning.
Advance Multi-Modal Search
- Lead the evolution of indexing and retrieval systems across diverse enterprise content types, including text, structured data, images, diagrams, audio, and video.
- Develop unified frameworks that enable agents to discover and reason across modalities through a consistent retrieval experience.
- Partner with ML and AI teams to bring emerging multi-modal capabilities into production.
Drive Knowledge and Entity Infrastructure
- Contribute to the design and evolution of enterprise knowledge graph capabilities that connect people, content, tickets, documents, conversations, and business entities.
- Lead initiatives that improve entity resolution, relationship modeling, and contextual understanding throughout the search platform.
- Enable richer retrieval and agent reasoning through high-quality enterprise knowledge representations.
Scale Reliability and Performance
- Own key platform metrics including search latency, indexing throughput, retrieval quality, infrastructure efficiency, and cluster health.
- Drive operational excellence through observability, capacity planning, resiliency engineering, and lifecycle management.
- Lead efforts to optimize infrastructure costs while maintaining high-performance retrieval experiences at scale.
Technical Leadership
- Provide technical leadership and mentorship for engineers across the organization.
- Influence roadmap and architectural direction through technical vision, design reviews, and cross-functional collaboration.
- Drive alignment across Search Infrastructure, Ranking, ML, and Platform teams to deliver cohesive solutions to complex engineering challenges.
- Lead multi-quarter initiatives that span teams and materially advance the capabilities of the agentic search platform.
Qualifications
Qualifications Required
- BS or MS in Computer Science or a related technical field; PhD is a plus.
- 8-12+ years of industry experience building large-scale distributed systems, search platforms, or data infrastructure.
- Deep hands-on experience with search technologies such as Lucene, Elasticsearch, OpenSearch, Solr, or comparable retrieval systems.
- Strong experience designing and operating distributed systems at scale, including storage, indexing, serving, and data processing infrastructure.
- Experience building and scaling production systems that leverage vector search, embeddings, retrieval systems, or AI-driven search capabilities.
- Proven track record of leading complex technical initiatives across teams and influencing architectural decisions beyond an individual team's scope.
- Demonstrated ability to balance technical depth with pragmatic delivery and operational excellence.
For positions in this location, we offer a base pay of $190,900 - $334,100, plus equity (when applicable), variable/incentive compensation and benefits. Sales positions generally offer a competitive On Target Earnings (OTE) incentive compensation structure. Please note that the base pay shown is a guideline, and individual total compensation will vary based on factors such as qualifications, skill level, competencies and work location. We also offer health plans, including flexible spending accounts, a 401(k) Plan with company match, ESPP, matching donations, a flexible time away plan and family leave programs.
Compensation is based on the geographic location in which the role is located and is subject to change based on work location.
Preferred
- Experience with information retrieval, ranking systems, recommendation systems, or AI-powered search platforms.
- Experience with knowledge graphs, entity resolution systems, or enterprise data modeling.
- Familiarity with modern retrieval approaches including dense retrieval, RAG architectures, hybrid search, and semantic indexing.
- Experience operating large-scale search clusters and performance-sensitive distributed infrastructure.
- Background working closely with ML or AI platform teams to productionize intelligent retrieval systems.
Culture
- Passion for collaborating in a highly engaged, in-person engineering culture.
- Strong communication skills and a track record of influencing across organizational boundaries.
- Excitement for solving foundational infrastructure problems that unlock the next generation of AI agent experiences.
For positions in this location, we offer a base pay of $190,900 - $334,100, plus equity (when applicable), variable/incentive compensation and benefits. Sales positions generally offer a competitive On Target Earnings (OTE) incentive compensation structure. Please note that the base pay shown is a guideline, and individual total compensation will vary based on factors such as qualifications, skill level, competencies and work location. We also offer health plans, including flexible spending accounts, a 401(k) Plan with company match, ESPP, matching donations, a flexible time away plan and family leave programs.
Compensation is based on the geographic location in which the role is located and is subject to change based on work location.
Additional Information Work Personas
We approach our distributed world of work with flexibility and trust. Work personas (flexible, remote, or required in office) are categories that are assigned to ServiceNow employees depending on the nature of their work and their assigned work location. Learn more here. To determine eligibility for a work persona, ServiceNow may confirm the distance between your primary residence and the closest ServiceNow office using a third-party service.
Equal Opportunity Employer
ServiceNow is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, national origin, age, disability, gender identity, veteran status, or any other category protected by law. In addition, all qualified applicants with arrest or conviction records will be considered for employment in accordance with legal requirements.
Accommodations
We strive to create an accessible and inclusive experience for all candidates. If you require a reasonable accommodation to complete any part of the application process, or are unable to use this online application and need an alternative method to apply, please contact [email protected] for assistance.
Export Control Regulations
For positions requiring access to controlled technology subject to export control regulations, including the U.S. Export Administration Regulations (EAR), ServiceNow may be required to obtain export control approval from government authorities for certain individuals. All employment is contingent upon ServiceNow obtaining any export license or other approval that may be required by relevant export control authorities.
From Fortune. ©2026 Fortune Media IP Limited. All rights reserved. Used under license.
Salary Context
This $190K-$334K range is above the 75th percentile for AI/ML Engineer roles in our dataset (median: $176K across 1540 roles with salary data).
View full AI/ML Engineer salary data →Role Details
About This Role
AI/ML Engineers build and deploy machine learning models in production. They work across the full ML lifecycle: data pipelines, model training, evaluation, and serving infrastructure. The role has evolved significantly over the past two years. Where ML Engineers once spent most of their time on model architecture, the job now tilts heavily toward inference optimization, cost management, and integrating LLM capabilities into existing systems. Companies want engineers who can ship production systems, and the experimenter-only role is fading fast.
Day-to-day, you're writing training pipelines, debugging data quality issues, setting up evaluation frameworks, and figuring out why your model performs differently in staging than it did on your dev set. The best ML engineers are obsessive about reproducibility and measurement. They instrument everything. They know that a model is only as good as the data feeding it and the infrastructure serving it.
Across the 9,653 AI roles we're tracking, AI/ML Engineer positions make up 76% of the market. At ServiceNow, this role fits into their broader AI and engineering organization.
Demand for AI/ML Engineers has been strong and consistent. Unlike some AI roles that spike with hype cycles, ML engineering is a foundational need. Every company deploying AI models needs people who can keep them running, and the gap between research prototypes and production systems keeps growing.
What the Work Looks Like
A typical week might include: debugging a data pipeline that's silently dropping 3% of training examples, running A/B tests on a new model version, writing documentation for a feature flag system that lets you roll back model deployments, and reviewing a junior engineer's PR for a new evaluation metric. Meetings tend to be cross-functional since ML touches product, engineering, and data teams.
Demand for AI/ML Engineers has been strong and consistent. Unlike some AI roles that spike with hype cycles, ML engineering is a foundational need. Every company deploying AI models needs people who can keep them running, and the gap between research prototypes and production systems keeps growing.
Skills Required
Python and PyTorch dominate the requirements. Most roles expect experience with cloud platforms (AWS, GCP, or Azure) and familiarity with ML frameworks like TensorFlow or JAX. RAG (Retrieval-Augmented Generation) has become a top-3 skill requirement as companies integrate LLMs into their products. Docker and Kubernetes show up in about a third of postings, reflecting the production focus of the role.
Beyond the core stack, employers increasingly want experience with experiment tracking tools (MLflow, Weights & Biases), feature stores, and vector databases. Fine-tuning experience is valuable but less common than you'd think from reading Twitter. Most production LLM work is RAG and prompt engineering, not fine-tuning. If you have both, you're in a strong position.
Companies that are serious about AI/ML hiring tend to post specific infrastructure details in the job description: the frameworks they use, their model serving stack, their data pipeline tools. Vague postings that just say 'ML experience required' without specifics are often companies that haven't figured out what they need yet.
Compensation Benchmarks
AI/ML Engineer roles pay a median of $212,000 based on 11,857 positions with disclosed compensation. Senior-level AI roles across all categories have a median of $228,700. This role's midpoint ($262K) sits 24% above the category median. Disclosed range: $190K to $334K.
Across all AI roles, the market median is $213,400. Top-quartile compensation starts at $264,230. The 90th percentile reaches $319,400. For comparison, the highest-paying categories include AI Safety ($253,100) and Research Engineer ($252,000). By seniority level: Entry: $110,408; Mid: $193,200; Senior: $228,700; Director: $272,275; VP: $235,000.
ServiceNow AI Hiring
ServiceNow has 28 open AI roles right now. They're hiring across AI/ML Engineer, AI Agent Developer, AI Product Manager, AI Software Engineer. Positions span Santa Clara, CA, US, Mountain View, CA, US, Petah Tikva, Center District, Israel. Compensation range: $158K - $387K.
Location Context
Across all AI roles, 6% (568 positions) offer remote work, while 9,010 require on-site attendance. Top AI hiring metros: New York (2,878 roles, $221,000 median); San Francisco (2,413 roles, $264,500 median); Los Angeles (1,340 roles, $210,000 median).
Career Path
Common paths into AI/ML Engineer roles include Data Scientist, Software Engineer, Research Engineer.
From here, career progression typically leads toward ML Architect, AI Engineering Manager, Principal ML Engineer.
The fastest path into ML engineering is through software engineering with a self-directed ML education. A CS degree helps, but production engineering skills matter more than academic credentials. Build something that works, deploy it, and measure it. That portfolio project is worth more than a Coursera certificate. For career growth, the fork comes around the senior level: go deep on technical complexity (staff/principal track) or move into managing ML teams.
What to Expect in Interviews
Expect system design questions around ML pipelines: how you'd build a training pipeline for a specific use case, handle data drift, or design A/B testing infrastructure for model deployments. Coding rounds typically involve Python, with emphasis on data manipulation (pandas, numpy) and algorithm implementation. Take-home assignments often ask you to build an end-to-end ML pipeline from raw data to deployed model.
When evaluating opportunities: Companies that are serious about AI/ML hiring tend to post specific infrastructure details in the job description: the frameworks they use, their model serving stack, their data pipeline tools. Vague postings that just say 'ML experience required' without specifics are often companies that haven't figured out what they need yet.
AI Hiring Overview
The AI job market has 9,653 open positions tracked in our dataset. By seniority: 193 entry-level, 4,500 mid-level, 3,455 senior, and 1,505 leadership roles (Director, VP, C-Level). Remote roles make up 6% of the market (568 positions). The remaining 9,010 roles require on-site or hybrid attendance.
The market median for AI roles is $213,400. Top-quartile compensation starts at $264,230. The 90th percentile reaches $319,400. Highest-paying categories: AI Safety ($253,100 median, 57 roles); Research Engineer ($252,000 median, 419 roles); AI Engineering Manager ($251,622 median, 51 roles).
Demand for AI/ML Engineers has been strong and consistent. Unlike some AI roles that spike with hype cycles, ML engineering is a foundational need. Every company deploying AI models needs people who can keep them running, and the gap between research prototypes and production systems keeps growing.
The AI Job Market Today
The AI job market spans 9,653 open positions across 16 role categories. The largest categories by volume: AI/ML Engineer (7,301), Data Scientist (441), AI Software Engineer (438). These three account for the majority of open positions, though smaller categories often have higher per-role compensation because of specialized skill requirements.
The seniority mix tells a story about where AI teams are in their maturity. Entry-level roles (193) are outnumbered by mid-level (4,500) and senior (3,455) positions, reflecting that most companies are past the 'build a team from scratch' phase and need experienced engineers who can ship production systems. Leadership roles (Director, VP, C-Level) total 1,505 positions, representing the bottleneck between technical execution and organizational strategy.
Remote work availability sits at 6% of all AI roles (568 positions), with 9,010 requiring on-site or hybrid attendance. The remote share has stabilized after the post-pandemic correction. Senior and specialized roles (Research Scientist, ML Architect) are more likely to be remote-eligible than entry-level positions, partly because experienced hires have more negotiating power and partly because these roles require less hands-on mentorship.
AI compensation is structured in clear tiers. The market median sits at $213,400. Top-quartile roles start at $264,230, and the 90th percentile reaches $319,400. These figures include base salary with disclosed compensation. Total compensation (including equity, bonuses, and sign-on) runs 20-40% higher at companies that offer those components.
Category matters for compensation. AI Safety roles lead at $253,100 median, while Prompt Engineer roles sit at $141,440. The spread between highest and lowest-paying categories reflects the premium on specialized technical skills versus broader analytical roles.
The most in-demand skills across all AI postings: Python (1,605 postings), Aws (916 postings), Azure (724 postings), Rag (634 postings), Gcp (522 postings), Pytorch (495 postings), Kubernetes (384 postings), Claude (383 postings). Python dominates, appearing in the vast majority of role descriptions regardless of category. Cloud platform experience (AWS, GCP, Azure) is the second most common requirement. The newer entrants to the top skills list (RAG, vector databases, LLM APIs) reflect the shift from traditional ML toward generative AI applications.
Frequently Asked Questions
Get Weekly AI Career Intelligence
Salary data, skills demand, and market signals from 16,000+ AI job postings. Every Monday.