Agentic AI Analyst

$93K - $135K Remote Mid Level AI/ML Engineer

Interested in this AI/ML Engineer role at Invoca?

Apply Now →

Skills & Technologies

LangchainPythonRag

About This Role

AI job market dashboard showing open roles by category

About Invoca:

We built the category that made conversations measurable. Now we're building the AI agents orchestrating those engagements.

Invoca is the revenue infrastructure connecting marketing, commerce, and contact center teams — turning every buyer conversation into revenue, and attributing it all the way back to the media spend that drove it. Our multimodal AI agents operate at the moment of decision: engaging buyers across the journey with personalized interactions at scale for life's most considered purchases — without losing the empathy, explainability, and trust those decisions demand. Every engagement is transparent and attributable — brands see not just what converted, but why, and what marketing dollar earned it. Come work on the layer where AI agents and real revenue meet.

The Opportunity

As an Agentic AI Analyst at Invoca, you will play a pivotal role in shaping and refining the emerging category of agentic AI applications. Within our Product organization, you'll collaborate closely with a cross-functional team, including Product Managers, Engineers, Data Scientists, and Customer Success, to identify, evaluate, and operationalize agentic use cases that directly improve customer outcomes and advance Invoca's strategic AI vision.

A core focus of this role is the integration layer that makes agents useful in the real world: designing and validating the tools agents call (via MCP and similar protocols), authoring the skills that shape agent behavior, building the evaluation harnesses that measure whether agents actually work, and running simulations that stress-test agents before customers ever touch them.

This is an opportunity to grow your product skillset at the intersection of customer needs, agentic AI system design, and real-world AI performance. You will contribute to building new features, evaluating agent performance in production, and distilling insights from field engagements and system data to inform product priorities.

You should bring strong problem-solving ability, curiosity around emerging AI capabilities, and confidence working across stakeholders to translate ambiguity into clarity and execution.

What You'll Do

  • Design and Validate Agentic Integrations (MCP Tools): Define the tools our agents use to read and act on customer data. Author tool specifications (names, descriptions, input/output schemas, error behavior), prototype MCP servers and tool integrations, and validate that agents select and invoke tools correctly across realistic scenarios. Partner with Engineering on tool ergonomics that reduce hallucinated calls and improve task completion.
  • Author and Maintain Agent Skills: Design, write, and maintain reusable skills: structured instructions, workflows, and domain knowledge that govern how agents approach specific jobs. Test skill triggering accuracy, iterate on instructions based on eval results, and manage a versioned library of skills for reuse across products and customers.
  • Build and Run Agent Evals: Design evaluation frameworks for agentic behaviors, including golden datasets, task-level success criteria, grading rubrics, and LLM-as-judge pipelines. Run evals across model, prompt, tool, and skill changes to catch regressions, quantify improvements, and inform release decisions. Report results in a way that both Engineering and GTM can act on.
  • Simulate Agent Behavior Before Production: Build and operate simulation environments (synthetic callers, mock tool backends, adversarial and edge-case scenarios) to exercise multi-step agent workflows at scale. Use simulation results to uncover failure modes, calibrate human-in-the-loop handoff points, and establish confidence thresholds before beta and GA.
  • Design End-to-End Agent Behavior: Own how an agent reasons through a task from start to finish, including planning logic, state management across steps, escalation and human-in-the-loop decision points, and fallback behavior when tools or data are unavailable.
  • Validate Use Cases with Customers and GTM: Work with Sales Engineering, Customer Success, and customers to surface high-value problems, and mine call transcripts, usage data, and tool-call traces to identify where agents can deliver measurable outcomes. Translate those findings into scoped, experiment-ready proposals.
  • Monitor Agent Performance in Production: Track and interpret key metrics, such as task completion rates, tool-call success rates, fallback frequency, and customer feedback, to assess agent efficacy and prioritize improvements.
  • Optimize Retrieval and Model Behavior: Partner with Engineering and ML teams to tune the components behind agent quality, including retrieval and RAG strategies, context management, and model selection, using eval and production data to guide changes.
  • Triage Production Issues and Regressions: Own the process for capturing, reproducing, and documenting unintended agent behaviors reported from production. Work cross-functionally to root-cause issues, land fixes, and add coverage to evals and simulations so they don't recur.
  • Document Agent Designs and Best Practices: Own internal documentation for agent designs, tool specifications, skill libraries, eval methodology, and troubleshooting guides so that patterns can be reused and scaled across teams.
  • Enable Cross-Functional Teams and Customers: Support Product Marketing and Enablement by developing clear collateral and training on agentic AI features. Represent Product in customer meetings, agile ceremonies, and internal demos.
  • Design Multi-Agent and Long-Running Workflows: Architect how agents hand off tasks to other agents (via A2A or similar protocols) and how they maintain context and state across long-running or multi-session buyer interactions — not just single-turn exchanges.

What You Bring

  • 3+ years of experience in product, analytics, or technical customer-facing roles within SaaS or enterprise software.
  • Hands-on experience with agentic AI systems in production environments, including multi-step reasoning, tool use, conversational agents and human-in-the-loop agents.
  • Experience designing or integrating tools for AI agents, such as building or configuring MCP servers, defining function/tool schemas, or connecting agents to APIs and enterprise systems.
  • Experience with agent design and architecture, authoring prompts, skills, or agent instructions and iterating on them based on measured results.
  • Experience designing and running evals for Agentic systems, including building golden data sets, defining success criteria, and building scorers.
  • Experience with simulation or synthetic testing approaches for agents (e.g., synthetic users, mocked tools, scenario generation).
  • Experience with AI orchestration frameworks (e.g., LangChain, LangGraph).
  • Demonstrated ability to work independently on medium-scope initiatives and balance tradeoffs across requirements, user value, and implementation effort.
  • Skilled at breaking down ambiguous problems, gathering data, and proposing thoughtful, data-driven solutions.
  • Strong communicator who can lead and coordinate messaging across technical and non-technical stakeholders.
  • Highly collaborative and comfortable working across Engineering, GTM, and Design partners.
  • Familiarity with agent-to-agent (A2A) protocols or multi-agent orchestration patterns.
  • Experience designing for long-running or stateful agent sessions (context persistence, session resumption, drift over time).

Strong Plus

  • Working comfort with Python, JSON/JSON Schema, and reading API documentation, enough to prototype and inspect tool calls and traces.
  • Prior experience building or managing integrations between SaaS platforms (e.g., CRM, marketing automation, contact center, or data platforms) via APIs, webhooks, or iPaaS tools.
  • Experience in marketing or advertising technology, such as paid media, call tracking, attribution, marketing analytics, or ad platforms (Google Ads, Meta, etc.).

Compensation, Benefits & Perks:

At Invoca, we believe great work starts with taking care of our people. That's why we offer competitive compensation and benefits designed to support your health, your family, your growth, and your life outside of work. For teammates in the U.S., health benefits begin on your first day of employment.

Location: This is a remote-first role. We are currently hiring in the following locations with a preference for talent located in the SF Bay Area:

United States: Greater Los Angeles Area (including Santa Barbara and San Diego) · SF Bay Area · Denver Metro · Austin Metro · Chicago Metro · Greater NYC Area · Seattle Metro

Candidates must be based within ~2 hour drive of these areas. Occasional business travel may be required.

Compensation

  • Base Salary: $94,000–$134,000*
  • Variable Compensation: Bonus and/or commission eligibility, where applicable.
  • Equity: All employees are invited to share in Invoca's success through our stock option program.

*Actual compensation will depend on factors including experience, skills, and location.

Benefits & Perks

Health & Wellbeing

  • Day-One Health Benefits – Medical, dental, and vision coverage begins on your first day of employment for U.S.-based teammates.
  • Mental Wellbeing – Access to mental wellbeing support and an Employee Assistance Program (EAP).
  • Wellness Subsidy – Reimbursement that can be applied toward gym memberships, fitness classes, and more.

Time Away

  • Flexible Time Off – We encourage a healthy work-life balance. Our flexible paid time off policy gives you the flexibility to recharge and take time away when you need it.
  • Paid Holidays – Invoca provides 20 U.S. paid holidays, including a winter break, giving you time to rest, recharge, and spend time with friends and family.
  • Paid Family Leave – Up to 12 weeks of 100% paid leave for baby bonding, adoption, and caring for family members.*
  • Paid Medical Leave – Up to 12 weeks of 100% paid leave for childbirth and medical needs.*

Growth & Career

  • Enterprise-Grade AI Tools – Access to industry-leading enterprise AI tools, including leading LLMs and agentic AI workflow solutions to help you maximize productivity and work more effectively.
  • Professional Development – Annual reimbursement of up to $1,000 per fiscal year to support learning, certifications, conferences, and other professional development opportunities.

Financial Benefits

  • 401(k) – Invoca offers a 401(k) plan through Fidelity with a company match of up to 4%.*

Recognition & Community

  • Recognition Programs – We celebrate great work through company-wide and team recognition programs, including President's Club and quarterly and departmental awards recognizing innovation, execution, and customer impact.
  • InVacation (Sabbatical) – As a thank-you to our long-term team members, we offer a sabbatical after seven years of service.

*Some benefits may vary for teammates outside the U.S. based on local laws, regulations, and country-specific offerings.

Pay: $45.00 - $65.00 per hour

Expected hours: 40.0 per week

Benefits:

  • 401(k)
  • 401(k) matching
  • Dental insurance
  • Flexible spending account
  • Health insurance
  • Health savings account
  • Paid time off
  • Vision insurance

Work Location: Remote

Salary Context

This $93K-$135K range is in the lower quartile for AI/ML Engineer roles in our dataset (median: $180K across 1953 roles with salary data).

View full AI/ML Engineer salary data →

Role Details

Company Invoca
Title Agentic AI Analyst
Location Remote, US
Category AI/ML Engineer
Experience Mid Level
Salary $93K - $135K
Remote Yes

About This Role

AI/ML Engineers build and deploy machine learning models in production. They work across the full ML lifecycle: data pipelines, model training, evaluation, and serving infrastructure. The role has evolved significantly over the past two years. Where ML Engineers once spent most of their time on model architecture, the job now tilts heavily toward inference optimization, cost management, and integrating LLM capabilities into existing systems. Companies want engineers who can ship production systems, and the experimenter-only role is fading fast.

Day-to-day, you're writing training pipelines, debugging data quality issues, setting up evaluation frameworks, and figuring out why your model performs differently in staging than it did on your dev set. The best ML engineers are obsessive about reproducibility and measurement. They instrument everything. They know that a model is only as good as the data feeding it and the infrastructure serving it.

Across the 10,419 AI roles we're tracking, AI/ML Engineer positions make up 75% of the market. At Invoca, this role fits into their broader AI and engineering organization.

Demand for AI/ML Engineers has been strong and consistent. Unlike some AI roles that spike with hype cycles, ML engineering is a foundational need. Every company deploying AI models needs people who can keep them running, and the gap between research prototypes and production systems keeps growing.

What the Work Looks Like

A typical week might include: debugging a data pipeline that's silently dropping 3% of training examples, running A/B tests on a new model version, writing documentation for a feature flag system that lets you roll back model deployments, and reviewing a junior engineer's PR for a new evaluation metric. Meetings tend to be cross-functional since ML touches product, engineering, and data teams.

Demand for AI/ML Engineers has been strong and consistent. Unlike some AI roles that spike with hype cycles, ML engineering is a foundational need. Every company deploying AI models needs people who can keep them running, and the gap between research prototypes and production systems keeps growing.

Skills Required

Langchain (4% of roles) Python (23% of roles) Rag (9% of roles)

Python and PyTorch dominate the requirements. Most roles expect experience with cloud platforms (AWS, GCP, or Azure) and familiarity with ML frameworks like TensorFlow or JAX. RAG (Retrieval-Augmented Generation) has become a top-3 skill requirement as companies integrate LLMs into their products. Docker and Kubernetes show up in about a third of postings, reflecting the production focus of the role.

Beyond the core stack, employers increasingly want experience with experiment tracking tools (MLflow, Weights & Biases), feature stores, and vector databases. Fine-tuning experience is valuable but less common than you'd think from reading Twitter. Most production LLM work is RAG and prompt engineering, not fine-tuning. If you have both, you're in a strong position.

Companies that are serious about AI/ML hiring tend to post specific infrastructure details in the job description: the frameworks they use, their model serving stack, their data pipeline tools. Vague postings that just say 'ML experience required' without specifics are often companies that haven't figured out what they need yet.

Compensation Benchmarks

AI/ML Engineer roles pay a median of $213,800 based on 16,346 positions with disclosed compensation. Mid-level AI roles across all categories have a median of $193,200. This role's midpoint ($114K) sits 46% below the category median. Disclosed range: $93K to $135K.

Across all AI roles, the market median is $214,834. Top-quartile compensation starts at $266,000. The 90th percentile reaches $321,730. For comparison, the highest-paying categories include AI Safety ($274,500) and Research Engineer ($252,000). By seniority level: Entry: $114,400; Mid: $193,200; Senior: $230,000; Director: $272,100; VP: $235,000.

Invoca AI Hiring

Invoca has 1 open AI role right now. They're hiring across AI/ML Engineer. Based in Remote, US. Compensation range: $135K - $135K.

Remote Work Context

Remote AI roles pay a median of $188,000 across 2,811 positions. About 6% of all AI roles offer remote work.

Career Path

Common paths into AI/ML Engineer roles include Data Scientist, Software Engineer, Research Engineer.

From here, career progression typically leads toward ML Architect, AI Engineering Manager, Principal ML Engineer.

The fastest path into ML engineering is through software engineering with a self-directed ML education. A CS degree helps, but production engineering skills matter more than academic credentials. Build something that works, deploy it, and measure it. That portfolio project is worth more than a Coursera certificate. For career growth, the fork comes around the senior level: go deep on technical complexity (staff/principal track) or move into managing ML teams.

What to Expect in Interviews

Expect system design questions around ML pipelines: how you'd build a training pipeline for a specific use case, handle data drift, or design A/B testing infrastructure for model deployments. Coding rounds typically involve Python, with emphasis on data manipulation (pandas, numpy) and algorithm implementation. Take-home assignments often ask you to build an end-to-end ML pipeline from raw data to deployed model.

When evaluating opportunities: Companies that are serious about AI/ML hiring tend to post specific infrastructure details in the job description: the frameworks they use, their model serving stack, their data pipeline tools. Vague postings that just say 'ML experience required' without specifics are often companies that haven't figured out what they need yet.

AI Hiring Overview

The AI job market has 10,419 open positions tracked in our dataset. By seniority: 117 entry-level, 4,975 mid-level, 3,840 senior, and 1,487 leadership roles (Director, VP, C-Level). Remote roles make up 6% of the market (580 positions). The remaining 9,776 roles require on-site or hybrid attendance.

The market median for AI roles is $214,834. Top-quartile compensation starts at $266,000. The 90th percentile reaches $321,730. Highest-paying categories: AI Safety ($274,500 median, 90 roles); Research Engineer ($252,000 median, 580 roles); AI Engineering Manager ($250,811 median, 72 roles).

Demand for AI/ML Engineers has been strong and consistent. Unlike some AI roles that spike with hype cycles, ML engineering is a foundational need. Every company deploying AI models needs people who can keep them running, and the gap between research prototypes and production systems keeps growing.

The AI Job Market Today

The AI job market spans 10,419 open positions across 16 role categories. The largest categories by volume: AI/ML Engineer (7,849), AI Product Manager (516), AI Software Engineer (513). These three account for the majority of open positions, though smaller categories often have higher per-role compensation because of specialized skill requirements.

The seniority mix tells a story about where AI teams are in their maturity. Entry-level roles (117) are outnumbered by mid-level (4,975) and senior (3,840) positions, reflecting that most companies are past the 'build a team from scratch' phase and need experienced engineers who can ship production systems. Leadership roles (Director, VP, C-Level) total 1,487 positions, representing the bottleneck between technical execution and organizational strategy.

Remote work availability sits at 6% of all AI roles (580 positions), with 9,776 requiring on-site or hybrid attendance. The remote share has stabilized after the post-pandemic correction. Senior and specialized roles (Research Scientist, ML Architect) are more likely to be remote-eligible than entry-level positions, partly because experienced hires have more negotiating power and partly because these roles require less hands-on mentorship.

AI compensation is structured in clear tiers. The market median sits at $214,834. Top-quartile roles start at $266,000, and the 90th percentile reaches $321,730. These figures include base salary with disclosed compensation. Total compensation (including equity, bonuses, and sign-on) runs 20-40% higher at companies that offer those components.

Category matters for compensation. AI Safety roles lead at $274,500 median, while Prompt Engineer roles sit at $140,000. The spread between highest and lowest-paying categories reflects the premium on specialized technical skills versus broader analytical roles.

The most in-demand skills across all AI postings: Python (2,350 postings), Aws (1,173 postings), Azure (1,030 postings), Rag (986 postings), Gcp (714 postings), Pytorch (649 postings), Kubernetes (583 postings), Claude (581 postings). Python dominates, appearing in the vast majority of role descriptions regardless of category. Cloud platform experience (AWS, GCP, Azure) is the second most common requirement. The newer entrants to the top skills list (RAG, vector databases, LLM APIs) reflect the shift from traditional ML toward generative AI applications.

Frequently Asked Questions

Based on 16,346 roles with disclosed compensation, the median salary for AI/ML Engineer positions is $213,800. Actual compensation varies by seniority, location, and company stage.
Python and PyTorch dominate the requirements. Most roles expect experience with cloud platforms (AWS, GCP, or Azure) and familiarity with ML frameworks like TensorFlow or JAX. RAG (Retrieval-Augmented Generation) has become a top-3 skill requirement as companies integrate LLMs into their products. Docker and Kubernetes show up in about a third of postings, reflecting the production focus of the role.
About 6% of the 10,419 AI roles we track offer remote work. Remote availability varies by company and seniority level, with senior and leadership roles more likely to offer location flexibility.
Invoca is among the companies actively hiring for AI and ML talent. Check our company profiles for detailed breakdowns of open roles, salary ranges, and hiring trends.
Common next steps from AI/ML Engineer positions include ML Architect, AI Engineering Manager, Principal ML Engineer. Progression depends on whether you lean toward technical depth, people management, or product strategy.

Get Weekly AI Career Intelligence

Salary data, skills demand, and market signals from 16,000+ AI job postings. Every Monday.