Senior Software Engineer, AI Agent Platform

$105K - $230K New York, NY, US Senior AI Agent Developer

Interested in this AI Agent Developer role at GEICO?

Apply Now →

Skills & Technologies

AwsAzureBedrockClaudeGeminiKubernetesLlamaOpenaiPythonRag

About This Role

AI job market dashboard showing open roles by category

Why Join GEICO?

At GEICO, we offer a rewarding career where your ambitions are met with endless possibilities.

Every day we honor our iconic brand by offering quality coverage to millions of customers and being there when they need us most. We thrive on relentless innovation to exceed our customers' expectations while making a real impact on local communities nationwide.

Founded in 1936, GEICO is a member of the Berkshire Hathaway family of companies and one of the largest auto insurers in the United States. When you join our company, we want you to feel valued, supported, and proud to work here. That's why we offer the GEICO Pledge: Great Company, Great Culture, Great Rewards, and Great Careers.

Senior Software Engineer, AI Agent Platform

GEICO

Why Join GEICO?

GEICO is transforming how AI is built and deployed across the enterprise. As one of the largest insurers in the United States, we are investing heavily in next-generation AI platforms that empower more than 30,000 associates and enhance experiences for millions of customers.

We are looking for a Senior Software Engineer with strong backend engineering experience to help build GEICO's enterprise AI Agent Platform. The team is building several core systems: an agent harness that runs agentic workflows durably in production, a retrieval-augmented generation (RAG) platform that grounds agents in enterprise knowledge, an insight engine that turns agent execution data and signals from related systems into live domain knowledge and context for both people and agents, an eval harness that measures agent quality and catches regressions, and a skills marketplace where teams publish and reuse agent capabilities. Each of them is a distributed systems problem at its core. We care about your experience building durable, scalable systems as well as your experience in AI/ML.

The Opportunity

As a Senior Software Engineer on the AI Agent Platform team, you will design, build, and own significant components of the core systems that power use-case-agnostic agentic workflows across the enterprise, from claims and underwriting to internal associate tools. You'll work closely with Sr. Staff and Staff engineers who set technical direction. This is platform work: generalized services and capabilities that many teams build on, not a single agent application.

We welcome candidates from application, platform, or infrastructure backgrounds. What matters is that you have designed and built systems that stay correct, available, and operable under real production load, that you've helped run them (on call, incidents, and all), and that you're comfortable working across the full backend stack. Hands-on experience building GenAI applications or agentic harnesses is a strong plus, and the foundation is solid engineering judgment.

What You Will Do

Own and Collaborate

  • Own the design and delivery of significant platform components and features end to end, from technical design and API definition through implementation, rollout, and iteration.
  • Write clear design docs, contribute actively to design and code reviews, and make sound tradeoffs within your area of ownership.
  • Mentor junior and mid-level engineers, and help raise the engineering bar on the team.
  • Collaborate with product managers, data scientists, and consuming teams to understand workflow needs and translate them into platform features.

Build

Depending on your strengths, you'll build and own work in areas such as:

  • Agent harness: the durable execution engine for agent workflows, with state management, checkpointing, retries, idempotency, and recovery for long-running, multi-step, tool-calling workflows.
  • Agent harness integrations: services, APIs, and integration contracts (including protocols like MCP) that let many teams connect agents to internal services, data sources, and external systems consistently.
  • RAG platform: shared ingestion, chunking, embedding, indexing, and retrieval services that ground agents in enterprise documents and data, with access controls, freshness guarantees, and low-latency retrieval at scale.
  • Insight engine: pipelines and services that collect data from agent executions and related enterprise systems and turn it into continuously updated domain knowledge and agent context, served to people through dashboards and reports and to agents through retrieval and tool interfaces. Where the RAG platform grounds agents in relatively static documents, the insight engine captures what is changing: emerging patterns, outcomes, and operational signals.
  • Eval harness: high-throughput pipelines for running offline and online evaluations, simulating scenarios, capturing execution traces, detecting regressions, and storing large volumes of execution data, as a shared framework every team can use.
  • Skills marketplace: a multi-tenant service where teams publish, version, discover, and reuse agent skills and tools, backed by permissions, security review, and governance.
  • Reliability, isolation, and cost controls: sandboxing, rate limiting, quotas, SLOs, and capacity planning at enterprise scale.
  • Work across the stack as needed, from storage and data modeling to services, deployment infrastructure, and the developer-facing surfaces (SDKs, CLIs, portals) teams use to build on the platform.

Operate

  • Own the production health of the components you build: help define SLIs and SLOs, and build the dashboards and alerts that tell the team when something is wrong before users do.
  • Build observability in from the start, with metrics, structured logging, and distributed tracing that make failures in the agent harness and in complex, multi-step agent workflows quick to diagnose.
  • Design for scale and resilience through load testing, capacity planning, graceful degradation, and failure-mode analysis, so the platform holds up as adoption grows across the enterprise.
  • Participate in the on-call rotation, respond to incidents, and contribute to blameless postmortems that result in durable fixes rather than repeat incidents.
  • Contribute to operational excellence through runbooks, alert hygiene, and safe deployment practices (canaries, feature flags, rollbacks).

Minimum Qualifications

  • 5+ years of professional software engineering experience building and operating production backend systems at scale.
  • Experience owning the design and delivery of services or major features end to end.
  • Strong proficiency in one or more of Python, Java, Go, or comparable languages.
  • Strong distributed systems fundamentals, including concurrency, consistency, fault tolerance, data modeling, API design, and scalability.
  • Experience operating production services with CI/CD, automated testing, and Kubernetes or other container platforms.
  • Hands-on operational experience supporting production systems, including observability, monitoring and alerting, on-call participation, incident response, and postmortems.
  • Experience scaling systems or improving reliability, such as meeting SLOs, performance tuning, capacity planning, or eliminating recurring failure modes.
  • Background in application, platform, or infrastructure engineering; all are relevant.

Preferred Qualifications

  • Experience with durable execution or workflow orchestration systems (e.g., Temporal, Restate, DBOS, Azure Durable Task, AWS Step Functions) or event-driven architectures (e.g., Kafka).
  • Experience building internal developer platforms, multi-tenant services, or SDKs used by many teams.
  • Experience building GenAI applications and agentic harnesses, using frontier and open-weight models (e.g., GPT, Claude, Gemini, Llama, Qwen) and frameworks such as LangGraph, Microsoft Agent Framework, OpenAI Agents SDK, or Claude Agent SDK.
  • Experience building RAG systems at scale, including ingestion pipelines, hybrid retrieval (dense plus keyword search), reranking, and permission-aware retrieval, using engines such as Azure AI Search, OpenSearch, or Vespa.
  • Experience building data pipelines or analytics systems (e.g., streaming ingestion, event processing, knowledge graphs, or feature stores) that turn operational data into insights or context for downstream consumers.
  • Experience building evaluation frameworks for LLM or agent systems, or capability ecosystems such as MCP server registries or Agent Skills marketplaces.
  • Experience with observability and evaluation tooling such as OpenTelemetry, Prometheus, Grafana, Datadog, Langfuse, LangSmith, Braintrust, or Arize Phoenix.
  • Experience with SRE practices such as error budgets, chaos engineering, or game days.
  • Experience with cloud platforms such as Azure or AWS, including managed agent services like Microsoft Foundry Agent Service or Amazon Bedrock AgentCore.
  • Understanding of AI security and governance, including prompt injection, sandboxing, and supply chain security for third-party tools and skills.

Why This Role Is Unique

  • Apply your distributed systems skills to one of the most important new workloads in enterprise software.
  • Build the agent harness, RAG platform, insight engine, eval harness, and skills marketplace: shared infrastructure, not a single agent, that every business workflow at GEICO can build on.
  • Help build the systems that decide whether GEICO's agents are reliable, measurable, and reusable at scale.
  • Build AI capabilities that impact 30,000+ associates and help shape AI experiences used by millions of customers.
  • Grow your career alongside senior AI and engineering leaders shaping the next generation of AI at GEICO.

Annual Salary

$105,000.00 - $230,000.00 The above annual salary range is a general guideline. Multiple factors are taken into consideration to arrive at the final hourly rate/ annual salary to be offered to the selected candidate. Factors include, but are not limited to, the scope and responsibilities of the role, the selected candidate’s work experience, education and training, the work location as well as market and business considerations.

GEICO will consider sponsoring a new qualified applicant for employment authorization for this position. The GEICO Pledge:

Great Company: Protecting customers through life’s twists and turns with innovation and integrity.

Great Careers:Personalized development programs, mentorship, and certification assistance.

Great Culture:Inclusive and collaborative culture rooted in shared success.

Great Rewards:Competitive pay, benefits, and flexibility to support your well-being and future.

The equal employment opportunity policy of the GEICO Companies provides for a fair and equal employment opportunity for all associates and job applicants regardless of race, color, religious creed, national origin, ancestry, age, gender, pregnancy, sexual orientation, gender identity, marital status, familial status, disability or genetic information, in compliance with applicable federal, state and local law. GEICO hires and promotes individuals solely on the basis of their qualifications for the job to be filled.

GEICO reasonably accommodates qualified individuals with disabilities to enable them to receive equal employment opportunity and/or perform the essential functions of the job, unless the accommodation would impose an undue hardship to the Company. This applies to all applicants and associates. GEICO also provides a work environment in which each associate is able to be productive and work to the best of their ability. We do not condone or tolerate an atmosphere of intimidation or harassment. We expect and require the cooperation of all associates in maintaining an atmosphere free from discrimination and harassment with mutual respect by and for all associates and applicants.

Salary Context

This $105K-$230K range is below the median for AI Agent Developer roles in our dataset (median: $185K across 15 roles with salary data).

View full AI Agent Developer salary data →

Role Details

Company GEICO
Title Senior Software Engineer, AI Agent Platform
Location New York, NY, US
Experience Senior
Salary $105K - $230K
Remote No

About This Role

AI Agent Developers build autonomous systems that can reason, plan, and take actions. They design multi-step workflows, tool-use frameworks, and orchestration layers that let LLMs interact with external systems. This is the frontier of applied AI engineering.

Agent development is where the most interesting (and hardest) problems in applied AI live right now. Making an LLM answer a question is straightforward. Making it reliably execute a 15-step workflow that involves calling APIs, reading databases, making decisions, and recovering from errors is an unsolved problem. You're building systems that have to work despite the fact that the underlying model is non-deterministic.

Across the 9,653 AI roles we're tracking, AI Agent Developer positions make up 1% of the market. At GEICO, this role fits into their broader AI and engineering organization.

AI Agent Developer is one of the newest and fastest-growing AI role categories. The market is early but accelerating as companies move beyond simple chatbots toward AI systems that can take real actions. Compensation is high because the skill set is rare and the business impact is potentially enormous.

What the Work Looks Like

A typical week includes: designing the action space and tool definitions for a new agent use case, debugging why the agent chose the wrong action sequence on a specific input, building evaluation frameworks that test agent reliability across hundreds of scenarios, optimizing the prompt chain for cost and latency, and implementing safety guardrails to prevent the agent from taking destructive actions. The work is equal parts engineering and empirical science.

AI Agent Developer is one of the newest and fastest-growing AI role categories. The market is early but accelerating as companies move beyond simple chatbots toward AI systems that can take real actions. Compensation is high because the skill set is rare and the business impact is potentially enormous.

Skills Required

Aws (9% of roles) Azure (8% of roles) Bedrock (2% of roles) Claude (4% of roles) Gemini (2% of roles) Kubernetes (4% of roles) Llama Openai (3% of roles) Python (17% of roles) Rag (7% of roles)

Deep experience with LLM APIs and agent frameworks (LangChain, CrewAI, AutoGen). Strong understanding of prompt engineering, function calling, and error handling for non-deterministic systems. Python is standard. Experience with orchestration patterns, state management, and workflow engines adds significant value.

The best agent developers think like systems engineers. They design for failure modes, build observability into every step, and understand that agent reliability is the product. Expertise in evaluation methodology for non-deterministic systems is the differentiator. Can you measure whether your agent works 'well enough'? Can you find the edge cases where it breaks?

Look for roles that describe specific agent use cases, mention evaluation methodology, and talk about production deployment. Early-stage companies exploring agents can be exciting, but be prepared for ambiguity. The most valuable roles are at companies that have already shipped a v1 and need to make it reliable.

Compensation Benchmarks

AI Agent Developer roles pay a median of $214,400 based on 180 positions with disclosed compensation. Senior-level AI roles across all categories have a median of $228,700. This role's midpoint ($167K) sits 22% below the category median. Disclosed range: $105K to $230K.

Across all AI roles, the market median is $213,400. Top-quartile compensation starts at $264,230. The 90th percentile reaches $319,400. For comparison, the highest-paying categories include AI Safety ($253,100) and Research Engineer ($252,000). By seniority level: Entry: $110,408; Mid: $193,200; Senior: $228,700; Director: $272,275; VP: $235,000.

GEICO AI Hiring

GEICO has 19 open AI roles right now. They're hiring across AI/ML Engineer, AI Agent Developer, AI Software Engineer, AI Product Manager. Positions span Palo Alto, CA, US, Seattle, WA, US, New York, NY, US. Compensation range: $230K - $300K.

Location Context

AI roles in New York pay a median of $221,000 across 2,878 tracked positions. That's 4% above the national median.

Career Path

Common paths into AI Agent Developer roles include Software Engineer, LLM Engineer, Prompt Engineer.

From here, career progression typically leads toward AI Architect, Principal Engineer, Head of AI Engineering.

Build agents. That's the portfolio. Take an open-source agent framework, build something that completes a non-trivial multi-step task, evaluate it rigorously, and document what you learned about reliability, cost, and failure modes. The field is new enough that practical experience counts for more than credentials.

What to Expect in Interviews

Interviews focus on systems thinking and reliability engineering. Expect questions about agent architecture: how you'd design a multi-step workflow with error recovery, how you'd evaluate agent performance, and how you'd prevent agents from taking destructive actions. Coding exercises often involve building a simple agent with tool use and evaluating its behavior across different scenarios. Discussion of safety and guardrails is increasingly common.

When evaluating opportunities: Look for roles that describe specific agent use cases, mention evaluation methodology, and talk about production deployment. Early-stage companies exploring agents can be exciting, but be prepared for ambiguity. The most valuable roles are at companies that have already shipped a v1 and need to make it reliable.

AI Hiring Overview

The AI job market has 9,653 open positions tracked in our dataset. By seniority: 193 entry-level, 4,500 mid-level, 3,455 senior, and 1,505 leadership roles (Director, VP, C-Level). Remote roles make up 6% of the market (568 positions). The remaining 9,010 roles require on-site or hybrid attendance.

The market median for AI roles is $213,400. Top-quartile compensation starts at $264,230. The 90th percentile reaches $319,400. Highest-paying categories: AI Safety ($253,100 median, 57 roles); Research Engineer ($252,000 median, 419 roles); AI Engineering Manager ($251,622 median, 51 roles).

AI Agent Developer is one of the newest and fastest-growing AI role categories. The market is early but accelerating as companies move beyond simple chatbots toward AI systems that can take real actions. Compensation is high because the skill set is rare and the business impact is potentially enormous.

The AI Job Market Today

The AI job market spans 9,653 open positions across 16 role categories. The largest categories by volume: AI/ML Engineer (7,301), Data Scientist (441), AI Software Engineer (438). These three account for the majority of open positions, though smaller categories often have higher per-role compensation because of specialized skill requirements.

The seniority mix tells a story about where AI teams are in their maturity. Entry-level roles (193) are outnumbered by mid-level (4,500) and senior (3,455) positions, reflecting that most companies are past the 'build a team from scratch' phase and need experienced engineers who can ship production systems. Leadership roles (Director, VP, C-Level) total 1,505 positions, representing the bottleneck between technical execution and organizational strategy.

Remote work availability sits at 6% of all AI roles (568 positions), with 9,010 requiring on-site or hybrid attendance. The remote share has stabilized after the post-pandemic correction. Senior and specialized roles (Research Scientist, ML Architect) are more likely to be remote-eligible than entry-level positions, partly because experienced hires have more negotiating power and partly because these roles require less hands-on mentorship.

AI compensation is structured in clear tiers. The market median sits at $213,400. Top-quartile roles start at $264,230, and the 90th percentile reaches $319,400. These figures include base salary with disclosed compensation. Total compensation (including equity, bonuses, and sign-on) runs 20-40% higher at companies that offer those components.

Category matters for compensation. AI Safety roles lead at $253,100 median, while Prompt Engineer roles sit at $141,440. The spread between highest and lowest-paying categories reflects the premium on specialized technical skills versus broader analytical roles.

The most in-demand skills across all AI postings: Python (1,605 postings), Aws (916 postings), Azure (724 postings), Rag (634 postings), Gcp (522 postings), Pytorch (495 postings), Kubernetes (384 postings), Claude (383 postings). Python dominates, appearing in the vast majority of role descriptions regardless of category. Cloud platform experience (AWS, GCP, Azure) is the second most common requirement. The newer entrants to the top skills list (RAG, vector databases, LLM APIs) reflect the shift from traditional ML toward generative AI applications.

Frequently Asked Questions

Based on 180 roles with disclosed compensation, the median salary for AI Agent Developer positions is $214,400. Actual compensation varies by seniority, location, and company stage.
Deep experience with LLM APIs and agent frameworks (LangChain, CrewAI, AutoGen). Strong understanding of prompt engineering, function calling, and error handling for non-deterministic systems. Python is standard. Experience with orchestration patterns, state management, and workflow engines adds significant value.
About 6% of the 9,653 AI roles we track offer remote work. Remote availability varies by company and seniority level, with senior and leadership roles more likely to offer location flexibility.
GEICO is among the companies actively hiring for AI and ML talent. Check our company profiles for detailed breakdowns of open roles, salary ranges, and hiring trends.
Common next steps from AI Agent Developer positions include AI Architect, Principal Engineer, Head of AI Engineering. Progression depends on whether you lean toward technical depth, people management, or product strategy.

Get Weekly AI Career Intelligence

Salary data, skills demand, and market signals from 16,000+ AI job postings. Every Monday.