Staff Software Engineer, AI Agent Platform & Runtime

$170K - $297K New York, NY, US Senior AI Agent Developer

Interested in this AI Agent Developer role at Datasite?

Apply Now →

Skills & Technologies

DockerKubernetesPythonRustTypescript

About This Role

AI job market dashboard showing open roles by category

About us

Datasite is the essential infrastructure for M&A. Also comprising Grata, Blueflame AI, and Sherpany, we help dealbreakers find opportunities, manage transactions, and make key decisions.

Whatever your talents, you can find a place for them here. Get involved in some of the biggest business ventures today. Work with other gifted people around the world. Follow your ambitions, or discover a whole new path.

Can you help us simplify the complex, create great experiences, and deliver better outcomes? Then let's talk.

Job Description:

Why Engineering at Datasite

Datasite's engineering organization builds the software the world's dealmakers depend on to find, evaluate, negotiate, and close transactions: secure virtual data rooms, AI-assisted diligence, deal sourcing, and private-company intelligence.

We're looking for a hands-on Staff Software Engineer to shape the foundational infrastructure for enterprise AI agents. You'll evolve our custom agent harness, build layered memory and secure isolated execution, and make sophisticated agent workflows dependable at production scale. This is an opportunity to solve challenging problems in distributed systems, applied AI, security, and platform engineering - not simply wrap APIs around models.

Help define how agents reason, plan, remember, use tools, delegate work, and recover from failures across complex, high-stakes business workflows. You'll own architecture decisions and collaborate across Engineering, Product, Machine Learning, and Security to deliver meaningful capabilities for dealmakers.

Location: We are hiring in New York City and Minneapolis. Datasite is a hybrid company, with in-office collaboration on Mondays, Tuesdays, and Thursdays.

What You Will Do

  • Lead the architecture and evolution of Datasite's custom agent harness, including reasoning and execution loops, planning, tool selection, state transitions, structured outputs, and runtime controls.
  • Design layered agent memory spanning working context, episodic history, semantic knowledge, and durable workflow state; build retrieval, consolidation, compaction, provenance, retention, and access controls.
  • Architect isolated, containerized agent execution environments for code, files, and tools, with ephemeral workloads, tenant boundaries, resource quotas, restricted networking, and secure credential handling.
  • Build resilient agent orchestration: asynchronous tasks, specialized subagents, delegation, checkpoints, resumability, retries, failure recovery, and human approvals.
  • Create secure, extensible tool integrations using MCP and related interfaces, with authentication, authorization, least-privilege permissions, and safeguards against prompt injection and unsafe actions.
  • Establish agent evaluation, tracing, observability, and regression testing to measure task quality, correctness, reliability, latency, and cost; drive measurable improvements
  • Make high-impact technical tradeoffs between probabilistic model behavior and deterministic application logic, validation, or human review.
  • Partner with Product, Machine Learning, Security, and platform teams to turn diligence, research, and deal workflows into production-grade agent experiences; mentor engineers while remaining hands-on in critical implementation.

What You Bring

  • Experienced in building and operating production software, with a track record of leading complex technical initiatives across teams.
  • Deep expertise in backend platforms, distributed systems, asynchronous execution, APIs, fault tolerance, and stateful services.
  • Strong hands-on Python proficiency and experience with a modern language such as TypeScript, Java, Go, Kotlin, or Rust.
  • Experience developing production LLM applications involving tool calling, multi-step workflows, retrieval, agent orchestration, or context management.
  • Practical understanding of containers, cloud-native infrastructure, workload isolation, and secure execution patterns.
  • Strong foundations in data persistence, caching, event-driven architectures, permissions, multi-tenancy, and secrets management.
  • Excellent product and architectural judgment: able to evaluate emerging techniques, balance speed with reliability, and turn ambiguous problems into maintainable platforms.
  • Ability to influence technical strategy, mentor senior engineers, and communicate complex tradeoffs clearly to engineering and product leaders.

Nice to Have

  • Custom agent runtimes or orchestration frameworks; agentic coding systems or autonomous development environments.
  • Persistent or hierarchical agent memory, context engineering, retrieval architectures, or long-running agent workflows.
  • Secure code execution, sandboxing, Docker, Kubernetes, microVMs, or ephemeral compute.
  • Multi-agent coordination, MCP servers, tool registries, capability-based permissions, model routing, or agent evaluation and tracing.
  • Enterprise SaaS, M&A, virtual data rooms, regulated data, financial services, or complex document-centric workflows.

The base salary range represents the estimated low and high end for this position based on a good faith assessment of the role and market data at the time of posting. Consistent with applicable law, each candidate’s compensation offer may vary and will be determined based on but not limited to, your geographic region, skills, qualifications, and experience along with the requirements of the position. This position may be eligible for bonuses, commissions, or overtime if applicable. Benefits include health insurance (medical, dental, vision), a retirement savings plan, paid time off, and other employee benefits. Specific details will be provided during the interview process. Datasite reserves the right to modify this pay range at any time.

$170,000.00 - $297,200.00 Our company is committed to fostering a diverse and inclusive workforce where all individuals are respected and valued. We are an equal opportunity employer and make all employment decisions without regard to race, color, religion, sex, gender identity, sexual orientation, age, national origin, disability, protected veteran status, or any other protected characteristic. We encourage applications from candidates of all backgrounds and are dedicated to building teams that reflect the diversity of our communities.

Salary Context

This $170K-$297K range is above the median for AI Agent Developer roles in our dataset (median: $178K across 35 roles with salary data).

View full AI Agent Developer salary data →

Role Details

Company Datasite
Title Staff Software Engineer, AI Agent Platform & Runtime
Location New York, NY, US
Experience Senior
Salary $170K - $297K
Remote No

About This Role

AI Agent Developers build autonomous systems that can reason, plan, and take actions. They design multi-step workflows, tool-use frameworks, and orchestration layers that let LLMs interact with external systems. This is the frontier of applied AI engineering.

Agent development is where the most interesting (and hardest) problems in applied AI live right now. Making an LLM answer a question is straightforward. Making it reliably execute a 15-step workflow that involves calling APIs, reading databases, making decisions, and recovering from errors is an unsolved problem. You're building systems that have to work despite the fact that the underlying model is non-deterministic.

Across the 10,419 AI roles we're tracking, AI Agent Developer positions make up 1% of the market. At Datasite, this role fits into their broader AI and engineering organization.

AI Agent Developer is one of the newest and fastest-growing AI role categories. The market is early but accelerating as companies move beyond simple chatbots toward AI systems that can take real actions. Compensation is high because the skill set is rare and the business impact is potentially enormous.

What the Work Looks Like

A typical week includes: designing the action space and tool definitions for a new agent use case, debugging why the agent chose the wrong action sequence on a specific input, building evaluation frameworks that test agent reliability across hundreds of scenarios, optimizing the prompt chain for cost and latency, and implementing safety guardrails to prevent the agent from taking destructive actions. The work is equal parts engineering and empirical science.

AI Agent Developer is one of the newest and fastest-growing AI role categories. The market is early but accelerating as companies move beyond simple chatbots toward AI systems that can take real actions. Compensation is high because the skill set is rare and the business impact is potentially enormous.

Skills Required

Docker (4% of roles) Kubernetes (6% of roles) Python (23% of roles) Rust (1% of roles) Typescript (4% of roles)

Deep experience with LLM APIs and agent frameworks (LangChain, CrewAI, AutoGen). Strong understanding of prompt engineering, function calling, and error handling for non-deterministic systems. Python is standard. Experience with orchestration patterns, state management, and workflow engines adds significant value.

The best agent developers think like systems engineers. They design for failure modes, build observability into every step, and understand that agent reliability is the product. Expertise in evaluation methodology for non-deterministic systems is the differentiator. Can you measure whether your agent works 'well enough'? Can you find the edge cases where it breaks?

Look for roles that describe specific agent use cases, mention evaluation methodology, and talk about production deployment. Early-stage companies exploring agents can be exciting, but be prepared for ambiguity. The most valuable roles are at companies that have already shipped a v1 and need to make it reliable.

Compensation Benchmarks

AI Agent Developer roles pay a median of $215,000 based on 252 positions with disclosed compensation. Senior-level AI roles across all categories have a median of $230,000. This role's midpoint ($233K) sits 9% above the category median. Disclosed range: $170K to $297K.

Across all AI roles, the market median is $214,834. Top-quartile compensation starts at $266,000. The 90th percentile reaches $321,730. For comparison, the highest-paying categories include AI Safety ($274,500) and Research Engineer ($252,000). By seniority level: Entry: $114,400; Mid: $193,200; Senior: $230,000; Director: $272,100; VP: $235,000.

Datasite AI Hiring

Datasite has 3 open AI roles right now. They're hiring across AI/ML Engineer, AI Agent Developer, AI Product Manager. Based in New York, NY, US. Compensation range: $297K - $297K.

Location Context

AI roles in New York pay a median of $222,480 across 3,785 tracked positions. That's 4% above the national median.

Career Path

Common paths into AI Agent Developer roles include Software Engineer, LLM Engineer, Prompt Engineer.

From here, career progression typically leads toward AI Architect, Principal Engineer, Head of AI Engineering.

Build agents. That's the portfolio. Take an open-source agent framework, build something that completes a non-trivial multi-step task, evaluate it rigorously, and document what you learned about reliability, cost, and failure modes. The field is new enough that practical experience counts for more than credentials.

What to Expect in Interviews

Interviews focus on systems thinking and reliability engineering. Expect questions about agent architecture: how you'd design a multi-step workflow with error recovery, how you'd evaluate agent performance, and how you'd prevent agents from taking destructive actions. Coding exercises often involve building a simple agent with tool use and evaluating its behavior across different scenarios. Discussion of safety and guardrails is increasingly common.

When evaluating opportunities: Look for roles that describe specific agent use cases, mention evaluation methodology, and talk about production deployment. Early-stage companies exploring agents can be exciting, but be prepared for ambiguity. The most valuable roles are at companies that have already shipped a v1 and need to make it reliable.

AI Hiring Overview

The AI job market has 10,419 open positions tracked in our dataset. By seniority: 117 entry-level, 4,975 mid-level, 3,840 senior, and 1,487 leadership roles (Director, VP, C-Level). Remote roles make up 6% of the market (580 positions). The remaining 9,776 roles require on-site or hybrid attendance.

The market median for AI roles is $214,834. Top-quartile compensation starts at $266,000. The 90th percentile reaches $321,730. Highest-paying categories: AI Safety ($274,500 median, 90 roles); Research Engineer ($252,000 median, 580 roles); AI Engineering Manager ($250,811 median, 72 roles).

AI Agent Developer is one of the newest and fastest-growing AI role categories. The market is early but accelerating as companies move beyond simple chatbots toward AI systems that can take real actions. Compensation is high because the skill set is rare and the business impact is potentially enormous.

The AI Job Market Today

The AI job market spans 10,419 open positions across 16 role categories. The largest categories by volume: AI/ML Engineer (7,849), AI Product Manager (516), AI Software Engineer (513). These three account for the majority of open positions, though smaller categories often have higher per-role compensation because of specialized skill requirements.

The seniority mix tells a story about where AI teams are in their maturity. Entry-level roles (117) are outnumbered by mid-level (4,975) and senior (3,840) positions, reflecting that most companies are past the 'build a team from scratch' phase and need experienced engineers who can ship production systems. Leadership roles (Director, VP, C-Level) total 1,487 positions, representing the bottleneck between technical execution and organizational strategy.

Remote work availability sits at 6% of all AI roles (580 positions), with 9,776 requiring on-site or hybrid attendance. The remote share has stabilized after the post-pandemic correction. Senior and specialized roles (Research Scientist, ML Architect) are more likely to be remote-eligible than entry-level positions, partly because experienced hires have more negotiating power and partly because these roles require less hands-on mentorship.

AI compensation is structured in clear tiers. The market median sits at $214,834. Top-quartile roles start at $266,000, and the 90th percentile reaches $321,730. These figures include base salary with disclosed compensation. Total compensation (including equity, bonuses, and sign-on) runs 20-40% higher at companies that offer those components.

Category matters for compensation. AI Safety roles lead at $274,500 median, while Prompt Engineer roles sit at $140,000. The spread between highest and lowest-paying categories reflects the premium on specialized technical skills versus broader analytical roles.

The most in-demand skills across all AI postings: Python (2,350 postings), Aws (1,173 postings), Azure (1,030 postings), Rag (986 postings), Gcp (714 postings), Pytorch (649 postings), Kubernetes (583 postings), Claude (581 postings). Python dominates, appearing in the vast majority of role descriptions regardless of category. Cloud platform experience (AWS, GCP, Azure) is the second most common requirement. The newer entrants to the top skills list (RAG, vector databases, LLM APIs) reflect the shift from traditional ML toward generative AI applications.

Frequently Asked Questions

Based on 252 roles with disclosed compensation, the median salary for AI Agent Developer positions is $215,000. Actual compensation varies by seniority, location, and company stage.
Deep experience with LLM APIs and agent frameworks (LangChain, CrewAI, AutoGen). Strong understanding of prompt engineering, function calling, and error handling for non-deterministic systems. Python is standard. Experience with orchestration patterns, state management, and workflow engines adds significant value.
About 6% of the 10,419 AI roles we track offer remote work. Remote availability varies by company and seniority level, with senior and leadership roles more likely to offer location flexibility.
Datasite is among the companies actively hiring for AI and ML talent. Check our company profiles for detailed breakdowns of open roles, salary ranges, and hiring trends.
Common next steps from AI Agent Developer positions include AI Architect, Principal Engineer, Head of AI Engineering. Progression depends on whether you lean toward technical depth, people management, or product strategy.

Get Weekly AI Career Intelligence

Salary data, skills demand, and market signals from 16,000+ AI job postings. Every Monday.