Sr. AI Software Engineer

$161K - $258K North Reading, MA, US Senior AI Software Engineer

Interested in this AI Software Engineer role at Teradyne?

Apply Now →

Skills & Technologies

PythonRagVector Search

About This Role

AI job market dashboard showing open roles by category

»* Date: Oct 1, 2026

Location: North Reading, MA, US

Company: Teradyne

We are the global test and automation specialists, powering next-generation technologies through sophisticated solutions. Behind every electronic device you use, Teradyne's test technology ensures your device works right the first time, every time! Our portfolio of automation solutions help manufacturers to develop and deliver products quickly, efficiently and cost-effectively. Together, Teradyne companies deliver manufacturing automation across industries and applications around the world!

We attract, develop, and retain a high-performance workforce, comprised of people with diverse backgrounds and a shared drive for excellence. We strive to foster a positive and inclusive work environment that helps employees, and communities, thrive.

Our Purpose

TERADYNE, where experience meets innovation and driving excellence in every connection. We are fueled by creativity and diversity of thought and in our workforce. Our employees are supported to innovate and learn something new every day.

We cultivate a culture of inclusion for all employees that respects their individual strengths, views, and experiences. We believe that our differences enable us to be a better team – one that makes better decisions, drives innovation and delivers better business results.

Opportunity Overview

Teradyne’s AI Ops team is building knowledge and retrieval infrastructure that helps engineering teams use AI agents and developer tools across a large technical codebase and documentation set. As a Senior AI Software Engineer, you will help evolve an existing proof of concept into an owned, reliable, and measurable platform.

This senior individual-contributor role sets technical direction for the retrieval platform while remaining hands-on in design, implementation, testing, and operation. You will work independently on complex technical problems, evaluate tradeoffs, and collaborate across engineering disciplines.

  • Lead the technical direction, design, implementation, testing, and operation of the retrieval platform.
  • Develop Python services and pipelines that index source repositories and engineering documents while preserving permissions.
  • Build repeatable evaluations for lexical and vector search, ranking, chunking, freshness, and code- and document-aware retrieval.
  • Collaborate with partner teams that own source systems and access rules to deliver practical API and MCP-compatible integrations.
  • Ensure operational health is visible through measures for index freshness, failures, retrieval quality, latency, and relevant cost.
  • Support platform adoption through hands-on code, tests, operational tooling, documentation, and shared engineering patterns.

All About You

We seek individuals who share our passion and determination. Our commitment to customer success drives us to go the extra mile. If you’re ready to join us in this mission, take a closer look at the minimum criteria for the position.

  • Production experience building and operating backend or platform systems, with the ability to take technical ownership and contribute hands-on.
  • Experience with search, code intelligence, or retrieval-augmented generation (RAG), including architecture, failure modes, operational tradeoffs, and retrieval-quality measurement.
  • Strong Python and systems engineering skills for designing and debugging services, pipelines, indexing, APIs, tests, and operational tools.
  • Knowledge of lexical and vector retrieval, re-ranking, chunking, freshness and invalidation, and techniques for finding relevant evidence in documents and code.
  • Ability to evaluate retrieval with representative questions and labeled evidence, distinguish retrieval performance from generated-answer quality, and use error analysis to guide decisions.
  • Ability to become effective in unfamiliar codebases and engineering domains; prior semiconductor-test experience is not required.
  • Clear cross-functional communication skills and the ability to share technical context through documentation, runbooks, and engineering patterns.
  • Experience using AI-assisted development tools productively and verifying generated code through testing, review, and evidence.

Compensation:

The base salary range for this role is $161,700 - $258,800. This range is a good faith estimate, and the amount of base salary will correspond with experience and skill set. This range can also fluctuate depending on demand and location.

Incentive Plan: This job is eligible for discretionary bonus(es) based on financial performance.

Benefits:

Teradyne offers a variety of robust health and well-being benefit programs, including medical, dental, vision, Flexible Spending Accounts, retirement savings plans, life and disability insurance, paid vacation & holidays, tuition assistance programs, and more.

Job Segment: Test Engineer, Testing, Software Engineer, Developer, Manufacturing Engineer, Engineering, Technology

»

Salary Context

This $161K-$258K range is above the median for AI Software Engineer roles in our dataset (median: $192K across 146 roles with salary data).

Role Details

Company Teradyne
Title Sr. AI Software Engineer
Location North Reading, MA, US
Category AI Software Engineer
Experience Senior
Salary $161K - $258K
Remote No

About This Role

AI Software Engineers build the applications and systems that AI models run inside. They own the API layers, data pipelines, frontend integrations, and infrastructure that turn a model into a product users interact with. Every AI company needs engineers who can build the software around the AI.

The challenge is building reliable systems around inherently unreliable components. Models are probabilistic. They'll give different answers to the same question. They hallucinate. They're slow. They're expensive. Your job is to build an application layer that handles all of this gracefully while delivering a product that users trust and enjoy.

Across the 8,943 AI roles we're tracking, AI Software Engineer positions make up 4% of the market. At Teradyne, this role fits into their broader AI and engineering organization.

AI Software Engineer roles are among the most numerous in the AI job market. Every company deploying AI needs software engineers who understand AI integration patterns. The demand is broad, spanning startups to enterprises, across every industry adopting AI capabilities.

What the Work Looks Like

A typical week includes: building API endpoints that serve model inference with caching and fallback logic, designing the data pipeline that feeds context to a RAG system, implementing streaming responses in the frontend, debugging a race condition in the async inference pipeline, and optimizing database queries for the vector search layer. It's full-stack engineering with AI at the center.

AI Software Engineer roles are among the most numerous in the AI job market. Every company deploying AI needs software engineers who understand AI integration patterns. The demand is broad, spanning startups to enterprises, across every industry adopting AI capabilities.

Skills Required

Python (16% of roles) Rag (6% of roles) Vector Search (1% of roles)

Full-stack engineering skills with AI integration experience. Python and TypeScript are the most common requirements. You'll need to understand API design, database architecture, and how to build reliable systems around probabilistic outputs. Experience with streaming, async processing, and caching patterns is increasingly important as real-time AI applications proliferate.

Knowledge of vector databases, embedding APIs, and LLM integration patterns (function calling, structured outputs, retry logic) differentiates AI software engineers from general software engineers. Understanding cost optimization (caching strategies, model routing, batched inference) is valuable since inference costs can dominate application economics.

Strong postings describe the product you'll be building, the AI integration patterns you'll work with, and the scale requirements. Look for companies that have existing AI features and need engineers to improve and expand them, not companies that are 'planning to add AI' someday.

Compensation Benchmarks

AI Software Engineer roles pay a median of $220,000 based on 1,448 positions with disclosed compensation. Senior-level AI roles across all categories have a median of $228,700. Disclosed range: $161K to $258K.

Across all AI roles, the market median is $213,380. Top-quartile compensation starts at $264,148. The 90th percentile reaches $319,310. For comparison, the highest-paying categories include AI Safety ($253,100) and Research Engineer ($252,000). By seniority level: Entry: $110,408; Mid: $193,200; Senior: $228,700; Director: $272,250; VP: $235,000.

Teradyne AI Hiring

Teradyne has 4 open AI roles right now. They're hiring across AI/ML Engineer, AI Software Engineer, AI Product Manager. Positions span North Reading, MA, US, Deer Park, IL, North Reading, MA. Compensation range: $258K - $319K.

Location Context

Across all AI roles, 6% (521 positions) offer remote work, while 8,351 require on-site attendance. Top AI hiring metros: New York (2,878 roles, $221,000 median); San Francisco (2,416 roles, $263,811 median); Los Angeles (1,340 roles, $210,000 median).

Career Path

Common paths into AI Software Engineer roles include Software Engineer, Full-Stack Developer, Backend Engineer.

From here, career progression typically leads toward Staff Engineer, AI Architect, Engineering Manager.

If you're a software engineer, you're already 80% there. Learn the AI integration patterns: RAG, streaming inference, function calling, structured outputs. Build a project that demonstrates you can wrap an AI model in a production-quality application with proper error handling, caching, and user experience. That's the portfolio piece that gets you hired.

What to Expect in Interviews

Technical screens look like standard software engineering interviews with an AI twist. Expect system design questions about building reliable applications around probabilistic models: handling streaming responses, implementing retry logic for API failures, and designing caching strategies for LLM outputs. Coding rounds test standard algorithms plus practical integration patterns like async processing and rate limiting.

When evaluating opportunities: Strong postings describe the product you'll be building, the AI integration patterns you'll work with, and the scale requirements. Look for companies that have existing AI features and need engineers to improve and expand them, not companies that are 'planning to add AI' someday.

AI Hiring Overview

The AI job market has 8,943 open positions tracked in our dataset. By seniority: 175 entry-level, 4,132 mid-level, 3,268 senior, and 1,368 leadership roles (Director, VP, C-Level). Remote roles make up 6% of the market (521 positions). The remaining 8,351 roles require on-site or hybrid attendance.

The market median for AI roles is $213,380. Top-quartile compensation starts at $264,148. The 90th percentile reaches $319,310. Highest-paying categories: AI Safety ($253,100 median, 57 roles); Research Engineer ($252,000 median, 419 roles); AI Engineering Manager ($251,622 median, 51 roles).

AI Software Engineer roles are among the most numerous in the AI job market. Every company deploying AI needs software engineers who understand AI integration patterns. The demand is broad, spanning startups to enterprises, across every industry adopting AI capabilities.

The AI Job Market Today

The AI job market spans 8,943 open positions across 16 role categories. The largest categories by volume: AI/ML Engineer (6,739), AI Product Manager (403), AI Software Engineer (402). These three account for the majority of open positions, though smaller categories often have higher per-role compensation because of specialized skill requirements.

The seniority mix tells a story about where AI teams are in their maturity. Entry-level roles (175) are outnumbered by mid-level (4,132) and senior (3,268) positions, reflecting that most companies are past the 'build a team from scratch' phase and need experienced engineers who can ship production systems. Leadership roles (Director, VP, C-Level) total 1,368 positions, representing the bottleneck between technical execution and organizational strategy.

Remote work availability sits at 6% of all AI roles (521 positions), with 8,351 requiring on-site or hybrid attendance. The remote share has stabilized after the post-pandemic correction. Senior and specialized roles (Research Scientist, ML Architect) are more likely to be remote-eligible than entry-level positions, partly because experienced hires have more negotiating power and partly because these roles require less hands-on mentorship.

AI compensation is structured in clear tiers. The market median sits at $213,380. Top-quartile roles start at $264,148, and the 90th percentile reaches $319,310. These figures include base salary with disclosed compensation. Total compensation (including equity, bonuses, and sign-on) runs 20-40% higher at companies that offer those components.

Category matters for compensation. AI Safety roles lead at $253,100 median, while Prompt Engineer roles sit at $141,440. The spread between highest and lowest-paying categories reflects the premium on specialized technical skills versus broader analytical roles.

The most in-demand skills across all AI postings: Python (1,422 postings), Aws (808 postings), Azure (638 postings), Rag (555 postings), Gcp (457 postings), Pytorch (433 postings), Claude (341 postings), Kubernetes (337 postings). Python dominates, appearing in the vast majority of role descriptions regardless of category. Cloud platform experience (AWS, GCP, Azure) is the second most common requirement. The newer entrants to the top skills list (RAG, vector databases, LLM APIs) reflect the shift from traditional ML toward generative AI applications.

Frequently Asked Questions

Based on 1,448 roles with disclosed compensation, the median salary for AI Software Engineer positions is $220,000. Actual compensation varies by seniority, location, and company stage.
Full-stack engineering skills with AI integration experience. Python and TypeScript are the most common requirements. You'll need to understand API design, database architecture, and how to build reliable systems around probabilistic outputs. Experience with streaming, async processing, and caching patterns is increasingly important as real-time AI applications proliferate.
About 6% of the 8,943 AI roles we track offer remote work. Remote availability varies by company and seniority level, with senior and leadership roles more likely to offer location flexibility.
Teradyne is among the companies actively hiring for AI and ML talent. Check our company profiles for detailed breakdowns of open roles, salary ranges, and hiring trends.
Common next steps from AI Software Engineer positions include Staff Engineer, AI Architect, Engineering Manager. Progression depends on whether you lean toward technical depth, people management, or product strategy.

Get Weekly AI Career Intelligence

Salary data, skills demand, and market signals from 16,000+ AI job postings. Every Monday.