AI Governance and Evaluation Executive

Dallas, TX, US Mid Level AI/ML Engineer

Interested in this AI/ML Engineer role at UT Southwestern Medical Center?

Apply Now →

About This Role

AI job market dashboard showing open roles by category

WHY UT SOUTHWESTERN?

With over 75 years of excellence in Dallas-Fort Worth, Texas, UT Southwestern is committed to excellence, innovation, teamwork, and compassion. As a world-renowned medical and research center, we strive to provide the best possible care, resources, and benefits for our valued employees. Ranked as the No. 1 hospital in Dallas-Fort Worth according to U.S. News & World Report, we invest in you with opportunities for career growth and development to align with your future goals. Our highly competitive benefits package offers healthcare, PTO and paid holidays, on-site childcare, wage, merit increases and so much more. We invite you to be a part of the UT Southwestern team where you’ll discover a culture of teamwork, professionalism, and a rewarding career!

JOB SUMMARY

The AI Governance and Evaluation Executive is the program and operations leader responsible for implementing, scaling, and continuously improving UTSW’s enterprise approach to responsible AI governance and evaluation. Reporting to the CAIO, this role executes the governance and evaluation roadmap and adoption plan across the health system, research and academic mission, biomedical education, and administrative and business functions. * The leader in this role converts enterprise direction into annual priorities and repeatable workflows for intake, classification, evaluation, review, vendor assessment, deployment conditions, monitoring, reassessment, and stakeholder support. The role maintains enterprise portfolio visibility, drives reuse and consistency, and coordinates cross-functional execution and works closely with Compliance, Information Security, and Information Technology Services on AI risk management, while those functions retain formal ownership of their respective risk-management domains.

BENEFITS

UT Southwestern is proud to offer a competitive and comprehensive benefits package to eligible employees. Our benefits are designed to support your overall wellbeing, and include:

  • PPO medical plan, available day one at no cost for full-time employee-only coverage
  • 100% coverage for preventive healthcare-no copay
  • Paid Time Off, available day one
  • Retirement Programs through the Teacher Retirement System of Texas (TRS)
  • Paid Parental Leave Benefit
  • Wellness programs
  • Tuition Reimbursement
  • Public Service Loan Forgiveness (PSLF) Qualified Employer

EXPERIENCE AND EDUCATION

Required

  • Education + Master’s Degree in Public Health, Biomedical Informatics, Data Science, Computer Science, Engineering, Research Administration, or a related field.
  • Experience + 8 years of progressively responsible experience in AI, digital health, healthcare operations, technology governance, clinical informatics, data analytics, research administration, compliance, or a related field. + 4 years leading people, programs, or complex cross-functional initiatives. + Demonstrated experience operating cross-functional governance, evaluation, assurance, or enterprise programs.

Demonstrated experience implementing enterprise roadmaps, operating models, or new capabilities, and translating priorities into measurable outcomes. +

Preferred

  • Education + PhD or additional advanced degree in a related field.
  • Experience + Experience in an academic medical center, integrated health system, life sciences organization, or similarly complex regulated environment. + Experience with AI/ML evaluation, deployment, governance, responsible AI, or assurance. + Experience evaluating AI vendors and coordinating due diligence. + Technical fluency across LLM ecosystems, MLOps, retrieval and vector technologies, AI APIs and integrations, lifecycle monitoring, and incident-response interfaces sufficient to engage technical teams and assess governance evidence. + Experience building or scaling a new team or function and managing tools, vendors, contracts, or external resources. + Familiarity with generative AI, LLMs, multimodal models, foundation models, and agentic AI. + Working knowledge of healthcare AI evaluation and lifecycle monitoring, including quantitative methods and model cards.

Familiarity with NIST AI RMF, ISO/IEC 42001, and related responsible AI frameworks or standards. +

JOB DUTIES

  • Lead Governance and Evaluation Operations and Roadmap Execution + Independently run the day-to-day enterprise Responsible AI Governance and Evaluation program on behalf of the CAIO. + Translate program strategy into an annual operating roadmap, including priorities, dependencies, resource needs, adoption activities, and measurable program outcomes. + Operationalize AI policies, standards, workflows, decision rights, review pathways, and documentation requirements. + Coordinate governance across institutional and domain-specific structures including work with UTSW executives and senior leadership. + Prioritize work based on institutional value, risk, dependencies, and capacity, and surface tradeoffs for decision. + Ensure governance is risk-proportionate, timely, consistent, and designed to enable responsible innovation. + Identify complex, novel, or high-consequence cases requiring escalation to the CAIO or appropriate governance body.
  • Manage End-to-End Governance Workflow + Operate overall intake, triage, AI risk classification, evaluation, multidisciplinary review, decision, deployment conditions, monitoring, and reassessment workflows. + Coordinate enterprise governance committee agendas, case materials, decisions, action items, and follow-up. + Maintain authoritative records of approvals, conditions, exceptions, reassessments, and governance precedents. + Develop expedited and standardized pathways for low-risk or well-understood AI uses. + Create and maintain reusable review patterns, templates, evidence packages, evaluation assets, and precedents that improve consistency and reduce duplicate work. + Provide clear guidance, consultation, education, and stakeholder support to promote early and ongoing engagement and adoption of governance requirements. + Track service levels, bottlenecks, and outstanding governance actions and drive closure.
  • Operationalize AI Evaluation and Assurance + Implement evaluation requirements proportionate to AI risk, intended use, and deployment context. + Coordinate and ensure assessment of performance, reliability, safety, bias, security considerations, and unintended consequences as applicable. + Coordinate independent evaluation of consequential AI systems as appropriate. + Lead assessment of vendor evidence and claims and identify when supplemental local testing or independent evaluation is required. + Facilitate prospective validation, simulation, and other assurance activities as warranted. + Translate evaluation findings into governance conditions, remediation actions, monitoring requirements, and escalation. + Connect evaluation plans and findings to measurable outcomes where appropriate.
  • Support Governance of Generative and Agentic AI + Ensure application of governance and evaluation practices to foundation models, LLMs, multimodal models, and agentic AI. + Coordinate review of tool and data access, identity and authorization, human oversight, autonomous actions, memory, agent-to-agent interactions, observability, guardrails, testing, and fail-safe mechanisms. + Ensure UTSW maintains practical governance approaches across commercial frontier models, institutionally hosted models, open-weight models, and internally developed AI. + Convert emerging model and agent capabilities, research, and standards into practical review criteria, test protocols, and playbooks.
  • Coordinate AI Portfolio, Vendor and Adoption Operations + Maintain enterprise visibility of AI systems, vendors, accountable owners, intended uses, risk classifications, evaluation status, and monitoring obligations. + Coordinate vendor due diligence and evidence collection with Procurement, Legal, Compliance, Information Security, IT, Data, and domain teams, supporting build-buy-partner decisions without assuming ownership of procurement or technical architecture. + Track portfolio priorities, review readiness, dependencies, decisions, and open conditions and prepare concise materials for decision forums. + Responsible for continuous adoption through training, guidance, communications, and integration of governance requirements into business, research, clinical, and technology workflows. + Promote common methods, reusable evidence, and standard controls to reduce duplication and improve enterprise consistency.
  • Partner on AI Risk Management + Work directly with Compliance and Information Security to identify and assess AI-related risks and to incorporate AI considerations into their established enterprise risk-management processes. + Lead coordination of AI governance requirements, evidence, mitigations, and escalation with the risk-owning functions and other control partners. + Partner with other senior leaders to help translate risk findings into governance decisions, deployment conditions, monitoring requirements, remediation plans, and reassessment triggers. + Stay current on emerging AI regulatory requirements, standards, and professional guidance relevant to UTSW.
  • Enable Domain Governance + Serve as a central operating leadership partner to domain leaders and governance groups. + Engage stakeholders early so governance and evaluation requirements are built into planning, procurement, research, development, implementation, and operations. + Health System: clinical and operational AI, patient-facing tools, predictive models, generative AI, ambient AI, and autonomous workflows. + Research & Academic: basic, translational, and clinical research AI, research data, scientific AI, external models, AI-enabled experimentation, and biomedical education. + Administrative/Business: workforce productivity, finance, HR, revenue cycle, procurement, communications, operations, and automation.
  • Build and Lead the Governance Team + Lead and oversee UTSW AI Governance Stewards and other governance staff supporting enterprise and domain workflows; define roles, structure, decision rights, and ways of working. + Develop practical expertise in AI governance, evaluation operations, assurance, and responsible AI. + Build strong working relationships with institutional partners. + Create reusable playbooks, templates, review criteria, and operating procedures. + Responsible for overall management of assigned budgets, governance and evaluation tooling, contracts, and external resources within approved plans.
  • Measure Program Performance + Maintain a balanced program scorecard including governance cycle time; enterprise portfolio coverage; adoption of standard pathways; reuse of evaluation assets; use-case volume and risk distribution; evaluation and vendor-review completion; backlog and dependency status; closure of conditions and mitigations; monitoring findings; incidents and near misses; measurable outcomes; and stakeholder experience. + Use relevant data to improve throughput, consistency, adoption, and institutional confidence.
  • Leadership and Decision Support + Advise the CAIO on governance operations, evaluation findings, emerging issues, and institutional AI governance maturity. + Represent the Office of the CAIO in designated governance forums and working groups. + Facilitate multidisciplinary and/or complete organizational decisions and resolve operational barriers to responsible deployment. + Escalate significant or unresolved governance concerns and risk findings to the CAIO and applicable risk-owning functions. + Recommend additional evaluation, mitigation, monitoring, conditions, or reassessment when warranted. + Prepare executive-level reporting on priorities, performance, dependencies, unresolved issues, resource needs, and decisions required. + Explain complex AI, governance, and evaluation concepts clearly to technical and nontechnical audiences.

Knowledge, Skills and Abilities

  • Ability to translate enterprise direction into priorities, tradeoffs, repeatable workflows, and measurable program performance.
  • Ability to move work across matrixed organizations without relying on command-and-control authority.
  • Ability to work comfortably with AI scientists, engineers, clinicians, researchers, and vendors.
  • Understands when deeper evaluation or stronger controls are warranted.
  • Ability to treat governance stakeholders as partners and designs for timely, usable experiences.
  • Ability to evolve governance as models, agents, regulations, and institutional use cases change.
  • Strong project and program management and organizational leadership skills.
  • Ability to translate complex technical, clinical, regulatory, and ethical issues into practical workflows and decisions.
  • Excellent communication, facilitation, negotiation, and stakeholder-management skills.

PHYSICAL REQUIREMENTS/WORKING CONDITIONS

Physical Requirements

  • Talking

Working Conditions

  • Office Setting

Salary Information

Salary is commensurate with education, skills, and relevant experience.

SECURITY AND EEO STATEMENT

Security

This position is security-sensitive and subject to Texas Education Code 51.215, which authorizes UT Southwestern to obtain criminal history record information. To the extent this position requires the holder to research, work on, or have access to critical infrastructure as defined in Section 117.001(2) of the Texas Business and Commerce Code, the ability to maintain the security or integrity of the critical infrastructure is a minimum qualification to be hired and to continue to be employed in the position.

EEO

UT Southwestern Medical Center is committed to an educational and working environment that provides equal opportunity to all members of the University community. As an equal opportunity employer, UT Southwestern prohibits unlawful discrimination, including discrimination on the basis of race, color, religion, national origin, sex, sexual orientation, gender identity, gender expression, age, disability, genetic information, citizenship status, or veteran status.

Role Details

Title AI Governance and Evaluation Executive
Location Dallas, TX, US
Category AI/ML Engineer
Experience Mid Level
Salary Not disclosed
Remote No

About This Role

AI/ML Engineers build and deploy machine learning models in production. They work across the full ML lifecycle: data pipelines, model training, evaluation, and serving infrastructure. The role has evolved significantly over the past two years. Where ML Engineers once spent most of their time on model architecture, the job now tilts heavily toward inference optimization, cost management, and integrating LLM capabilities into existing systems. Companies want engineers who can ship production systems, and the experimenter-only role is fading fast.

Day-to-day, you're writing training pipelines, debugging data quality issues, setting up evaluation frameworks, and figuring out why your model performs differently in staging than it did on your dev set. The best ML engineers are obsessive about reproducibility and measurement. They instrument everything. They know that a model is only as good as the data feeding it and the infrastructure serving it.

Across the 10,419 AI roles we're tracking, AI/ML Engineer positions make up 75% of the market. At UT Southwestern Medical Center, this role fits into their broader AI and engineering organization.

Demand for AI/ML Engineers has been strong and consistent. Unlike some AI roles that spike with hype cycles, ML engineering is a foundational need. Every company deploying AI models needs people who can keep them running, and the gap between research prototypes and production systems keeps growing.

What the Work Looks Like

A typical week might include: debugging a data pipeline that's silently dropping 3% of training examples, running A/B tests on a new model version, writing documentation for a feature flag system that lets you roll back model deployments, and reviewing a junior engineer's PR for a new evaluation metric. Meetings tend to be cross-functional since ML touches product, engineering, and data teams.

Demand for AI/ML Engineers has been strong and consistent. Unlike some AI roles that spike with hype cycles, ML engineering is a foundational need. Every company deploying AI models needs people who can keep them running, and the gap between research prototypes and production systems keeps growing.

Skills in Demand for This Role

Python (23% of roles) Aws (11% of roles) Azure (10% of roles) Rag (9% of roles) Gcp (7% of roles) Pytorch (6% of roles) Kubernetes (6% of roles) Claude (6% of roles)

Python and PyTorch dominate the requirements. Most roles expect experience with cloud platforms (AWS, GCP, or Azure) and familiarity with ML frameworks like TensorFlow or JAX. RAG (Retrieval-Augmented Generation) has become a top-3 skill requirement as companies integrate LLMs into their products. Docker and Kubernetes show up in about a third of postings, reflecting the production focus of the role.

Beyond the core stack, employers increasingly want experience with experiment tracking tools (MLflow, Weights & Biases), feature stores, and vector databases. Fine-tuning experience is valuable but less common than you'd think from reading Twitter. Most production LLM work is RAG and prompt engineering, not fine-tuning. If you have both, you're in a strong position.

Companies that are serious about AI/ML hiring tend to post specific infrastructure details in the job description: the frameworks they use, their model serving stack, their data pipeline tools. Vague postings that just say 'ML experience required' without specifics are often companies that haven't figured out what they need yet.

Compensation Benchmarks

AI/ML Engineer roles pay a median of $213,800 based on 16,346 positions with disclosed compensation. Mid-level AI roles across all categories have a median of $193,200.

Across all AI roles, the market median is $214,834. Top-quartile compensation starts at $266,000. The 90th percentile reaches $321,730. For comparison, the highest-paying categories include AI Safety ($274,500) and Research Engineer ($252,000). By seniority level: Entry: $114,400; Mid: $193,200; Senior: $230,000; Director: $272,100; VP: $235,000.

UT Southwestern Medical Center AI Hiring

UT Southwestern Medical Center has 2 open AI roles right now. They're hiring across AI/ML Engineer. Positions span Dallas, TX, US, Dallas, TX.

Location Context

Across all AI roles, 6% (580 positions) offer remote work, while 9,776 require on-site attendance. Top AI hiring metros: New York (3,785 roles, $222,480 median); San Francisco (3,262 roles, $261,300 median); Los Angeles (1,896 roles, $210,000 median).

Career Path

Common paths into AI/ML Engineer roles include Data Scientist, Software Engineer, Research Engineer.

From here, career progression typically leads toward ML Architect, AI Engineering Manager, Principal ML Engineer.

The fastest path into ML engineering is through software engineering with a self-directed ML education. A CS degree helps, but production engineering skills matter more than academic credentials. Build something that works, deploy it, and measure it. That portfolio project is worth more than a Coursera certificate. For career growth, the fork comes around the senior level: go deep on technical complexity (staff/principal track) or move into managing ML teams.

What to Expect in Interviews

Expect system design questions around ML pipelines: how you'd build a training pipeline for a specific use case, handle data drift, or design A/B testing infrastructure for model deployments. Coding rounds typically involve Python, with emphasis on data manipulation (pandas, numpy) and algorithm implementation. Take-home assignments often ask you to build an end-to-end ML pipeline from raw data to deployed model.

When evaluating opportunities: Companies that are serious about AI/ML hiring tend to post specific infrastructure details in the job description: the frameworks they use, their model serving stack, their data pipeline tools. Vague postings that just say 'ML experience required' without specifics are often companies that haven't figured out what they need yet.

AI Hiring Overview

The AI job market has 10,419 open positions tracked in our dataset. By seniority: 117 entry-level, 4,975 mid-level, 3,840 senior, and 1,487 leadership roles (Director, VP, C-Level). Remote roles make up 6% of the market (580 positions). The remaining 9,776 roles require on-site or hybrid attendance.

The market median for AI roles is $214,834. Top-quartile compensation starts at $266,000. The 90th percentile reaches $321,730. Highest-paying categories: AI Safety ($274,500 median, 90 roles); Research Engineer ($252,000 median, 580 roles); AI Engineering Manager ($250,811 median, 72 roles).

Demand for AI/ML Engineers has been strong and consistent. Unlike some AI roles that spike with hype cycles, ML engineering is a foundational need. Every company deploying AI models needs people who can keep them running, and the gap between research prototypes and production systems keeps growing.

The AI Job Market Today

The AI job market spans 10,419 open positions across 16 role categories. The largest categories by volume: AI/ML Engineer (7,849), AI Product Manager (516), AI Software Engineer (513). These three account for the majority of open positions, though smaller categories often have higher per-role compensation because of specialized skill requirements.

The seniority mix tells a story about where AI teams are in their maturity. Entry-level roles (117) are outnumbered by mid-level (4,975) and senior (3,840) positions, reflecting that most companies are past the 'build a team from scratch' phase and need experienced engineers who can ship production systems. Leadership roles (Director, VP, C-Level) total 1,487 positions, representing the bottleneck between technical execution and organizational strategy.

Remote work availability sits at 6% of all AI roles (580 positions), with 9,776 requiring on-site or hybrid attendance. The remote share has stabilized after the post-pandemic correction. Senior and specialized roles (Research Scientist, ML Architect) are more likely to be remote-eligible than entry-level positions, partly because experienced hires have more negotiating power and partly because these roles require less hands-on mentorship.

AI compensation is structured in clear tiers. The market median sits at $214,834. Top-quartile roles start at $266,000, and the 90th percentile reaches $321,730. These figures include base salary with disclosed compensation. Total compensation (including equity, bonuses, and sign-on) runs 20-40% higher at companies that offer those components.

Category matters for compensation. AI Safety roles lead at $274,500 median, while Prompt Engineer roles sit at $140,000. The spread between highest and lowest-paying categories reflects the premium on specialized technical skills versus broader analytical roles.

The most in-demand skills across all AI postings: Python (2,350 postings), Aws (1,173 postings), Azure (1,030 postings), Rag (986 postings), Gcp (714 postings), Pytorch (649 postings), Kubernetes (583 postings), Claude (581 postings). Python dominates, appearing in the vast majority of role descriptions regardless of category. Cloud platform experience (AWS, GCP, Azure) is the second most common requirement. The newer entrants to the top skills list (RAG, vector databases, LLM APIs) reflect the shift from traditional ML toward generative AI applications.

Frequently Asked Questions

Based on 16,346 roles with disclosed compensation, the median salary for AI/ML Engineer positions is $213,800. Actual compensation varies by seniority, location, and company stage.
Python and PyTorch dominate the requirements. Most roles expect experience with cloud platforms (AWS, GCP, or Azure) and familiarity with ML frameworks like TensorFlow or JAX. RAG (Retrieval-Augmented Generation) has become a top-3 skill requirement as companies integrate LLMs into their products. Docker and Kubernetes show up in about a third of postings, reflecting the production focus of the role.
About 6% of the 10,419 AI roles we track offer remote work. Remote availability varies by company and seniority level, with senior and leadership roles more likely to offer location flexibility.
UT Southwestern Medical Center is among the companies actively hiring for AI and ML talent. Check our company profiles for detailed breakdowns of open roles, salary ranges, and hiring trends.
Common next steps from AI/ML Engineer positions include ML Architect, AI Engineering Manager, Principal ML Engineer. Progression depends on whether you lean toward technical depth, people management, or product strategy.

Get Weekly AI Career Intelligence

Salary data, skills demand, and market signals from 16,000+ AI job postings. Every Monday.