Managing Director – Enterprise Architecture, Data & AI Governance

San Francisco, CA, US Mid Level AI/ML Engineer

Interested in this AI/ML Engineer role at Baker Tilly Canada?

Apply Now →

About This Role

AI job market dashboard showing open roles by category

Overview

Baker Tilly is a leading advisory, tax and assurance firm, providing clients with a genuine coast-to-coast and global advantage in major regions of the U.S. and in many of the world’s leading financial centers – New York, London, San Francisco, Los Angeles, Chicago and Boston. Baker Tilly Advisory Group, LP and Baker Tilly US, LLP (Baker Tilly) provide professional services through an alternative practice structure in accordance with the AICPA Code of Professional Conduct and applicable laws, regulations and professional standards. Baker Tilly US, LLP is a licensed independent CPA firm that provides attest services to its clients. Baker Tilly Advisory Group, LP and its subsidiary entities provide tax and business advisory services to their clients. Baker Tilly Advisory Group, LP and its subsidiary entities are not licensed CPA firms.

Baker Tilly Advisory Group, LP and Baker Tilly US, LLP, trading as Baker Tilly, are independent members of Baker Tilly International, a worldwide network of independent accounting and business advisory firms in 141 territories, with 43,000 professionals and a combined worldwide revenue of $5.2 billion. Visit bakertilly.com or join the conversation on LinkedIn, Facebook and Instagram.

Please discuss the work location status with your Baker Tilly talent acquisition professional to understand the requirements for an opportunity you are exploring.

Baker Tilly is an equal opportunity/affirmative action employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, disability or protected veteran status, gender identity, sexual orientation, or any other legally protected basis, in accordance with applicable federal, state or local law.

Any unsolicited resumes submitted through our website or to Baker Tilly Advisory Group, LP, employee e-mail accounts are considered property of Baker Tilly Advisory Group, LP, and are not subject to payment of agency fees. In order to be an authorized recruitment agency ("search firm") for Baker Tilly Advisory Group, LP, there must be a formal written agreement in place and the agency must be invited, by Baker Tilly's Talent Attraction team, to submit candidates for review via our applicant tracking system.

Job Description:

Baker Tilly is seeking a Managing Director – Enterprise Architecture, Data & AI Governance to lead the firm’s enterprise architecture function and establish the architectural and governance foundation required to scale technology, data, and artificial intelligence responsibly across the enterprise.

Reporting directly to the Chief Digital & Information Officer (CDIO), this leader will serve as the firm’s senior authority for enterprise architecture and will bring together Enterprise Architecture, Data Governance, and AI Governance into an integrated enterprise capability. The role will establish the standards, guardrails, decision rights, controls, and governance mechanisms that allow Baker Tilly to innovate rapidly while maintaining enterprise integrity, interoperability, security, data quality, responsible AI practices, operational sustainability, and the control discipline expected of a future publicly traded company.

As Baker Tilly prepares for the possibility of becoming a publicly traded company, this leader will help mature technology, data, and AI governance to public-company standards. The role will partner closely with Innovation, Finance, Risk, Legal, Privacy, Security, Internal Audit, and other control functions to establish durable evidence, accountability, traceability, and control practices that can withstand executive, board, auditor, regulator, and investor scrutiny.

This role is central to Baker Tilly’s evolving technology operating model. Enterprise Architecture will operate as an enabling enterprise function—not simply an architecture review body—providing reusable standards and patterns, engaging early with capability and product teams, governing critical architectural decisions, and creating clear paths that allow teams to move quickly within established enterprise guardrails.

A critical element of the mandate is maintaining a clear architectural seam between core Enterprise Technology and emerging AI Innovation in partnership with Baker Tilly’s AI Product Group (APG).

Strategic Mandate

  • Establish an integrated enterprise architecture function that defines Baker Tilly’s target technology architecture and provides clear standards, patterns, roadmaps, and guardrails across the technology estate.
  • Own enterprise Data & AI Governance, creating a coherent governance model covering enterprise data standards, responsible AI, risk-tiered AI and agent approval, architecture compliance, technology lifecycle management and production readiness.
  • Define and steward the enterprise data architecture, including the enterprise data foundation, data contracts, integration patterns, systems of record, data interoperability, and BTID as the firm’s client-data join key and source-of-truth mechanism.
  • Enable rather than impede technology delivery by embedding architecture and governance early in capability, platform, transformation, and AI product lifecycles and providing pre-approved patterns and pathways wherever practical.
  • Establish the architectural partnership between Enterprise Technology and the AI Product Group, ensuring that AI products can innovate rapidly while securely and sustainably operating at enterprise scale.
  • Reduce technology complexity and fragmentation by driving standardization, reuse, platform leverage, application rationalization, and alignment to target-state architecture.
  • Provide senior architectural leadership to the CDIO and enterprise leadership, translating technology, data, and AI architecture into clear business implications, investment choices, risks, and strategic opportunities.
  • Build public-company-ready technology, data, and AI governance capabilities, including clear control ownership in partnership with the Risk Organization, documented decision rights, evidence-based compliance, auditability, and disciplined oversight of technology and data risks.

Core Responsibilities

Enterprise Architecture Strategy & Leadership

  • Define and maintain Baker Tilly’s enterprise technology architecture, principles, standards, and target-state roadmaps.
  • Establish architecture across major domains including applications, platforms, cloud, integration, APIs, enterprise data and identity.
  • Create a coherent view of the firm’s current-state and target-state technology landscape and connect architectural roadmaps to business strategy, capability roadmaps, platform investments, and major transformation programs.
  • Identify opportunities to simplify the technology estate and reduce redundant applications, platforms, integrations, and architectural patterns.
  • Advise the CDIO and other senior stakeholders on significant architectural choices, technology investments, technical debt, and modernization priorities.
  • Maintain architecture decision records and mechanisms that make significant enterprise technology decisions transparent and durable.

Enterprise Data Architecture & Governance

  • Establish and steward the enterprise data architecture in partnership with Business Technology, Operational IT, APG, Security, and business stakeholders.
  • Define architectural standards for the enterprise data foundation, systems of record, data domains, data contracts, integration, APIs, metadata, lineage, quality, and interoperability.
  • Establish enterprise principles governing authoritative data sources, ownership, stewardship, quality, classification, access, retention, and lifecycle management.
  • Define and govern standards supporting BTID as the firm’s client-data source-of-truth and cross-platform join mechanism.
  • Ensure APG and other product teams can consume enterprise data through governed, scalable, published data contracts.

AI Governance & Responsible AI

  • Lead the enterprise AI Governance framework in partnership with Security, Risk, Legal, Compliance, APG, and other stakeholders.
  • Manage a risk-tiered governance model for AI systems and agents, allowing lower-risk experimentation to move quickly through pre-approved paths while applying appropriate scrutiny to higher-risk use cases.
  • Establish a single enterprise launch-gate approach applicable to internally developed AI, agents, vendor AI capabilities, and other AI-enabled systems.
  • Define governance standards covering AI risk classification, data use, privacy, security, model evaluation, human oversight, explainability, monitoring, and production readiness.
  • Partner with APG on evaluation and production criteria: APG develops product-specific evaluation approaches while Enterprise Architecture ratifies enterprise standards and production-gate requirements.
  • Maintain clear accountability between governance and engineering: governance defines the enterprise bar; product/capability and engineering teams remain accountable for designing and building solutions that meet it.

Architecture Governance & Production Readiness

  • Establish practical architecture governance integrated into Baker Tilly’s capability operating model and clarify architectural decision rights, including advisory versus approval authority.
  • Create reusable reference architectures, patterns, standards, and pre-approved approaches that allow teams to operate independently within enterprise guardrails.
  • Participate early in major product, platform, transformation, and capability roadmaps to identify architectural implications and dependencies before delivery commitments are made.
  • Establish architecture and non-functional requirements for scalability, deployment, integration, resilience, security, observability, supportability, and operational readiness.
  • Partner with Operational IT and APG to define and maintain the production handoff standard for new products and platforms.
  • Co-manage appropriate production gates and evaluate definition-of-done from an enterprise architecture and governance perspective.

Partnership with the AI Product Group

  • Serve as the principal enterprise architecture partner to the Chief AI and Technology Officer and AI Product Group.
  • Maintain the explicit architectural boundary: APG owns AI product architecture, agentic architecture, the AI intelligence substrate, ontology, knowledge graph, judgment layer, and product data architecture; Enterprise Architecture owns enterprise architecture, enterprise integration, systems-of-record architecture, enterprise data foundation architecture, enterprise standards, Data Governance, and AI Governance.
  • Partner with APG on agentic architecture through standards and gates rather than assuming design authority inside APG products.
  • Ensure AI products can transition cleanly from experimentation and product engineering into enterprise production and operations.
  • Help create reusable enterprise patterns so each new AI product becomes progressively easier, faster, and less expensive to scale.

Capability Operating Model Enablement

  • Position Enterprise Architecture as a horizontal enabling capability supporting product, platform, and service teams across TDIO.
  • Provide architects to capability teams as appropriate while maintaining enterprise consistency and an architecture community of practice.
  • Participate in Quarterly Technology Reviews and other cross-team planning mechanisms to identify architectural dependencies and constraints early.
  • Partner with Capability Owners and Technical Leads to translate enterprise architecture into actionable team-level guidance.
  • Establish interaction models that make it clear when teams can proceed independently, when consultation is required, and when enterprise approval is necessary.
  • Measure Enterprise Architecture success based on enablement, reuse, simplification, risk reduction, and business outcomes—not architecture-review volume.

Technology Simplification & Modernization

  • Establish an enterprise approach to technology and application rationalization.
  • Identify duplication, fragmentation, obsolete platforms, unnecessary customization, and opportunities for consolidation.
  • Drive greater reuse of enterprise platforms, APIs, integration services, data capabilities, and architectural patterns.
  • Partner with Strategy & Planning to connect architectural recommendations to portfolio and investment decisions.
  • Develop modernization roadmaps that balance business value, risk reduction, technical debt, cost, and organizational capacity.

Leadership & Organizational Development

  • Build and lead a high-performing Enterprise Architecture and Governance organization.
  • Develop enterprise, domain, solution, data, and governance talent appropriate to the future operating model.
  • Establish an architecture community of practice across TDIO and APG and create clear roles and career paths for architects.
  • Build a culture in which architects are viewed as strategic partners and enablers rather than reviewers operating outside delivery teams.

Public Company Readiness, Controls & Assurance

  • Lead the maturation of enterprise architecture, data, and AI governance practices to support Baker Tilly’s longer-term IPO and public-company readiness objectives.
  • Bring practical experience operating in, preparing for, or advising a publicly traded company, IPO candidate, or similarly rigorous regulated environment with mature technology controls and governance expectations.
  • Partner with Finance, Internal Audit, Risk, Legal, Privacy, Security, and Compliance to define technology and data controls that support financial reporting integrity, regulatory obligations, audit readiness, and executive/board oversight.
  • Ensure architecture and governance processes produce durable evidence of decisions, approvals, exceptions, risk acceptance, control execution, and remediation.
  • Establish clear ownership and traceability for systems of record, critical data, integrations, privileged access dependencies, change controls, third-party technology, and AI-enabled processes that could affect financial, operational, regulatory, or client outcomes.
  • Support technology-control readiness associated with public-company expectations, including IT general controls, automated/application controls, change management, access governance, data integrity, third-party risk, resilience, and control monitoring.
  • Provide credible technology, architecture, data, and AI governance leadership for board, audit committee, investor diligence, external audit, and other assurance activities as Baker Tilly’s governance model matures.

Innovation, Risk, Legal & Privacy Partnership

  • Create an intentional partnership with BT Labs, APG Design & Innovation, Applied AI, and product teams so architecture, privacy, legal, security, and responsible-AI considerations are incorporated from concept and experimentation through production scale.
  • Design governance pathways that protect experimentation velocity: low-risk concepts should have pre-approved patterns and lightweight controls, while higher-risk uses receive deeper review based on data sensitivity, client impact, autonomy, materiality, and regulatory exposure.
  • Partner with Legal, Privacy, Risk, and Security on data privacy and data protection requirements, including appropriate use, collection, classification, access, retention, sharing, cross-border considerations, vendor use, and protection of client, employee, and firm-confidential information.
  • Ensure innovation involving AI, data, models, agents, and third-party platforms has clear ownership for intellectual property, confidentiality, contractual obligations, data rights, acceptable use, human oversight, and production accountability.
  • Translate regulatory, legal, privacy, and risk requirements into practical architecture patterns and engineering guardrails rather than relying solely on downstream review.
  • Maintain a clear escalation and exception process for novel technologies where existing standards do not yet provide sufficient guidance, enabling informed risk-taking with documented accountability.

Key Organizational Interfaces

  • Chief Digital & Information Officer (CDIO): direct executive sponsor; alignment on enterprise technology strategy, architecture, investment, governance, and modernization.
  • Chief AI and Technology Officer (CAITO): peer technology organization leader with interactions focused on AI product architecture, enterprise standards, data, governance, and production scale.
  • AI Product Group: architectural standards, enterprise data contracts, AI governance, production gates, and enterprise integration.
  • Operational IT: cloud, infrastructure, workplace, support, deployment, reliability, observability, and operational architecture.
  • Business Technology: enterprise applications, systems of record, enterprise data foundation, and integration with core business processes.
  • Service-Line Technology: architectural guidance, standards, modernization, reuse, and integration across Tax, Assurance, Consulting, and Managed Services.
  • Security / CISO: security architecture, risk management, secure-by-design standards, and AI/data risk.
  • Strategy & Planning: portfolio planning, investment prioritization, QTRs, value realization, vendor strategy, and technology simplification.
  • Risk, Legal & Compliance: responsible AI, privacy, regulatory obligations, and enterprise governance requirements.

Required Experience

  • 15+ years of progressive leadership experience across enterprise architecture, technology strategy, data architecture, engineering, or related disciplines.
  • Bachelors Degree required.
  • Demonstrated leadership experience in a publicly traded company, IPO-readiness environment, or organization operating with comparable public-company control, audit, governance, and disclosure rigor; direct participation in IPO preparation or public-company technology/control maturation strongly preferred.
  • Working knowledge of public-company technology control expectations, including IT general controls, access and change controls, application/automated controls, evidence retention, auditability, control testing, remediation, and the technology implications of financial reporting controls.
  • Experience partnering credibly with CFO/Finance, Internal Audit, external audit, Risk, Legal, Privacy, Security, and Compliance functions on enterprise technology, data, and control matters.
  • Experience presenting technology risk, architecture, data governance, cyber/privacy dependencies, and control posture to executive leadership and, ideally, boards or audit/risk committees.
  • Demonstrated experience integrating data privacy and data protection requirements into architecture, data governance, vendor governance, cloud, analytics, and AI delivery practices.
  • Experience establishing governance for emerging technology and innovation that balances speed with legal, regulatory, privacy, security, intellectual-property, and reputational considerations.
  • Significant experience leading Enterprise Architecture in a complex, distributed, matrixed organization.
  • Demonstrated experience defining enterprise technology strategy and translating it into executable target-state architectures and modernization roadmaps.
  • Deep experience with enterprise data architecture, including modern cloud data platforms, integration patterns, APIs, data domains, data contracts, metadata, lineage, and governance.
  • Demonstrated experience establishing architecture governance that balances enterprise control with delivery speed and team autonomy.
  • Strong understanding of modern AI architectures, generative AI, agentic systems, AI platforms, and the governance implications of deploying AI in enterprise environments.
  • Experience developing or operating Data Governance and/or Responsible AI governance programs.
  • Demonstrated ability to establish enterprise standards while partnering effectively with autonomous product and engineering organizations.
  • Experience influencing major technology investment, modernization, simplification, and platform decisions.
  • Proven ability to operate effectively with senior executives, business leaders, architects, engineers, security leaders, risk professionals, and product teams.
  • Experience leading through significant organizational and operating-model transformation.
  • Experience in professional services, financial services, SaaS, or another highly regulated or data-intensive environment preferred.

Technical & Domain Competencies

  • Enterprise and domain architecture
  • Modern cloud and distributed architectures
  • Enterprise data architecture and modern data platforms
  • Data governance, metadata, lineage, quality, and stewardship
  • Integration architecture, APIs, and event-driven architecture
  • AI and generative AI architecture
  • Agentic AI patterns and governance
  • Responsible AI frameworks and model governance
  • Architecture governance and decision-rights frameworks
  • Application and technology portfolio rationalization
  • Platform engineering and DevOps concepts
  • Security and privacy architecture
  • Technology modernization and technical-debt management
  • Architecture tooling, repositories, standards, and roadmapping
  • Public-company / IPO technology governance and control readiness
  • IT general controls, automated/application controls, audit evidence, and control remediation
  • Data privacy, data protection, information lifecycle, and cross-border data considerations
  • Third-party technology, data, AI, and vendor risk governance

Leadership Attributes

  • Enterprise-minded: optimizes for the firm rather than individual platforms, functions, or organizational boundaries.
  • Enabling rather than bureaucratic: understands that good governance creates speed by making the safe path clear and reusable.
  • Technically credible: can engage deeply with architects and engineers while communicating implications clearly to executive leadership.
  • Pragmatic: distinguishes between decisions requiring enterprise control and decisions best left to empowered teams.
  • Strategic: connects architecture decisions to business strategy, investment choices, risk, operating leverage, and long-term enterprise value.
  • Collaborative: succeeds through influence across the CDIO, CAITO, Security, Risk, business, and technology organizations.
  • Decisive: willing to establish standards, resolve architectural ambiguity, and make difficult simplification decisions.
  • Future-oriented: understands how AI, agents, modern data architecture, and rapidly evolving technology will reshape enterprise architecture.
  • Talent builder: develops architects who combine technical depth, business acumen, communication skills, and an enterprise mindset.
  • Clear communicator: makes complex architecture, data, and AI topics understandable and actionable for executive stakeholders.

Success Metrics

  • Adoption and reuse of enterprise architecture standards and patterns.
  • Reduction in technology duplication, fragmentation, and unnecessary complexity.
  • Progress against target-state architecture and modernization roadmaps.
  • Improved architectural alignment of major technology investments.
  • Increased use of shared platforms, integration patterns, APIs, and enterprise data capabilities.
  • Improved quality, accessibility, interoperability, and governance of enterprise data.
  • Percentage of material AI initiatives operating through the defined risk-tiered governance framework.
  • Speed and predictability of AI and technology governance decisions.
  • Reduction in late-stage architecture, data, security, and operational-readiness issues.
  • Successful implementation and adoption of the production handoff standard.
  • Effectiveness of the architecture partnership between TDIO and APG.
  • Stakeholder confidence in Enterprise Architecture as an enabling strategic partner.
  • Measurable contribution to technology simplification, operational efficiency, risk reduction, and enterprise value creation.
  • Progress toward public-company-ready technology, data, and AI control maturity, with documented ownership, evidence, testing, and remediation mechanisms.
  • Reduction in material control gaps, repeat audit findings, privacy/data-protection exceptions, and unmanaged technology or AI risks.
  • Demonstrated ability to accelerate innovation through risk-tiered, pre-approved governance pathways while maintaining appropriate Legal, Risk, Privacy, and Security oversight.

The national pay rate range for this job position is $350,00-$550,000. Actual compensation is influenced by a variety of relevant factors including but not limited to applicant’s skills, prior experience, qualifications, degrees, professional certifications, work arrangements and geographic location. Baker Tilly offers a comprehensive compensation and benefits package to eligible employees.

Role Details

Title Managing Director – Enterprise Architecture, Data & AI Governance
Location San Francisco, CA, US
Category AI/ML Engineer
Experience Mid Level
Salary Not disclosed
Remote No

About This Role

AI/ML Engineers build and deploy machine learning models in production. They work across the full ML lifecycle: data pipelines, model training, evaluation, and serving infrastructure. The role has evolved significantly over the past two years. Where ML Engineers once spent most of their time on model architecture, the job now tilts heavily toward inference optimization, cost management, and integrating LLM capabilities into existing systems. Companies want engineers who can ship production systems, and the experimenter-only role is fading fast.

Day-to-day, you're writing training pipelines, debugging data quality issues, setting up evaluation frameworks, and figuring out why your model performs differently in staging than it did on your dev set. The best ML engineers are obsessive about reproducibility and measurement. They instrument everything. They know that a model is only as good as the data feeding it and the infrastructure serving it.

Across the 9,653 AI roles we're tracking, AI/ML Engineer positions make up 76% of the market. At Baker Tilly Canada, this role fits into their broader AI and engineering organization.

Demand for AI/ML Engineers has been strong and consistent. Unlike some AI roles that spike with hype cycles, ML engineering is a foundational need. Every company deploying AI models needs people who can keep them running, and the gap between research prototypes and production systems keeps growing.

What the Work Looks Like

A typical week might include: debugging a data pipeline that's silently dropping 3% of training examples, running A/B tests on a new model version, writing documentation for a feature flag system that lets you roll back model deployments, and reviewing a junior engineer's PR for a new evaluation metric. Meetings tend to be cross-functional since ML touches product, engineering, and data teams.

Demand for AI/ML Engineers has been strong and consistent. Unlike some AI roles that spike with hype cycles, ML engineering is a foundational need. Every company deploying AI models needs people who can keep them running, and the gap between research prototypes and production systems keeps growing.

Skills in Demand for This Role

Python (17% of roles) Aws (9% of roles) Azure (8% of roles) Rag (7% of roles) Gcp (5% of roles) Pytorch (5% of roles) Kubernetes (4% of roles) Claude (4% of roles)

Python and PyTorch dominate the requirements. Most roles expect experience with cloud platforms (AWS, GCP, or Azure) and familiarity with ML frameworks like TensorFlow or JAX. RAG (Retrieval-Augmented Generation) has become a top-3 skill requirement as companies integrate LLMs into their products. Docker and Kubernetes show up in about a third of postings, reflecting the production focus of the role.

Beyond the core stack, employers increasingly want experience with experiment tracking tools (MLflow, Weights & Biases), feature stores, and vector databases. Fine-tuning experience is valuable but less common than you'd think from reading Twitter. Most production LLM work is RAG and prompt engineering, not fine-tuning. If you have both, you're in a strong position.

Companies that are serious about AI/ML hiring tend to post specific infrastructure details in the job description: the frameworks they use, their model serving stack, their data pipeline tools. Vague postings that just say 'ML experience required' without specifics are often companies that haven't figured out what they need yet.

Compensation Benchmarks

AI/ML Engineer roles pay a median of $212,000 based on 11,857 positions with disclosed compensation. Director-level AI roles across all categories have a median of $272,275.

Across all AI roles, the market median is $213,400. Top-quartile compensation starts at $264,230. The 90th percentile reaches $319,400. For comparison, the highest-paying categories include AI Safety ($253,100) and Research Engineer ($252,000). By seniority level: Entry: $110,408; Mid: $193,200; Senior: $228,700; Director: $272,275; VP: $235,000.

Baker Tilly Canada AI Hiring

Baker Tilly Canada has 3 open AI roles right now. They're hiring across AI/ML Engineer. Positions span San Francisco, CA, US, Boston, MA, US, Santa Clara, CA, US. Compensation range: $405K - $550K.

Location Context

AI roles in San Francisco pay a median of $264,500 across 2,413 tracked positions. That's 24% above the national median.

Career Path

Common paths into AI/ML Engineer roles include Data Scientist, Software Engineer, Research Engineer.

From here, career progression typically leads toward ML Architect, AI Engineering Manager, Principal ML Engineer.

The fastest path into ML engineering is through software engineering with a self-directed ML education. A CS degree helps, but production engineering skills matter more than academic credentials. Build something that works, deploy it, and measure it. That portfolio project is worth more than a Coursera certificate. For career growth, the fork comes around the senior level: go deep on technical complexity (staff/principal track) or move into managing ML teams.

What to Expect in Interviews

Expect system design questions around ML pipelines: how you'd build a training pipeline for a specific use case, handle data drift, or design A/B testing infrastructure for model deployments. Coding rounds typically involve Python, with emphasis on data manipulation (pandas, numpy) and algorithm implementation. Take-home assignments often ask you to build an end-to-end ML pipeline from raw data to deployed model.

When evaluating opportunities: Companies that are serious about AI/ML hiring tend to post specific infrastructure details in the job description: the frameworks they use, their model serving stack, their data pipeline tools. Vague postings that just say 'ML experience required' without specifics are often companies that haven't figured out what they need yet.

AI Hiring Overview

The AI job market has 9,653 open positions tracked in our dataset. By seniority: 193 entry-level, 4,500 mid-level, 3,455 senior, and 1,505 leadership roles (Director, VP, C-Level). Remote roles make up 6% of the market (568 positions). The remaining 9,010 roles require on-site or hybrid attendance.

The market median for AI roles is $213,400. Top-quartile compensation starts at $264,230. The 90th percentile reaches $319,400. Highest-paying categories: AI Safety ($253,100 median, 57 roles); Research Engineer ($252,000 median, 419 roles); AI Engineering Manager ($251,622 median, 51 roles).

Demand for AI/ML Engineers has been strong and consistent. Unlike some AI roles that spike with hype cycles, ML engineering is a foundational need. Every company deploying AI models needs people who can keep them running, and the gap between research prototypes and production systems keeps growing.

The AI Job Market Today

The AI job market spans 9,653 open positions across 16 role categories. The largest categories by volume: AI/ML Engineer (7,301), Data Scientist (441), AI Software Engineer (438). These three account for the majority of open positions, though smaller categories often have higher per-role compensation because of specialized skill requirements.

The seniority mix tells a story about where AI teams are in their maturity. Entry-level roles (193) are outnumbered by mid-level (4,500) and senior (3,455) positions, reflecting that most companies are past the 'build a team from scratch' phase and need experienced engineers who can ship production systems. Leadership roles (Director, VP, C-Level) total 1,505 positions, representing the bottleneck between technical execution and organizational strategy.

Remote work availability sits at 6% of all AI roles (568 positions), with 9,010 requiring on-site or hybrid attendance. The remote share has stabilized after the post-pandemic correction. Senior and specialized roles (Research Scientist, ML Architect) are more likely to be remote-eligible than entry-level positions, partly because experienced hires have more negotiating power and partly because these roles require less hands-on mentorship.

AI compensation is structured in clear tiers. The market median sits at $213,400. Top-quartile roles start at $264,230, and the 90th percentile reaches $319,400. These figures include base salary with disclosed compensation. Total compensation (including equity, bonuses, and sign-on) runs 20-40% higher at companies that offer those components.

Category matters for compensation. AI Safety roles lead at $253,100 median, while Prompt Engineer roles sit at $141,440. The spread between highest and lowest-paying categories reflects the premium on specialized technical skills versus broader analytical roles.

The most in-demand skills across all AI postings: Python (1,605 postings), Aws (916 postings), Azure (724 postings), Rag (634 postings), Gcp (522 postings), Pytorch (495 postings), Kubernetes (384 postings), Claude (383 postings). Python dominates, appearing in the vast majority of role descriptions regardless of category. Cloud platform experience (AWS, GCP, Azure) is the second most common requirement. The newer entrants to the top skills list (RAG, vector databases, LLM APIs) reflect the shift from traditional ML toward generative AI applications.

Frequently Asked Questions

Based on 11,857 roles with disclosed compensation, the median salary for AI/ML Engineer positions is $212,000. Actual compensation varies by seniority, location, and company stage.
Python and PyTorch dominate the requirements. Most roles expect experience with cloud platforms (AWS, GCP, or Azure) and familiarity with ML frameworks like TensorFlow or JAX. RAG (Retrieval-Augmented Generation) has become a top-3 skill requirement as companies integrate LLMs into their products. Docker and Kubernetes show up in about a third of postings, reflecting the production focus of the role.
About 6% of the 9,653 AI roles we track offer remote work. Remote availability varies by company and seniority level, with senior and leadership roles more likely to offer location flexibility.
Baker Tilly Canada is among the companies actively hiring for AI and ML talent. Check our company profiles for detailed breakdowns of open roles, salary ranges, and hiring trends.
Common next steps from AI/ML Engineer positions include ML Architect, AI Engineering Manager, Principal ML Engineer. Progression depends on whether you lean toward technical depth, people management, or product strategy.

Get Weekly AI Career Intelligence

Salary data, skills demand, and market signals from 16,000+ AI job postings. Every Monday.