Director of Data Engineering - QuantumBlack, AI by McKinsey

Atlanta, GA, US Mid Level Data Engineer

Interested in this Data Engineer role at McKinsey & Company?

Apply Now →

Skills & Technologies

AwsAzureDockerGcpKubernetesTypescript

About This Role

AI job market dashboard showing open roles by category

Job ID: 110855

Atlanta

Boston

Charlotte

Chicago

Cleveland

Columbus

Connecticut \- Darien

\+ 16 More

Do you want to do work that matters, alongside supportive leaders who will help you grow faster than you ever thought possible? Are you a creative problem\-solver who is energized by challenges? You’ve come to the right place.

YOUR IMPACT

You will lead multiple technical and cross\-functional teams, architecting and owning the full\-stack technology platform \- from front\-end client\-facing applications through back\-end services to the underlying data and AI infrastructure.

You’ll design and build robust, scalable, and reproducible platforms and pipelines for machine learning and production software, while ensuring information security standards are upheld across the stack. You’ll manage large internal engineering teams, set technical direction, mentor senior and junior colleagues alike, and drive innovation within the QuantumBlack, AI by McKinsey Engineering community.

Partnering with QuantumBlack, AI by McKinsey and QuantumBlack Labs teams and serving as the primary technical relationship owner for client engagements, you’ll help create innovative, full\-stack machine learning and software systems that accelerate AI adoption and solve business problems at speed and scale \- enabling clients to achieve meaningful and lasting impact.

Your work will address real\-world challenges across industries. You’ll lead cross\-functional Agile teams spanning Data Engineers, Full\-Stack/Software Engineers, Data Scientists, and Machine Learning Engineers to deliver advanced analytics and software solutions. You will own the client relationship at a senior\-stakeholder level \- from data owners through C\-level executives \- architecting solutions that solve complex business problems and drive measurable value.

Your work offers an exceptional environment to grow as a technology leader \- developing expertise at the intersection of technology, people leadership, and business, across a broad engineering scope that spans the full stack of client\-facing software delivery, not just data engineering.

YOUR GROWTH

Driving lasting impact and building long\-term capabilities with our clients is not easy work. You are the kind of person who thrives in a high performance/high reward culture \- doing hard things, picking yourself up when you stumble, and having the resilience to try another way forward.

In return for your drive, determination, and curiosity, we'll provide the resources, mentorship, and opportunities you need to become a stronger leader faster than you ever thought possible. Your colleagues—at all levels—will invest deeply in your development, just as much as they invest in delivering exceptional results for clients. Every day, you'll receive apprenticeship, coaching, and exposure that will accelerate your growth in ways you won’t find anywhere else.

When you join us, you will have:

  • Continuous learning: Our learning and apprenticeship culture, backed by structured programs, is all about helping you grow while creating an environment where feedback is clear, actionable, and focused on your development. The real magic happens when you take the input from others to heart and embrace the fast\-paced learning experience, owning your journey.
  • A voice that matters: From day one, we value your ideas and contributions. You’ll make a tangible impact by offering innovative ideas and practical solutions, all while upholding our unwavering commitment to ethics and integrity. We not only encourage diverse perspectives, but they are critical in driving us toward the best possible outcomes.
  • Global community: With colleagues across 65\+ countries and over 100 different nationalities, our firm’s diversity fuels creativity and helps us come up with the best solutions for our clients. Plus, you’ll have the opportunity to learn from exceptional colleagues with diverse backgrounds and experiences.
  • World\-class benefits: On top of a competitive salary (based on your location, experience, and skills), we provide a comprehensive benefits package to enable holistic well\-being for you and your family.

YOUR QUALIFICATIONS AND SKILLS

Degree in Computer Science, Engineering, Mathematics, or equivalent experience.

12\+ years of relevant professional experience, including experience managing large engineering teams (multiple pods/squads, 20\+ engineers) as a people leader \- not only as a technical lead

Proven experience architecting and building full\-stack platforms \- front\-end (e.g., React, Angular, TypeScript), back\-end services and APIs, and data/AI infrastructure \- for enterprise\-scale, production use cases

Ability to scope multi\-workstream programs, define technical roadmaps, and align engineering delivery to client business outcomes

Track record of directly managing and developing engineering managers and senior engineers, including performance management, hiring, and career development at scale

Expertise in distributed computing frameworks (e.g., Spark, Dask), cloud platforms (AWS, Azure, GCP), containerization (Docker, Kubernetes), and modern full\-stack frameworks

Extensive senior client\-facing experience \- able to independently own and grow C\-level and senior\-executive client relationships, not just execute against a scope defined by others

Ability to write clean, maintainable, scalable, and robust code across the stack (front\-end and back\-end), and to set engineering standards and review practices for large teams

Exceptional time management and program leadership skills in a complex, largely autonomous, multi\-team environment

Willingness to travel

Strong communication skills, both verbal and written, with the ability to represent engineering strategy to both technical and executive audiences

Please review the additional requirements regarding essential job functions of McKinsey colleagues.

Our unwavering commitment to integrity drives everything we do, guiding us to always act in the best interests of our clients, our people, and the communities we serve.

Role Details

Title Director of Data Engineering - QuantumBlack, AI by McKinsey
Location Atlanta, GA, US
Category Data Engineer
Experience Mid Level
Salary Not disclosed
Remote No

About This Role

Data Engineers build the pipelines that feed AI models. They design ETL workflows, manage data lakes, and ensure training and inference data is clean, timely, and accessible. Without good data engineering, AI projects fail. It's that simple.

The AI era has expanded the data engineer's scope far beyond batch ETL jobs. You're building real-time embedding pipelines for RAG systems, managing vector databases, ensuring training data quality at scale, and building the infrastructure that lets ML teams iterate on data as fast as they iterate on models. Data quality is the biggest predictor of model quality, and you're the person responsible for it.

Across the 4,317 AI roles we're tracking, Data Engineer positions make up 1% of the market. At McKinsey & Company, this role fits into their broader AI and engineering organization.

Data Engineer demand in AI contexts is strong and growing. Every company building AI needs clean, reliable data pipelines. The shift toward real-time AI applications (chatbots, recommendation engines, agent systems) means data engineering is more critical than ever. Companies are willing to pay premium salaries for data engineers with AI/ML pipeline experience.

What the Work Looks Like

A typical week includes: debugging a data pipeline that's producing stale embeddings for the RAG system, optimizing a Spark job that processes training data, building a data quality monitoring dashboard, meeting with the ML team to understand their next data requirements, and writing dbt models that transform raw event data into ML-ready features. The work is deeply technical and high-impact.

Data Engineer demand in AI contexts is strong and growing. Every company building AI needs clean, reliable data pipelines. The shift toward real-time AI applications (chatbots, recommendation engines, agent systems) means data engineering is more critical than ever. Companies are willing to pay premium salaries for data engineers with AI/ML pipeline experience.

Skills Required

Aws (28% of roles) Azure (22% of roles) Docker (10% of roles) Gcp (15% of roles) Kubernetes (13% of roles) Typescript (7% of roles)

SQL, Python, and distributed systems (Spark, Airflow, dbt) are core. Cloud data platforms (Snowflake, BigQuery, Redshift) are increasingly standard. Many AI-focused roles also want familiarity with vector databases and embedding pipelines. Understanding data modeling, pipeline orchestration, and data quality frameworks covers the essentials.

AI-specific data engineering skills include: building feature stores, managing training data versioning, implementing data lineage tracking, and building real-time embedding pipelines. Experience with streaming systems (Kafka, Flink) is valuable for real-time AI applications. Understanding ML data requirements (balanced datasets, data augmentation, evaluation set construction) makes you much more effective working with ML teams.

Strong postings specify the data stack, mention ML pipeline work, and describe the scale of data you'll be working with. Look for companies that understand the connection between data quality and model quality. Avoid roles that conflate data engineering with data analysis.

Compensation Benchmarks

Data Engineer roles pay a median of $185,000 based on 83 positions with disclosed compensation. Director-level AI roles across all categories have a median of $274,554.

Across all AI roles, the market median is $215,000. Top-quartile compensation starts at $266,300. The 90th percentile reaches $320,790. For comparison, the highest-paying categories include AI Safety ($287,500) and Research Engineer ($272,100). By seniority level: Entry: $110,000; Mid: $194,400; Senior: $227,400; Director: $274,554; VP: $241,000.

McKinsey & Company AI Hiring

McKinsey & Company has 5 open AI roles right now. They're hiring across Data Engineer, AI Software Engineer, Data Scientist. Positions span Atlanta, GA, US, Boston, MA, US.

Location Context

Across all AI roles, 15% (635 positions) offer remote work, while 3,657 require on-site attendance. Top AI hiring metros: New York (1,650 roles, $220,000 median); San Francisco (1,335 roles, $265,000 median); Los Angeles (708 roles, $214,112 median).

Career Path

Common paths into Data Engineer roles include Backend Engineer, Database Administrator, Analytics Engineer.

From here, career progression typically leads toward Senior Data Engineer, ML Engineer, Data Platform Lead.

Master SQL and Python first. Then learn a distributed processing framework (Spark or its modern alternatives) and a pipeline orchestrator (Airflow, Dagster, Prefect). Build a portfolio project that demonstrates end-to-end pipeline construction: ingest, transform, validate, serve. If you want to specialize in AI data engineering, add vector databases and embedding pipelines to your skill set.

What to Expect in Interviews

Expect SQL deep-dives (query optimization, partitioning strategies, data modeling), Python coding focused on data pipeline patterns, and system design questions about building scalable ETL workflows. Companies with ML teams will ask about feature stores, embedding pipelines, and training data management. Be ready to discuss data quality monitoring, pipeline orchestration, and how you'd handle schema evolution in a production data lake.

When evaluating opportunities: Strong postings specify the data stack, mention ML pipeline work, and describe the scale of data you'll be working with. Look for companies that understand the connection between data quality and model quality. Avoid roles that conflate data engineering with data analysis.

AI Hiring Overview

The AI job market has 4,317 open positions tracked in our dataset. By seniority: 138 entry-level, 2,071 mid-level, 1,655 senior, and 453 leadership roles (Director, VP, C-Level). Remote roles make up 15% of the market (635 positions). The remaining 3,657 roles require on-site or hybrid attendance.

The market median for AI roles is $215,000. Top-quartile compensation starts at $266,300. The 90th percentile reaches $320,790. Highest-paying categories: AI Safety ($287,500 median, 34 roles); Research Engineer ($272,100 median, 227 roles); AI Engineering Manager ($244,000 median, 23 roles).

Data Engineer demand in AI contexts is strong and growing. Every company building AI needs clean, reliable data pipelines. The shift toward real-time AI applications (chatbots, recommendation engines, agent systems) means data engineering is more critical than ever. Companies are willing to pay premium salaries for data engineers with AI/ML pipeline experience.

The AI Job Market Today

The AI job market spans 4,317 open positions across 15 role categories. The largest categories by volume: AI/ML Engineer (3,004), Data Scientist (345), AI Software Engineer (309). These three account for the majority of open positions, though smaller categories often have higher per-role compensation because of specialized skill requirements.

The seniority mix tells a story about where AI teams are in their maturity. Entry-level roles (138) are outnumbered by mid-level (2,071) and senior (1,655) positions, reflecting that most companies are past the 'build a team from scratch' phase and need experienced engineers who can ship production systems. Leadership roles (Director, VP, C-Level) total 453 positions, representing the bottleneck between technical execution and organizational strategy.

Remote work availability sits at 15% of all AI roles (635 positions), with 3,657 requiring on-site or hybrid attendance. The remote share has stabilized after the post-pandemic correction. Senior and specialized roles (Research Scientist, ML Architect) are more likely to be remote-eligible than entry-level positions, partly because experienced hires have more negotiating power and partly because these roles require less hands-on mentorship.

AI compensation is structured in clear tiers. The market median sits at $215,000. Top-quartile roles start at $266,300, and the 90th percentile reaches $320,790. These figures include base salary with disclosed compensation. Total compensation (including equity, bonuses, and sign-on) runs 20-40% higher at companies that offer those components.

Category matters for compensation. AI Safety roles lead at $287,500 median, while Prompt Engineer roles sit at $145,000. The spread between highest and lowest-paying categories reflects the premium on specialized technical skills versus broader analytical roles.

The most in-demand skills across all AI postings: Python (2,249 postings), Aws (1,224 postings), Azure (938 postings), Rag (915 postings), Gcp (660 postings), Pytorch (640 postings), Prompt Engineering (624 postings), Kubernetes (559 postings). Python dominates, appearing in the vast majority of role descriptions regardless of category. Cloud platform experience (AWS, GCP, Azure) is the second most common requirement. The newer entrants to the top skills list (RAG, vector databases, LLM APIs) reflect the shift from traditional ML toward generative AI applications.

Frequently Asked Questions

Based on 83 roles with disclosed compensation, the median salary for Data Engineer positions is $185,000. Actual compensation varies by seniority, location, and company stage.
SQL, Python, and distributed systems (Spark, Airflow, dbt) are core. Cloud data platforms (Snowflake, BigQuery, Redshift) are increasingly standard. Many AI-focused roles also want familiarity with vector databases and embedding pipelines. Understanding data modeling, pipeline orchestration, and data quality frameworks covers the essentials.
About 15% of the 4,317 AI roles we track offer remote work. Remote availability varies by company and seniority level, with senior and leadership roles more likely to offer location flexibility.
McKinsey & Company is among the companies actively hiring for AI and ML talent. Check our company profiles for detailed breakdowns of open roles, salary ranges, and hiring trends.
Common next steps from Data Engineer positions include Senior Data Engineer, ML Engineer, Data Platform Lead. Progression depends on whether you lean toward technical depth, people management, or product strategy.

Get Weekly AI Career Intelligence

Salary data, skills demand, and market signals from 16,000+ AI job postings. Every Monday.