Interested in this Data Scientist role at IT Tech Direct/TechPerm?
Apply Now →Skills & Technologies
About This Role
Data Scientist/Engineer with strong Databricks SME
Overview
We are seeking a highly skilled Data Scientist with deep AI expertise to join our team. You will leverage the Databricks Data Intelligence Platform to design, build, and deploy advanced machine learning models and AI\-driven solutions. This role is ideal for a Python expert who thrives at the intersection of big data, distributed computing, and cutting\-edge artificial intelligence.
About the Role
This role involves leveraging advanced machine learning models and AI\-driven solutions to address complex business problems.
Responsibilities
- AI/ML Model Development: Design and train machine learning models using various algorithms, including deep learning, NLP, and computer vision.
- Databricks Orchestration: Build and optimize end\-to\-end AI/ML pipelines on Databricks, utilizing Unity Catalog for governance and MLflow for experiment tracking.
- Generative AI \& LLMs: Implement advanced AI patterns such as Retrieval\-Augmented Generation (RAG) and fine\-tune pre\-trained models for specific enterprise tasks.
- Python Expertise: Write production\-quality, idiomatic PySpark and Python code that leverages Spark’s distributed nature.
- Collaboration: Partner with Engineering and Product teams to translate business problems into scalable analytical solutions.
- Insight Extraction: Perform exploratory data analysis (EDA) and extract meaningful insights from massive, complex datasets to drive strategic decisions.
Qualifications
- Education: MS or PhD in a quantitative field such as Computer Science, Statistics, or Math.
- Experience: 5\+ years of hands\-on experience in data science or AI engineering in high\-growth environments.
Required Skills
- Technical Proficiency: Expert\-level Python (pandas, NumPy, scikit\-learn, PySpark).
- Extensive experience with Apache Spark for large\-scale data processing.
- Proficiency in SQL for data manipulation and querying in Lakehouse environments.
- AI Foundations: Strong understanding of statistics, probability, and advanced ML lifecycle management (MLOps).
Preferred Skills
- Experience with Deep Learning frameworks (TensorFlow, PyTorch).
- Familiarity with Cloud Platforms (AWS, Azure, or GCP) and their native data services.
- Databricks certifications, such as Databricks Certified Machine Learning Professional.
Pay: $120,000\.00 per year
Benefits:
- Employee assistance program
- Health insurance
- Paid time off
Education:
- Master's (Required)
Language:
- English (Required)
Security clearance:
- Confidential (Preferred)
Work Location: In person
Role Details
About This Role
Data Scientists extract insights and build predictive models from data. In the AI era, many roles now include LLM-powered analytics, automated reporting, and integration with generative AI tools. The role has evolved from 'the person who runs SQL queries' to 'the person who builds AI-powered data products.'
Modern data science roles fall into two camps: analytics-focused (insights, dashboards, experimentation) and ML-focused (building predictive models, recommendation systems, NLP features). The best data scientists can operate in both modes. The AI shift means that even analytics-focused roles now involve building automated insight pipelines using LLMs, going well beyond one-off reports.
Across the 3,824 AI roles we're tracking, Data Scientist positions make up 7% of the market. At IT Tech Direct/TechPerm, this role fits into their broader AI and engineering organization.
Data Scientist roles remain in high demand, though the definition keeps shifting. Companies increasingly want candidates who can bridge traditional statistics with modern ML and LLM capabilities. The 'pure insights' data scientist role is consolidating into analytics engineering, while the 'build models' data scientist role is merging with ML engineering.
What the Work Looks Like
A typical week includes: analyzing experiment results for a product feature launch, building a predictive model for customer churn, creating an automated reporting pipeline using LLM-powered summarization, presenting insights to stakeholders, and cleaning data (always cleaning data). The ratio of analysis to engineering varies by company, but expect both.
Data Scientist roles remain in high demand, though the definition keeps shifting. Companies increasingly want candidates who can bridge traditional statistics with modern ML and LLM capabilities. The 'pure insights' data scientist role is consolidating into analytics engineering, while the 'build models' data scientist role is merging with ML engineering.
Skills Required
Python, SQL, and statistical modeling are the foundation. Increasingly, roles want experience with LLMs for data analysis, automated insight generation, and building AI-powered data products. Familiarity with cloud data platforms (Snowflake, BigQuery, Databricks) and ML frameworks (scikit-learn, PyTorch) covers most job requirements.
Experimentation design and causal inference are underrated skills that separate strong candidates. Companies care about whether their product changes cause improvements, and can distinguish causation from correlation. A/B testing methodology, Bayesian statistics, and the ability to communicate uncertainty to non-technical stakeholders are high-value skills.
Good postings specify the data stack, the types of problems you'll work on, and the team structure. Look for companies that differentiate between analytics and ML data science. Vague 'data scientist' postings that list every skill under the sun usually mean the company doesn't know what they need.
Compensation Benchmarks
Data Scientist roles pay a median of $200,000 based on 697 positions with disclosed compensation. Mid-level AI roles across all categories have a median of $160,000.
Across all AI roles, the market median is $200,000. Top-quartile compensation starts at $253,000. The 90th percentile reaches $307,500. For comparison, the highest-paying categories include AI Engineering Manager ($293,500) and AI Safety ($274,200). By seniority level: Entry: $97,380; Mid: $160,000; Senior: $227,400; Director: $243,000; VP: $250,000.
IT Tech Direct/TechPerm AI Hiring
IT Tech Direct/TechPerm has 1 open AI role right now. They're hiring across Data Scientist. Based in Baltimore, MD, US.
Location Context
Across all AI roles, 16% (613 positions) offer remote work, while 3,187 require on-site attendance. Top AI hiring metros: New York (2,448 roles, $210,000 median); San Francisco (1,990 roles, $253,000 median); Los Angeles (1,686 roles, $189,000 median).
Career Path
Common paths into Data Scientist roles include Data Analyst, Statistician, Quantitative Researcher.
From here, career progression typically leads toward Senior Data Scientist, ML Engineer, AI Product Manager.
Start with statistics and SQL. Build a real analysis project on public data that demonstrates insight generation alongside model building. The market values data scientists who can communicate findings clearly to business stakeholders. If you want to move toward ML engineering, invest in software engineering fundamentals and production deployment skills.
What to Expect in Interviews
Interviews combine statistics, coding, and business acumen. SQL is almost always tested, often with complex joins and window functions. Expect a case study round where you're given a business problem and asked to design an analysis plan. Coding rounds focus on pandas, statistical modeling, and visualization. The strongest differentiator is how well you communicate insights to non-technical stakeholders during presentation rounds.
When evaluating opportunities: Good postings specify the data stack, the types of problems you'll work on, and the team structure. Look for companies that differentiate between analytics and ML data science. Vague 'data scientist' postings that list every skill under the sun usually mean the company doesn't know what they need.
AI Hiring Overview
The AI job market has 3,824 open positions tracked in our dataset. By seniority: 119 entry-level, 1,813 mid-level, 1,472 senior, and 420 leadership roles (Director, VP, C-Level). Remote roles make up 16% of the market (613 positions). The remaining 3,187 roles require on-site or hybrid attendance.
The market median for AI roles is $200,000. Top-quartile compensation starts at $253,000. The 90th percentile reaches $307,500. Highest-paying categories: AI Engineering Manager ($293,500 median, 31 roles); AI Safety ($274,200 median, 51 roles); Research Engineer ($260,000 median, 401 roles).
Data Scientist roles remain in high demand, though the definition keeps shifting. Companies increasingly want candidates who can bridge traditional statistics with modern ML and LLM capabilities. The 'pure insights' data scientist role is consolidating into analytics engineering, while the 'build models' data scientist role is merging with ML engineering.
The AI Job Market Today
The AI job market spans 3,824 open positions across 15 role categories. The largest categories by volume: AI/ML Engineer (2,702), Data Scientist (281), AI Software Engineer (258). These three account for the majority of open positions, though smaller categories often have higher per-role compensation because of specialized skill requirements.
The seniority mix tells a story about where AI teams are in their maturity. Entry-level roles (119) are outnumbered by mid-level (1,813) and senior (1,472) positions, reflecting that most companies are past the 'build a team from scratch' phase and need experienced engineers who can ship production systems. Leadership roles (Director, VP, C-Level) total 420 positions, representing the bottleneck between technical execution and organizational strategy.
Remote work availability sits at 16% of all AI roles (613 positions), with 3,187 requiring on-site or hybrid attendance. The remote share has stabilized after the post-pandemic correction. Senior and specialized roles (Research Scientist, ML Architect) are more likely to be remote-eligible than entry-level positions, partly because experienced hires have more negotiating power and partly because these roles require less hands-on mentorship.
AI compensation is structured in clear tiers. The market median sits at $200,000. Top-quartile roles start at $253,000, and the 90th percentile reaches $307,500. These figures include base salary with disclosed compensation. Total compensation (including equity, bonuses, and sign-on) runs 20-40% higher at companies that offer those components.
Category matters for compensation. AI Engineering Manager roles lead at $293,500 median, while Prompt Engineer roles sit at $142,800. The spread between highest and lowest-paying categories reflects the premium on specialized technical skills versus broader analytical roles.
The most in-demand skills across all AI postings: Python (1,968 postings), Aws (1,203 postings), Azure (882 postings), Rag (877 postings), Gcp (735 postings), Prompt Engineering (587 postings), Pytorch (586 postings), Claude (554 postings). Python dominates, appearing in the vast majority of role descriptions regardless of category. Cloud platform experience (AWS, GCP, Azure) is the second most common requirement. The newer entrants to the top skills list (RAG, vector databases, LLM APIs) reflect the shift from traditional ML toward generative AI applications.
Frequently Asked Questions
Get Weekly AI Career Intelligence
Salary data, skills demand, and market signals from 16,000+ AI job postings. Every Monday.