Interested in this Data Scientist role at Alpaca?
Apply Now →Skills & Technologies
About This Role
Who We Are:
Alpaca is a US-headquartered, global leader in agent-first brokerage infrastructure for stocks, ETFs, options, crypto, fixed income, 24/5 trading, and more.
Amongst our subsidiaries, Alpaca is a licensed financial services company, serving hundreds of financial institutions across 40 countries with our institutional-grade APIs. This includes broker-dealers, investment advisors, wealth managers, hedge funds, and crypto exchanges, totalling over 10 million brokerage accounts.
Our global team is a diverse group of experienced engineers, traders, and brokerage professionals who are working to achieve our mission of opening financial services to everyone on the planet. We're deeply committed to open-source contributions and fostering a vibrant community, continuously enhancing our award-winning, developer-friendly API and the robust infrastructure behind it.
Alpaca is proudly backed by $400 million in funding from top-tier global investors including Portage Ventures, Spark Capital, Tribe Capital, Social Leverage, Horizons Ventures, Opera Tech Ventures, SBI Group, Derayah Financial, Unbound, Peak XV, Elefund, and Y Combinator.
Our Team Members:
We're a dynamic team of 400+ globally distributed members who thrive working from our favorite places around the world, with teammates spanning the USA, Canada, Japan, Hungary, Nigeria, Brazil, the UK, and beyond!
We're searching for passionate individuals eager to contribute to Alpaca's rapid growth. If you align with our core values—Stay Curious, Have Empathy, and Be Accountable—and are ready to make a significant impact, we encourage you to apply.
Your Role: We're looking for a Senior Data Scientist, AI Evaluation to design how Alpaca measures whether our models and agents are actually right. You'll be a senior individual contributor who turns ambiguous quality questions into ground truth, scoring methods, and eval loops that the company can trust—and uses those results to make the systems better. You'll build on an established data foundation, so the focus is raising quality and speeding up safe rollout. You'll own the quality bar, independent of the teams that build and optimize those systems.
This role is for someone who cares as much about whether an answer is correct as about whether a model can generate one. You'll partner with Product, Engineering, Analytics Engineering, and business stakeholders to define what "good" looks like, build the evaluations that test it, and close the loop so evals drive iteration. If you have a strong quantitative background, have shipped rigorous, measurable work (evaluation, experimentation, or model validation), and want ownership over a greenfield eval practice at a fast-growing brokerage-infrastructure company, this is the role.
What You'll Do
- Design AI evaluations: Define ground truth, metrics, and scoring methods for models and agents.
- Build repeatable eval loops: Track quality over time and catch regressions before release.
- Partner on infrastructure: Work with engineering and analytics engineering to operationalize eval harnesses.
- Drive iteration: Translate eval results into actionable recommendations for system improvements.
- Establish quality standards: Set evaluation guidelines, documentation, and review practices.
- Mentor and align: Foster evaluation best practices and build a culture of measurable AI quality across the team.
What We're Looking For
- Track record of quantitative measurement rigor (e.g., LLM/model evaluation, metric validation, or experimentation).
- Strong statistical and ML foundation—you treat evaluations as experiments (sample sizing, confidence intervals, significance, handling non-determinism) and validate automated graders against human ground truth.
- Proficiency in Python and SQL, with experience evaluating models in production environments.
- Strong judgment in defining quality metrics and ground truth for ambiguous outputs.
- Excellent communication and cross-functional collaboration skills to align technical teams and leadership.
- Strong problem-solving ability in fast-paced, greenfield environments.
- 6–10 years in quantitative data science or ML, with focused experience in measurement or evaluation. A quantitative degree is a plus; equivalent industry experience is equally welcome.
Nice to Have
- Hands-on LLM/agent evaluation in production, including eval harnesses, LLM-as-judge calibration, and CI regression gates.
- Experience evaluating text-to-SQL, analytics agents, or other systems where correctness is verifiable against data.
- Background in fintech, brokerage, or other domains where a wrong answer has real business or risk consequences.
- Fluency with AI tools in research and engineering workflows.
How We Take Care of You:
- Competitive Salary & Stock Options
- Health Benefits
- New Hire Home-Office Setup: One-time USD $500
- Monthly Stipend: USD $150 per month via a Brex Card
Alpaca is proud to be an equal opportunity workplace dedicated to pursuing and hiring a diverse workforce.
Recruitment Privacy Policy
Role Details
About This Role
Data Scientists extract insights and build predictive models from data. In the AI era, many roles now include LLM-powered analytics, automated reporting, and integration with generative AI tools. The role has evolved from 'the person who runs SQL queries' to 'the person who builds AI-powered data products.'
Modern data science roles fall into two camps: analytics-focused (insights, dashboards, experimentation) and ML-focused (building predictive models, recommendation systems, NLP features). The best data scientists can operate in both modes. The AI shift means that even analytics-focused roles now involve building automated insight pipelines using LLMs, going well beyond one-off reports.
Across the 9,079 AI roles we're tracking, Data Scientist positions make up 4% of the market. At Alpaca, this role fits into their broader AI and engineering organization.
Data Scientist roles remain in high demand, though the definition keeps shifting. Companies increasingly want candidates who can bridge traditional statistics with modern ML and LLM capabilities. The 'pure insights' data scientist role is consolidating into analytics engineering, while the 'build models' data scientist role is merging with ML engineering.
What the Work Looks Like
A typical week includes: analyzing experiment results for a product feature launch, building a predictive model for customer churn, creating an automated reporting pipeline using LLM-powered summarization, presenting insights to stakeholders, and cleaning data (always cleaning data). The ratio of analysis to engineering varies by company, but expect both.
Data Scientist roles remain in high demand, though the definition keeps shifting. Companies increasingly want candidates who can bridge traditional statistics with modern ML and LLM capabilities. The 'pure insights' data scientist role is consolidating into analytics engineering, while the 'build models' data scientist role is merging with ML engineering.
Skills Required
Python, SQL, and statistical modeling are the foundation. Increasingly, roles want experience with LLMs for data analysis, automated insight generation, and building AI-powered data products. Familiarity with cloud data platforms (Snowflake, BigQuery, Databricks) and ML frameworks (scikit-learn, PyTorch) covers most job requirements.
Experimentation design and causal inference are underrated skills that separate strong candidates. Companies care about whether their product changes cause improvements, and can distinguish causation from correlation. A/B testing methodology, Bayesian statistics, and the ability to communicate uncertainty to non-technical stakeholders are high-value skills.
Good postings specify the data stack, the types of problems you'll work on, and the team structure. Look for companies that differentiate between analytics and ML data science. Vague 'data scientist' postings that list every skill under the sun usually mean the company doesn't know what they need.
Compensation Benchmarks
Data Scientist roles pay a median of $190,000 based on 1,503 positions with disclosed compensation. Senior-level AI roles across all categories have a median of $229,300.
Across all AI roles, the market median is $213,000. Top-quartile compensation starts at $263,911. The 90th percentile reaches $318,400. For comparison, the highest-paying categories include AI Safety ($256,000) and Research Engineer ($252,000). By seniority level: Entry: $111,000; Mid: $193,200; Senior: $229,300; Director: $272,300; VP: $235,830.
Alpaca AI Hiring
Alpaca has 2 open AI roles right now. They're hiring across Data Scientist. Positions span New York, NY, US, New York, NY.
Location Context
AI roles in New York pay a median of $221,000 across 3,078 tracked positions. That's 4% above the national median.
Career Path
Common paths into Data Scientist roles include Data Analyst, Statistician, Quantitative Researcher.
From here, career progression typically leads toward Senior Data Scientist, ML Engineer, AI Product Manager.
Start with statistics and SQL. Build a real analysis project on public data that demonstrates insight generation alongside model building. The market values data scientists who can communicate findings clearly to business stakeholders. If you want to move toward ML engineering, invest in software engineering fundamentals and production deployment skills.
What to Expect in Interviews
Interviews combine statistics, coding, and business acumen. SQL is almost always tested, often with complex joins and window functions. Expect a case study round where you're given a business problem and asked to design an analysis plan. Coding rounds focus on pandas, statistical modeling, and visualization. The strongest differentiator is how well you communicate insights to non-technical stakeholders during presentation rounds.
When evaluating opportunities: Good postings specify the data stack, the types of problems you'll work on, and the team structure. Look for companies that differentiate between analytics and ML data science. Vague 'data scientist' postings that list every skill under the sun usually mean the company doesn't know what they need.
AI Hiring Overview
The AI job market has 9,079 open positions tracked in our dataset. By seniority: 106 entry-level, 4,384 mid-level, 3,343 senior, and 1,246 leadership roles (Director, VP, C-Level). Remote roles make up 6% of the market (531 positions). The remaining 8,478 roles require on-site or hybrid attendance.
The market median for AI roles is $213,000. Top-quartile compensation starts at $263,911. The 90th percentile reaches $318,400. Highest-paying categories: AI Safety ($256,000 median, 66 roles); Research Engineer ($252,000 median, 457 roles); AI Engineering Manager ($251,622 median, 55 roles).
Data Scientist roles remain in high demand, though the definition keeps shifting. Companies increasingly want candidates who can bridge traditional statistics with modern ML and LLM capabilities. The 'pure insights' data scientist role is consolidating into analytics engineering, while the 'build models' data scientist role is merging with ML engineering.
The AI Job Market Today
The AI job market spans 9,079 open positions across 16 role categories. The largest categories by volume: AI/ML Engineer (6,862), AI Product Manager (453), AI Software Engineer (451). These three account for the majority of open positions, though smaller categories often have higher per-role compensation because of specialized skill requirements.
The seniority mix tells a story about where AI teams are in their maturity. Entry-level roles (106) are outnumbered by mid-level (4,384) and senior (3,343) positions, reflecting that most companies are past the 'build a team from scratch' phase and need experienced engineers who can ship production systems. Leadership roles (Director, VP, C-Level) total 1,246 positions, representing the bottleneck between technical execution and organizational strategy.
Remote work availability sits at 6% of all AI roles (531 positions), with 8,478 requiring on-site or hybrid attendance. The remote share has stabilized after the post-pandemic correction. Senior and specialized roles (Research Scientist, ML Architect) are more likely to be remote-eligible than entry-level positions, partly because experienced hires have more negotiating power and partly because these roles require less hands-on mentorship.
AI compensation is structured in clear tiers. The market median sits at $213,000. Top-quartile roles start at $263,911, and the 90th percentile reaches $318,400. These figures include base salary with disclosed compensation. Total compensation (including equity, bonuses, and sign-on) runs 20-40% higher at companies that offer those components.
Category matters for compensation. AI Safety roles lead at $256,000 median, while Prompt Engineer roles sit at $141,440. The spread between highest and lowest-paying categories reflects the premium on specialized technical skills versus broader analytical roles.
The most in-demand skills across all AI postings: Python (1,649 postings), Aws (898 postings), Azure (723 postings), Rag (671 postings), Gcp (536 postings), Pytorch (434 postings), Claude (410 postings), Kubernetes (406 postings). Python dominates, appearing in the vast majority of role descriptions regardless of category. Cloud platform experience (AWS, GCP, Azure) is the second most common requirement. The newer entrants to the top skills list (RAG, vector databases, LLM APIs) reflect the shift from traditional ML toward generative AI applications.
Frequently Asked Questions
Get Weekly AI Career Intelligence
Salary data, skills demand, and market signals from 16,000+ AI job postings. Every Monday.