Research Scientist – Multimodal Foundation Models & Visual Reasoning

Palo Alto, CA, US Mid Level Research Scientist

Interested in this Research Scientist role at Elorian?

Apply Now →

Skills & Technologies

GeminiJaxPythonPytorch

About This Role

AI job market dashboard showing open roles by category

About Us

We are a well-funded, early-stage AI research and product lab focused on building the next generation of frontier multimodal AI models. Founded by former DeepMind researchers—including Andrew Dai, previously an engineering leader on Gemini—our mission is to push the frontier of visual and multimodal intelligence. Our first model, Glimpse, launched publicly in October 2026.

Our team currently consists of 25 world-class scientists and engineers. We raised a $55M seed round led by Altimeter Capital, Menlo Ventures, Striker VC, and NVIDIA. We are tackling foundational problems in artificial intelligence and translating cutting-edge multimodal research into scalable, real-world systems.

About the role

In this role, you will lead ambitious, high-impact research across next-generation model architectures, distributed training methodologies, multimodal visual reasoning, reinforcement learning, and data-centric learning. Backed by dedicated, large-scale compute clusters and deep engineering support, you will formulate first-principles hypotheses and run large-scale empirical experiments. You will collaborate closely with world-class research and engineering peers to push the boundary of visual intelligence and translate core research breakthroughs directly into state-of-the-art foundation models and real-world capabilities.

What you will do

  • Frontier Research: Drive novel research at the intersection of foundation models, multimodal understanding, complex visual reasoning, and spatial intelligence.
  • Architecture & Training Innovations: Conceive and build novel model architectures, pre-training methodologies, and scalable post-training techniques (e.g., preference tuning, reasoning-focused RL) to systematically advance model capabilities.
  • Large-Scale Experimentation: Design, execute, and analyze large-scale distributed training experiments on modern accelerator clusters to push the frontier of model performance.
  • Data-Centric Intelligence: Pioneer innovative approaches to multimodal data curation, synthetic data generation, automated filtering, and rigorous benchmark evaluation.
  • Breakthrough to Capability: Collaborate with cross-functional research and systems engineering teams to turn fundamental algorithmic breakthroughs into robust, scalable foundation model capabilities deployed at scale.

What we are looking for

  • Ph.D. or equivalent industry research track record in Machine Learning, Computer Vision, Natural Language Processing, or a related quantitative discipline.
  • Rigorous foundational understanding of deep learning principles, transformer/multimodal architectures, and modern large-scale training dynamics.
  • Deep proficiency in Python and modern deep learning frameworks (PyTorch or JAX).
  • Demonstrated ability to independently define research agendas, design rigorous empirical experiments, and solve open-ended, frontier-level problems.

Nice to have

  • Specialized Domain Expertise: Deep theoretical and practical expertise in at least one of the following: foundation models, multimodal reasoning, visual/spatial intelligence, reinforcement learning, or post-training
  • Proven Research Impact: Strong track record demonstrated through first-author publications at top-tier venues (e.g. NeurIPS, ICML, ICLR, CVPR, ICCV, ECCV) or key technical contributions to high-profile foundation model releases.
  • Distributed Systems & Scale: Hands-on experience training, profiling, and scaling models across large distributed GPU or TPU clusters (e.g., FSDP, Megatron-LM, DeepSpeed, Ray).
  • Data & Evaluation: Demonstrated experience developing large-scale multimodal data pipelines, synthetic reasoning trace generation, or designing rigorous evaluation suites for frontier models.

Role Details

Company Elorian
Title Research Scientist – Multimodal Foundation Models & Visual Reasoning
Location Palo Alto, CA, US
Category Research Scientist
Experience Mid Level
Salary Not disclosed
Remote No

About This Role

Research Scientists push the boundaries of what AI can do. They design experiments, develop novel architectures, publish papers, and translate research breakthroughs into production capabilities. This is where the fundamental advances happen, from attention mechanisms to diffusion models to reasoning chains.

The work is intellectually demanding and often ambiguous. You might spend months on an approach that doesn't pan out. The best research scientists combine deep mathematical intuition with engineering pragmatism. They know when to go deep on theory and when to run experiments. They read papers voraciously and can spot incremental contributions from genuine breakthroughs.

Across the 10,419 AI roles we're tracking, Research Scientist positions make up 2% of the market. At Elorian, this role fits into their broader AI and engineering organization.

Research Scientist roles are concentrated at major AI labs (OpenAI, Anthropic, Google DeepMind, Meta FAIR) and well-funded AI startups. The competition is intense. PhD is effectively required for most positions, and publication track record matters. Compensation is among the highest in AI, reflecting both the scarcity of talent and the strategic importance of research breakthroughs.

What the Work Looks Like

A typical week includes: reading and discussing recent papers with your team, designing and running experiments on multi-GPU clusters, analyzing results and iterating on hypotheses, writing up findings for internal review or publication, and collaborating with engineering teams to productionize promising results. The ratio of thinking to coding is higher than in engineering roles.

Research Scientist roles are concentrated at major AI labs (OpenAI, Anthropic, Google DeepMind, Meta FAIR) and well-funded AI startups. The competition is intense. PhD is effectively required for most positions, and publication track record matters. Compensation is among the highest in AI, reflecting both the scarcity of talent and the strategic importance of research breakthroughs.

Skills Required

Gemini (2% of roles) Jax (1% of roles) Python (23% of roles) Pytorch (6% of roles)

PhD strongly preferred for most roles. Deep expertise in a specific area (NLP, computer vision, reinforcement learning, multimodal) is expected. PyTorch is the standard. Publication track record matters. Strong mathematical foundations in linear algebra, probability, optimization, and information theory are assumed.

Beyond the fundamentals, companies value experience with large-scale distributed training, novel architecture design, and the ability to bridge theory and practice. Understanding of current frontier topics (reasoning, multimodal, long-context, alignment) is essential. Code quality matters more than many researchers expect. Labs want researchers who can implement their ideas cleanly.

Strong research postings specify the research area, mention the team you'd join, and describe the problems they're working on. They often list recent publications from the team. Vague 'AI research' postings without specifics usually mean the company wants to sound impressive but doesn't have a real research agenda.

Compensation Benchmarks

Research Scientist roles pay a median of $223,400 based on 917 positions with disclosed compensation. Mid-level AI roles across all categories have a median of $193,200.

Across all AI roles, the market median is $214,834. Top-quartile compensation starts at $266,000. The 90th percentile reaches $321,730. For comparison, the highest-paying categories include AI Safety ($274,500) and Research Engineer ($252,000). By seniority level: Entry: $114,400; Mid: $193,200; Senior: $230,000; Director: $272,100; VP: $235,000.

Elorian AI Hiring

Elorian has 2 open AI roles right now. They're hiring across Research Scientist, Research Engineer. Based in Palo Alto, CA, US.

Location Context

Across all AI roles, 6% (580 positions) offer remote work, while 9,776 require on-site attendance. Top AI hiring metros: New York (3,785 roles, $222,480 median); San Francisco (3,262 roles, $261,300 median); Los Angeles (1,896 roles, $210,000 median).

Career Path

Common paths into Research Scientist roles include PhD Student, Research Engineer, Postdoc.

From here, career progression typically leads toward Research Lead, Distinguished Scientist, VP of Research.

The PhD is the entry point for most paths. Choose your advisor and research area carefully since they'll define your first industry position. Publish consistently, contribute to open-source projects in your area, and build relationships at conferences. Industry research offers better compensation and compute resources than academia, but the pressure to show product impact is real.

What to Expect in Interviews

Research interviews are multi-stage: a research talk (present your best paper), technical deep-dives on your methodology, and often a 'research proposal' exercise where you design an experiment to test a hypothesis. Coding rounds test implementation ability alongside theoretical knowledge. Be prepared to implement a paper from scratch and discuss the design choices the authors made. Strong candidates can critique papers constructively and identify gaps in experimental methodology.

When evaluating opportunities: Strong research postings specify the research area, mention the team you'd join, and describe the problems they're working on. They often list recent publications from the team. Vague 'AI research' postings without specifics usually mean the company wants to sound impressive but doesn't have a real research agenda.

AI Hiring Overview

The AI job market has 10,419 open positions tracked in our dataset. By seniority: 117 entry-level, 4,975 mid-level, 3,840 senior, and 1,487 leadership roles (Director, VP, C-Level). Remote roles make up 6% of the market (580 positions). The remaining 9,776 roles require on-site or hybrid attendance.

The market median for AI roles is $214,834. Top-quartile compensation starts at $266,000. The 90th percentile reaches $321,730. Highest-paying categories: AI Safety ($274,500 median, 90 roles); Research Engineer ($252,000 median, 580 roles); AI Engineering Manager ($250,811 median, 72 roles).

Research Scientist roles are concentrated at major AI labs (OpenAI, Anthropic, Google DeepMind, Meta FAIR) and well-funded AI startups. The competition is intense. PhD is effectively required for most positions, and publication track record matters. Compensation is among the highest in AI, reflecting both the scarcity of talent and the strategic importance of research breakthroughs.

The AI Job Market Today

The AI job market spans 10,419 open positions across 16 role categories. The largest categories by volume: AI/ML Engineer (7,849), AI Product Manager (516), AI Software Engineer (513). These three account for the majority of open positions, though smaller categories often have higher per-role compensation because of specialized skill requirements.

The seniority mix tells a story about where AI teams are in their maturity. Entry-level roles (117) are outnumbered by mid-level (4,975) and senior (3,840) positions, reflecting that most companies are past the 'build a team from scratch' phase and need experienced engineers who can ship production systems. Leadership roles (Director, VP, C-Level) total 1,487 positions, representing the bottleneck between technical execution and organizational strategy.

Remote work availability sits at 6% of all AI roles (580 positions), with 9,776 requiring on-site or hybrid attendance. The remote share has stabilized after the post-pandemic correction. Senior and specialized roles (Research Scientist, ML Architect) are more likely to be remote-eligible than entry-level positions, partly because experienced hires have more negotiating power and partly because these roles require less hands-on mentorship.

AI compensation is structured in clear tiers. The market median sits at $214,834. Top-quartile roles start at $266,000, and the 90th percentile reaches $321,730. These figures include base salary with disclosed compensation. Total compensation (including equity, bonuses, and sign-on) runs 20-40% higher at companies that offer those components.

Category matters for compensation. AI Safety roles lead at $274,500 median, while Prompt Engineer roles sit at $140,000. The spread between highest and lowest-paying categories reflects the premium on specialized technical skills versus broader analytical roles.

The most in-demand skills across all AI postings: Python (2,350 postings), Aws (1,173 postings), Azure (1,030 postings), Rag (986 postings), Gcp (714 postings), Pytorch (649 postings), Kubernetes (583 postings), Claude (581 postings). Python dominates, appearing in the vast majority of role descriptions regardless of category. Cloud platform experience (AWS, GCP, Azure) is the second most common requirement. The newer entrants to the top skills list (RAG, vector databases, LLM APIs) reflect the shift from traditional ML toward generative AI applications.

Frequently Asked Questions

Based on 917 roles with disclosed compensation, the median salary for Research Scientist positions is $223,400. Actual compensation varies by seniority, location, and company stage.
PhD strongly preferred for most roles. Deep expertise in a specific area (NLP, computer vision, reinforcement learning, multimodal) is expected. PyTorch is the standard. Publication track record matters. Strong mathematical foundations in linear algebra, probability, optimization, and information theory are assumed.
About 6% of the 10,419 AI roles we track offer remote work. Remote availability varies by company and seniority level, with senior and leadership roles more likely to offer location flexibility.
Elorian is among the companies actively hiring for AI and ML talent. Check our company profiles for detailed breakdowns of open roles, salary ranges, and hiring trends.
Common next steps from Research Scientist positions include Research Lead, Distinguished Scientist, VP of Research. Progression depends on whether you lean toward technical depth, people management, or product strategy.

Get Weekly AI Career Intelligence

Salary data, skills demand, and market signals from 16,000+ AI job postings. Every Monday.