# Senior/Lead Research Engineer (Foundation Models)

Source: https://realanalystjobs.com/job/senior-lead-research-engineer-foundation-models-jobgether-2ce72b2f
Senior/Lead Research Engineer (Foundation Models) at Jobgether, an on-site role based in USA. Experience level: 3 Years. Pay stated in the posting: $118,400 to $219,800. Posted on 19 November 2026, read from Jobgether's own careers page (Lever), which RealAnalystJobs re-checks daily and removes the role when it closes.

Updated 20 November 2026.

## Key facts

- Company: [Jobgether](https://realanalystjobs.com/companies/jobgether)
- Location: USA
- Work mode: On-site
- Pay stated in the posting: $118,400 to $219,800
- Posted: Nov 19, 2026
- Employment type: Full time
- Experience level: 3 Years
- Source: Jobgether's careers page (Lever), re-checked daily

Skills: Agents, Fine-tuning, Evals, LLM, PyTorch, CUDA, Ray, Kubernetes, AWS, Azure, GCP

## About this role

This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Senior/Lead Research Engineer (Foundation Models) based in the United States.

We are looking for a Senior/Lead Research Engineer to build and scale the infrastructure behind advanced foundation models for high-stakes professional workflows. You will work closely with research scientists and engineering teams to develop reliable systems for model training, evaluation, and experimentation. The role offers two areas of focus: large-scale reinforcement learning (RL) training for agentic Mixture-of-Experts models, or evaluation engineering for large language models (LLMs). You will tackle complex distributed computing and performance challenges while optimizing GPU utilization, cost, and latency. Your work will help accelerate model development, improve release quality, and support the reliable deployment of AI capabilities. At Lead level, you will also shape technical architecture, guide delivery, and mentor other engineers.

Accountabilities
•
Research and Engineering Infrastructure: Build, operate, and maintain the systems used to train, evaluate, and experiment with foundation models, ensuring reliability as model complexity and adoption increase.

•
Large-Scale RL Training: For candidates focused on training infrastructure, architect and optimize systems supporting reinforcement learning for agentic Mixture-of-Experts models exceeding 300 billion parameters, including asynchronous and long-context training with tool interaction.

•
Evaluation Engineering: For candidates focused on evaluation, build, scale, and optimize evaluation suites and leaderboards that support model releases and product integrations.

•
Performance Optimization: Profile and improve systems for cost efficiency, latency, and GPU utilization without compromising model quality. Document technical trade-offs and optimization decisions for the wider team.

•
Complex Technical Troubleshooting: Investigate and resolve challenging numerical, distributed systems, and performance issues across training frameworks, inference engines, and evaluation code.

•
Research Collaboration: Work directly with research and evaluation teams to translate new algorithms, reward mechanisms, and evaluation approaches into scalable systems that can be tested quickly and reliably.

•
Model Release Support: Collaborate with training and evaluation teams to prepare new model releases, complete testing, and support deployment into production environments.

•
Production Readiness and Compliance: Strengthen production engineering practices and contribute to the organization's ISO 27001 compliance journey.

•
Engineering Standards: Establish and promote high standards for code quality, testing, reproducibility, and maintainability.

•
Technical Leadership (Lead Level): Own the architecture of your technical area, coordinate delivery plans and staffing with research leads, and mentor engineers while driving complex projects from conception through completion.

Requirements:

•
Education: Master's or PhD in Computer Science, Machine Learning, or a related discipline, or equivalent professional industry experience.

•
Software Engineering: Strong software engineering fundamentals, including experience with large-scale distributed systems and the ability to work effectively in substantial open-source codebases.

•
Production and Research Systems: Experience maintaining reliable research or production systems under real-world workloads, including debugging distributed systems and resolving operational incidents.

•
Research Collaboration: Demonstrated ability to work closely with researchers and cross-functional stakeholders to translate research ideas and technical requirements into scalable engineering solutions.

•
Specialist Expertise: Deep experience in at least one of the following areas:

Large-Scale Reinforcement Learning Training

•
Multi-node GPU training using PyTorch and technologies such as Megatron-Core, FSDP/DTensor, or DeepSpeed.

•
Understanding of tensor, pipeline, context, and expert parallelism strategies, including their trade-offs for Mixture-of-Experts and long-context models.

•
Familiarity with LLM inference engines such as vLLM or SGLang.

•
GPU profiling experience involving memory, NCCL, and CUDA graphs.

Evaluation Engineering

•
Experience building, scaling, and optimizing evaluation suites for large language models.

•
Ability to demonstrate the measurable impact of evaluation engineering work.

•
Lead-Level Experience: For Lead-level candidates, at least 3 years of professional experience in the relevant technical area, together with a track record of leading complex technical projects end to end and mentoring engineers.

•
Additional Preferred Experience:

•
Building or extending RL post-training frameworks such as NeMo-RL, verl, OpenRLHF, or TRL, particularly asynchronous or non-colocated architectures.

•
Familiarity with evaluation frameworks such as Inspect, Harbor, or lm-evaluation-harness.

•
Experience with distributed runtimes and orchestration tools such as Ray, Kubernetes, or Slurm across AWS, Azure, or Google Cloud.

•
Significant contributions to open-source projects such as vLLM, Megatron, or PyTorch.

•
Familiarity with AI-assisted software development and using coding agents at scale.

Candidates are encouraged to apply even if they do not meet every preferred qualification, as relevant experience and potential alignment will also be considered.

Benefits:

•
Base Salary: For eligible U.S. locations, the annual base salary range is $118,400 - $219,800 USD. Actual compensation depends on location, skills, knowledge, experience, and internal equity.

•
Annual Bonus: The role may be eligible for an annual bonus based on a combination of company and individual performance.

•
Health Coverage: Medical, dental, and vision insurance, as well as disability and life insurance programs.

•
R

Description from Jobgether's public careers feed, reproduced so you can read the role here. Apply on the company's own site; Real Analyst Jobs never submits anything for you.

## How to apply

Open [this role on Real Analyst Jobs](https://realanalystjobs.com/job/senior-lead-research-engineer-foundation-models-jobgether-2ce72b2f) and use Apply now there to reach the employer's application. The listing is re-checked against Jobgether's careers page daily and removed when it closes.

## Jobgether

320 open analyst roles on Real Analyst Jobs. [More roles at Jobgether](https://realanalystjobs.com/companies/jobgether)

## More like this

### Other open roles at Jobgether

- [(Senior) FP&A Analyst](https://realanalystjobs.com/job/senior-fp-and-a-analyst-jobgether-1854cb5c), Switzerland (On-site)
- [(Senior) FP&A Analyst](https://realanalystjobs.com/job/senior-fp-and-a-analyst-jobgether-afb728a7), Spain (On-site)
- [(Senior) FP&A Analyst](https://realanalystjobs.com/job/senior-fp-and-a-analyst-jobgether-839a4716), Germany (On-site)
- [(Senior) FP&A Analyst](https://realanalystjobs.com/job/senior-fp-and-a-analyst-jobgether-a9baee89), France (On-site)
- [(Senior) FP&A Analyst](https://realanalystjobs.com/job/senior-fp-and-a-analyst-jobgether-50e1cb2c), UK (On-site)

- [Data analyst jobs in the USA](https://realanalystjobs.com/jobs/data-analyst-jobs-in-usa)
- [Analyst job market report](https://realanalystjobs.com/analyst-job-market)
- [What analyst roles pay](https://realanalystjobs.com/blog/data-analyst-salaries)

## Sources and links

- [This role on Real Analyst Jobs](https://realanalystjobs.com/job/senior-lead-research-engineer-foundation-models-jobgether-2ce72b2f)
- [Jobgether on Real Analyst Jobs](https://realanalystjobs.com/companies/jobgether)
- [All analyst jobs](https://realanalystjobs.com/jobs)
