xAI · Foundation models
Sr. Model Engineer, Mid-training
- Palo Alto
AI roleMachine LearningTrains models
Still open on xAI's site · checked just now
- Level
- Senior
- Posted
What you'll do
As written by xAI · Read the original
RESPONSIBILITIES
- Scale synthetic coding data to trillions of tokens with large-scale docker verification
- Distill the intelligence of flagship models into flash models through synthetic data generation
- Optimize mid-training data mixtures to boost the ceiling for RL
- Engineer long-context data recipes
- Develop robust and diverse evaluation for mid-training checkpoints
Requirements
BASIC QUALIFICATIONS
- Experience writing production-quality code in Python, PyTorch, JAX, Rust, or C++
- Experience training large models (e.g., pre-training, post-training, fine-tuning, or RL training of neural networks with 1B+ parameters)
PREFERRED SKILLS AND EXPERIENCE
- Familiarity across all kinds of scaling laws
- Strong ability to design ML experiments
- Familiarity with state-of-the-art techniques for curating AI training data for text, image, audio, and video modalities
- Strong engineering abilities in large-scale data processing frameworks
- Experience with ML and large model scaling
- Experience with Spark, Ray, and other large-scale data processing frameworks
Skills
Stack
- Python
- C++
- Rust
- PyTorch
- JAX
- Spark
- Ray
- Docker
Working languages
English
Salary & benefits
COMPENSATION AND BENEFITS
$180,000 - $440,000 USD
Base salary is just one part of our total rewards package at SpaceXSI, which also includes equity, comprehensive medical, vision, and dental coverage, access to a 401(k) retirement plan, short & long-term disability insurance, life insurance, and various other discounts and perks.
SpaceXSI is an equal opportunity employer. For details on data processing, view our Recruitment Privacy Notice.
Company
Last checked . The details above were extracted automatically; the employer's original posting is the authority.
