Institute of Foundation Models · Foundation models
Data & Eval Operations Program Manager
- Sunnyvale (On‑site)
- Full-time
- $250,000 - $450,000 / year
Still open on Institute of Foundation Models's site · checked 7 hours ago
- Experience
- 5+ years
- Posted
- Visa & relocation
- Institute of Foundation Models offers visa sponsorship for this job
See all jobs with visa or relocation supportIn the job ad:
“This position is eligible for visa sponsorship.”
What you'll do
As written by Institute of Foundation Models · Read the original
The Role
As the Data & Eval Operations Program Manager for our team, you will structure and implement the processes for data acquisition and eval execution for our foundation models and will develop these into comprehensive programs. You will work closely with our techincal team, including research scientists, research engineers, and software engineers, as well as with external data vendor partners as our key interface. These programs will have a massive impact on the continuous improvement of the models we develop, meaning that this is a critical role to the ultimate success of the organization. You will be expected to stand up and manage these programs autonomously, and tailor them over time to the changing needs of the team.
Requirements
Academic Qualifications
Professional Experience - Minimum
-
5+ years of relevant industry experience, with at least 3 years in program management with technical teams, including working directly with researchers and engineers.
-
Budget Management: Budget management experience, managing multi-million-dollar budgets.
-
Vendor Management: Vendor management experience, working across multiple vendors, and experience with contracts and SOWs.
-
Complete Program Ownership: Autonomy in fully managing projects with budget, timeline, and quality components.
-
Technical Fluency: You don’t need to write code or understand nuanced research but must understand relevant technical concepts.
Professional Experience - Preferred
-
Foundation Model Experience: Experience working specifically with LLMs, Generative AI, or ML Infrastructure.
-
Data Operations Experience: Experience working with data vendors for LLM development.
-
LLM/Agentic Benchmarks Understanding: Familiarity with key LLM/agentic benchmarks, including an understanding of how LLMs, aagentic capabilties, and benchmarks are evolving over time.
Skills
Working languages
English
Salary & benefits
Compensation
$250,000 – $450,000/year + discretionary performance bonus + benefits
The posted salary range represents the company’s good faith estimate of the base compensation for this position upon hire. The actual base compensation offered may vary within this range depending on individual qualifications, including but not limited to relevant skills, experience, education, certifications, and specific business needs. In addition to base salary, total compensation includes an annual discretionary performance bonus and comprehensive benefits.
Benefits Include
- Comprehensive medical, dental, and vision benefits
- Bonus
- 401K Plan
- Generous paid time off, sick leave and holidays
- Paid Parental Leave
- Employee Assistance Program
- Life insurance and disability
This position is eligible for visa sponsorship.
Company
Last checked . The details above were extracted automatically; the employer's original posting is the authority.
