Head of Evaluation and Oversight Research job opportunity at Scale AI.



bot
Scale AI Head of Evaluation and Oversight Research
Experience: 1-year
Pattern: full-time
apply Apply Now
Salary:
Status:

Research

Copy Link Report
degreeDiploma
loacation San Francisco, CA; Seattle, WA; New York, NY, United States Of America
loacation San Francisco,..........United States Of America

#Lead a team of #research #scientists and #engineers on foundational work in evaluation and oversight. __ Drive research initiatives on frameworks and benchmarks for #frontier #AI models, spanning reasoning, coding, multi-modal, and agentic behaviors. __ Design and advance scalable oversight methods, leveraging model-assisted evaluation, rubric-guided judgments, and recursive oversight. __ Collaborate with leading research labs across industry and academia. __ Publish research at top-tier venues and contribute to open-source benchmarking initiatives. __ Remain deeply engaged with the research community, both understanding trends and setting them.
ai summary

Other Ai Matches

STEM Fellow - Human Frontier Collective (US) Applicants are expected to have a solid experience in handling Stem Fellow related tasks
Senior Software Engineer, Data Experience Applicants are expected to have a solid experience in handling Software Engineer related tasks
Principal Architect Applicants are expected to have a solid experience in handling Principal Architect related tasks
Machine Learning Engineering Manager, Public Sector Applicants are expected to have a solid experience in handling Engineering related tasks
Product Delivery & Operations Lead Applicants are expected to have a solid experience in handling Leader related tasks
Engagement Manager (Homeland Layered Defense), Public Sector Applicants are expected to have a solid experience in handling Manager related tasks
Software Engineer - Robotics & Autonomous Systems Applicants are expected to have a solid experience in handling Software Engineer related tasks
Machine Learning Engineer, GenAI Applied ML Applicants are expected to have a solid experience in handling Engineer related tasks
AI Infrastructure Engineer, Model Serving Platform Applicants are expected to have a solid experience in handling Engineering related tasks
remote-jobserver Remote
Medical Fellow - Human Frontier Collective (UK) Applicants are expected to have a solid experience in handling Researcher related tasks
Software Engineer, Enterprise AI Applicants are expected to have a solid experience in handling Engineering related tasks
Security Engineer, Federal Assurance Applicants are expected to have a solid experience in handling Security Engineer related tasks
Head of Evaluation and Oversight Research Applicants are expected to have a solid experience in handling Research related tasks
Growth Lead Applicants are expected to have a solid experience in handling Lead related tasks
Strategist, EMEA Applicants are expected to have a solid experience in handling Strategist, EMEA related tasks
AI Strategy Consultant, Frontier Tech Applicants are expected to have a solid experience in handling Consultant related tasks
Senior Software Engineer, Full-Stack - Enterprise Gen AI Applicants are expected to have a solid experience in handling Engineering related tasks
Field Engineer, Public Sector Applicants are expected to have a solid experience in handling Engineering related tasks
Technical Program Manage Applicants are expected to have a solid experience in handling Supervisor related tasks
Applied AI Engineer, Enterprise GenAI Applicants are expected to have a solid experience in handling Engineering related tasks
Medical Fellow - Human Frontier Collective (US) Applicants are expected to have a solid experience in handling Medical related tasks
Senior Forward Deployed Engineer, Enterprise Application Applicants are expected to have a solid experience in handling Engineer related tasks
Applied AI Engineering Manager, Enterprise Applicants are expected to have a solid experience in handling Manager related tasks