Back to all listings

Research Engineer, Safety Evaluation

Meta • Menlo Park, CA, New York, NY • On-site • Recent
Apply on Meta

Research Engineer, Safety Evaluation

  • Company: Meta
  • Requisition ID: 1407878191449887
  • Location: Menlo Park, CA, New York, NY
  • Department: AI Research, Generative AI
  • Compensation: $219,000/year - $301,000/year (US)
  • Official Posting: Apply / View

Description

Meta is seeking a Research Engineer to join the Safety Evaluation team within Meta Superintelligence Labs. Our mission is to make the safety of Meta's frontier AI systems measurable — turning ambiguous notions of "safe" into rigorous, defensible metrics that model developers, product teams, and company leadership rely on to make launch decisions.

Safety evaluation is the ground truth for every safety claim Meta makes. This role owns that ground truth: designing the evaluations that detect emerging risks in text, image, voice, video, and agentic systems; building the infrastructure that runs them continuously against training checkpoints and production traffic; and setting the technical direction for how safety is measured across Meta's AI portfolio. You will define measurement standards that outlast any single model generation, and your results will directly gate what ships to billions of people.

Responsibilities

  • Set the technical strategy for safety evaluation across multiple model families and modalities, and drive it to execution across teams
  • Design, implement, and validate novel evaluations for safety-critical behaviors — policy adherence, adversarial robustness, agentic risk, jailbreak resistance, and emerging harm categories — including for capabilities with no established benchmark
  • Build and harden the distributed evaluation platform so that hundreds of evals run reliably and continuously against checkpoints throughout large-scale training runs
  • Own the measurement quality bar: signal-to-noise, statistical power, saturation, contamination, and construct validity — and establish when an eval is trustworthy enough to gate a launch
  • Create, curate, and analyze high-quality safety datasets, including adversarial, borderline, multilingual, and long-tail cases; convert real-world incidents and red-team findings into durable, repeatable safety signals
  • Diagnose anomalous eval results mid-training-run, determine whether the cause is a model change or an infrastructure artifact, and communicate a clear answer under time pressure
  • Own the dashboards and reporting that researchers, product partners, and leadership use to monitor safety during training and post-launch
  • Translate evolving global safety policy and regulatory standards into concrete, testable measurement criteria, partnering with Policy, Legal, and Integrity
  • Influence the roadmaps of partner research and product teams; mentor engineers and researchers and raise the evaluation bar across the org
  • Represent Meta's safety evaluation methodology to internal leadership and, where appropriate, to external audiences and the research community

Minimum Qualifications

  • Bachelor's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience
  • Bachelor's degree in Computer Science, Computer Engineering, a relevant technical field, or equivalent practical experience
  • 3+ years of industry research or research-engineering experience in ML/AI, including hands-on work with LLMs, multimodal models, or NLP
  • Demonstrated experience setting technical direction for a large, ambiguous problem area and driving it to delivery across multiple teams
  • Experience designing and validating evaluations or benchmarks for ML systems, including reasoning about metric reliability and failure modes
  • Experience building production-grade or research infrastructure that must be reliable at scale — distributed systems, data pipelines, or evaluation harnesses
  • Programming experience in Python and hands-on experience with frameworks such as PyTorch
  • Experience communicating complex technical results to non-specialist stakeholders and decision-makers

Preferred Qualifications

  • Experience translating regulatory or policy requirements into technical measurement criteria
  • Experience evaluating LLMs across multiple languages and modalities (text, image, voice, video, reasoning, tool use)
  • Experience operating in an on-call or production-support capacity for live training runs or safety-critical systems
  • Experience evaluating agentic systems — multi-step tool use, autonomy, and oversight mechanisms
  • Publications at peer-reviewed venues (e.g. ICLR, NeurIPS, ICML, ACL, CVPR, ICCV, FAccT) with a track record in evaluation, alignment, or AI safety
  • Experience with large-scale distributed training (hundreds/thousands of GPUs) and evaluating models in-flight during training
  • Experience with adversarial evaluation and red-teaming, including automated attack generation and jailbreak robustness measurement
  • experience with observability, monitoring, or experiment-tracking systems
  • PhD in Computer Science, Machine Learning, or a relevant technical field
  • Background in statistics and experimental design

Compensation & Benefits

  • Estimated Compensation: $219,000/year - $301,000/year (US)
  • Additional Benefits: Bonus eligible, Equity eligible

Equal Opportunity

Meta is proud to be an Equal Employment Opportunity employer. We do not discriminate based upon race, religion, color, national origin, sex (including pregnancy, childbirth, reproductive health decisions, or related medical conditions), sexual orientation, gender identity, gender expression, age, status as a protected veteran, status as an individual with a disability, genetic information, political views or activity, or other applicable legally protected characteristics. You may view our Equal Employment Opportunity notice here.

Accommodations

Meta is committed to providing reasonable accommodations for qualified individuals with disabilities and disabled veterans in our job application procedures. If you need assistance or an accommodation due to a disability, fill out the Accommodations request form.

Back to all listings Apply on Meta

About Open Indeed

Open Indeed is a free, public job board created to help Canadian undergraduate students and new graduates discover verified tech internships, co-ops, and early-career opportunities.

Postings are indexed directly from official employer career portals via an autonomous scraping pipeline and updated on a recurring schedule—keeping listings timely, accurate, and completely free of spam or recruiter reposts.

The complete data collection and indexing pipeline is currently undergoing active reliability testing and will be fully open-sourced once thoroughly verified.