Sunday (sunday.ai) Logo

Sunday (sunday.ai)

Eval Ops Program Manager

Reposted 2 Months Ago
Be an Early Applicant
In-Office
Redwood City, CA, USA
120K-230K Annually
Mid level
In-Office
Redwood City, CA, USA
120K-230K Annually
Mid level
Support ML evaluation operations by building analytics and reporting, coordinating logistics and physical test environments, sourcing and standardizing props/equipment, scouting spaces, and creating documentation and processes to ensure high-quality, actionable eval data for the ML team.
The summary above was generated by AI

Join Us in Building the Future of Home Robotics

At Sunday, we're developing personal robots to reclaim the hours lost to repetitive tasks. We're focused on an ambitious goal to make generalized robots broadly accessible, enabling households to take back quality time.

We have spent the last 18 months building a talented team, securing capital, and validating our technology. We are now seeking passionate individuals to join us in the next phase of our growth. If you are ready to apply your skills to the forefront of robotics innovation, we’d love to hear from you.

What to Expect

We're looking for an Eval Ops Program Manager to join our Data team and build the operational system for robotics evals.

This role sits at the intersection of machine learning, analytics, and operations. You’ll work closely with ML engineers, researchers, the Eval Operations Lead, and Memory Developers to ensure evaluations are producing trustworthy data and running efficiently at scale.

What You'll Do

  • Build the analytics layer for eval operations, developing dashboards, reporting, and analyses to understand model performance, evaluation throughput, failure patterns, and operational bottlenecks

  • Work with stakeholders across ML, Software, Hardware, Product, and Operations to define evaluation goals, ensure data quality, and translate results into actionable insights

  • Design and improve processes that increase evaluation quality, repeatability and scale

  • Own the logistics required to run evaluations, including sourcing and standardizing props, garments, equipment, and environments

  • Identify operational gaps and build solutions, automations, or processes to close them

What You'll Bring

  • Strong analytical skills and the ability to turn data into actionable insights

  • High ownership and bias for execution

  • Clear written and verbal communication

  • Comfort working across both analytics and hands-on operations

  • A level of hardcore-ness while still treating people like people

  • Thick-skinned, resilient and receptive to direct feedback

  • Intermediate-level understanding of ML

Nice to Have

  • Previous experience in strategy and ops, technical program management, consulting or investment banking

  • Technical skills to build lightweight tooling or automations

  • Exposure to ML evaluation, experimentation, or labeling workflows

  • Ability to leverage AI to improve productivity

At Sunday Robotics, we’re building technology shaped by real people — curious, creative, and diverse. We’re proud to be an equal opportunity employer and consider all qualified applicants regardless of race, color, religion, gender, gender identity or expression, sexual orientation, national origin, genetics, disability, age, or veteran status.

Even if you don’t meet every single requirement, we encourage you to apply. Studies show that women and underrepresented groups often hold back unless they meet 100% of the criteria — we don’t want that to be the reason we miss out on great talent.

Similar Jobs

15 Days Ago
In-Office
Sunnyvale, CA, USA
250K-450K Annually
Senior level
250K-450K Annually
Senior level
Information Technology • Automation • Manufacturing
Owns and builds end-to-end data operations and evaluation programs for foundation models. Responsibilities include data vendor management, multi-million-dollar budget oversight, procurement and contract coordination, evaluation process design, benchmark analysis, and cross-functional collaboration with researchers and engineers. The role independently manages program scope, timelines, quality, performance, and evolving technical requirements.
Top Skills: Ai BenchmarksFoundation ModelsGenerative AiLarge Language Models (Llms)Machine Learning Infrastructure
24 Minutes Ago
Hybrid
83K-157K Annually
Senior level
83K-157K Annually
Senior level
Artificial Intelligence • Fintech • Insurance • Marketing Tech • Software • Analytics
Leads a Workers Compensation claims team, overseeing daily operations, staffing, coaching, performance, compliance, quality, reserves, settlements, and customer relationships. The manager reviews claims files, facilitates claim reviews, monitors analytics and inventory trends, ensures licensing and fair-claims compliance, and supports continuous improvement. The role also develops employees, communicates with agents, brokers, and policyholders, and presents to existing and prospective customers.
Top Skills: Liberty Management System
An Hour Ago
Remote or Hybrid
USA
140K-215K Annually
Senior level
140K-215K Annually
Senior level
Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
Develop and operate CrowdStrike’s internal cloud management platform and mission-critical CI/CD pipelines. Build APIs and UIs using Go and TypeScript, improve developer productivity, integrate tooling, maintain cloud-native infrastructure, and support secure, highly available software delivery systems. Collaborate with development, infrastructure, security, and SRE teams, ensure SOC2-aware processes, and participate in on-call operations.
Top Skills: AlertmanagerArgo CdArgo WorkflowsCi/CdDebianDockerGoGoreleaserGrafanaHelmJavaScriptJenkinsKubernetesKustomizeLinuxPrometheusPulumiPypiTemporalTerraformTypescript

What you need to know about the San Francisco Tech Scene

San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.

Key Facts About San Francisco Tech

  • Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Google, Apple, Salesforce, Meta
  • Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
  • Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
  • Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account