Top Tech Jobs & Startup Jobs in San Francisco Bay Area, CA

Evaluate AI outputs and audit model behavior, apply and refine guidelines, identify failure modes and trends, document findings, and collaborate with leads and cross-functional teams to improve evaluation frameworks and data quality.

Audit and ensure quality of data labeling outputs, coach and onboard Data Labeling Associates, provide actionable feedback, monitor workflows, identify patterns and edge cases, and help improve guidelines and processes in human-in-the-loop AI workflows.

Evaluate AI outputs, perform audit-based reviews, identify patterns and failure modes, apply and improve annotation/evaluation guidelines, document findings, and communicate insights to cross-functional teams to improve model performance and evaluation frameworks.

Lead and manage a team of Chinese (zh-CN) multimodal annotators and reviewers to meet throughput and quality targets. Own guidelines, calibration, audits, reporting, onboarding, and cross-stakeholder coordination for multimedia labeling workflows.

Evaluate AI outputs, perform audit-based reviews, identify failure modes and trends, apply and refine guidelines, communicate findings, participate in calibrations and stakeholder syncs, and help improve evaluation frameworks for human-in-the-loop AI.

Audit and monitor data labeling outputs, provide actionable feedback, support onboarding and training of annotators, enforce and improve guidelines, escalate workflow issues, and document findings to maintain high-quality human-in-the-loop AI data processes.

Evaluate AI outputs, audit model behavior, apply and refine labeling guidelines, identify failure modes and trends, document findings, and collaborate with cross-functional teams to improve model evaluation and data quality.

Evaluate AI model outputs, perform audit-based reviews to identify patterns and failure modes, apply and refine guidelines, document findings, and collaborate with leads and cross-functional teams to improve model evaluation and data quality.

Write and edit short-form entertainment copy about TV and film in a defined brand voice. Rewrite AI-generated copy for accuracy and tone, research factual details and cultural context, match genre-appropriate tone, and flag incorrect or off-voice AI responses. Flexible, remote, ~20 hours/week freelance work.

Evaluate and verify claims using online evidence, assess source credibility and conflicting information, assign accuracy ratings, and document evidence-based conclusions following project guidelines to improve AI-generated content accuracy.