Top Tech Jobs & Startup Jobs in San Francisco Bay Area, CA

Audit and ensure quality of data labeling work for ML using human-in-the-loop processes. Provide feedback, train and support annotators, monitor workflows, identify recurring issues, and help improve guidelines and processes.

Audit and review data labeling outputs, provide actionable feedback, train and support labeling teams, monitor workflows, identify recurring issues and edge cases, participate in calibrations and stakeholder syncs, and help improve guidelines and processes in human-in-the-loop AI workflows.

Audit and improve data labeling quality in human-in-the-loop ML workflows. Coach and onboard labelers, provide actionable feedback, monitor queues, identify recurring issues, and help refine guidelines and processes.

Evaluate AI model outputs, perform audit-style reviews to find patterns and failure modes, apply and refine labeling/evaluation guidelines, document findings, communicate insights to leads and stakeholders, and participate in team calibrations to improve model evaluation and data quality.

Audit and ensure quality of labeled data by reviewing DLA outputs, providing feedback and coaching, supporting onboarding and training, monitoring workflows, identifying recurring issues and edge cases, and contributing to guideline and process improvements in human-in-the-loop AI workflows.

Audit and validate data labeling outputs, provide structured feedback and hands-on training to annotators, monitor workflows and escalate issues, help apply and improve guidelines, and identify patterns in human and model outputs to maintain high-quality AI training data.

Evaluate AI model outputs, perform audit-based reviews, apply and improve guidelines, identify trends and failure modes, document findings, and collaborate with leads and cross-functional teams to refine quality standards.

Audit and ensure quality of data labeling outputs, coach and onboard annotators, apply and refine guidelines, monitor workflows and escalate issues, document findings, and support human-in-the-loop AI evaluation processes.

Evaluate AI model outputs, perform audit-based reviews, identify failure modes and trends, apply and improve guidelines, document findings, and collaborate with leads and cross-functional teams to refine quality standards.

Perform Chinese annotation, labeling, and quality review of multimodal datasets (text, image, video, audio) for generative AI. Evaluate AI prompts/responses, conduct QA, identify edge cases, refine guidelines, and collaborate with teams to improve annotation workflows and tooling.