Top Tech Jobs & Startup Jobs in San Francisco Bay Area, CA

Evaluate AI model outputs, perform audit-based reviews, apply and refine guidelines, identify performance trends and failure modes, document findings, and collaborate with cross-functional teams to improve model evaluation and data quality.

Audit and monitor data labeling outputs, provide actionable feedback, support onboarding and training of annotators, enforce and improve guidelines, escalate workflow issues, and document findings to maintain high-quality human-in-the-loop AI data processes.

Audit and ensure quality of data labeling work for ML using human-in-the-loop processes. Provide feedback, train and support annotators, monitor workflows, identify recurring issues, and help improve guidelines and processes.

Evaluate AI outputs, perform audit-based reviews, identify patterns and failure modes, apply and improve annotation/evaluation guidelines, document findings, and communicate insights to cross-functional teams to improve model performance and evaluation frameworks.

Evaluate AI model outputs, perform audit-based reviews to identify patterns and failure modes, apply and refine guidelines, document findings, and collaborate with leads and cross-functional teams to improve model evaluation and data quality.

Operate I2RT YAM bimanual robotic arms for scripted data-collection tasks, including teleoperation and human-robot interactions. Follow SOPs, coordinate with a station partner, maintain safety and data-handling standards, log trial results and anomalies, and assist with resets and retries. Training is provided, with emphasis on reliable, precise, repetitive work and clear communication.

Lead onsite execution of a robotics data collection pilot using bimanual robotic arms. Coach teleoperation and HRI operators, enforce SOP, safety, and quality standards, monitor live sessions and data quality, troubleshoot issues, document blockers, and coordinate with client stakeholders. Contribute to improving SOPs and checklists while maintaining station readiness and consistent execution.

Own Uzbek Cyrillic language quality for UI, marketing, product, legal, informational, and support content. Serve as the primary client-facing linguistic expert, interpret style guides and quality frameworks, manage arbitrations and escalations, coach reviewers, facilitate alignment sessions, track quality trends, and convert recurring issues into style guide improvements. The role is remote freelance work of approximately 24 hours per month for candidates in approved countries.

Translate and copy-edit English content into German for Germany and/or Switzerland across marketing, UI, product, support, informational, and light legal materials. Manage 5,000+ words weekly using CAT tools, meet deadlines, maintain high quality and consistency, communicate reliably, and incorporate feedback and revisions in a remote freelance localization environment.

Record natural, conversational customer-service style speech from a home studio. Submit two audition samples; if selected, complete two supervised ~4-hour remote recording sessions meeting technical audio specs.