Top Tech Jobs & Startup Jobs in San Francisco Bay Area, CA

Evaluate AI-generated Norwegian lyrics for quality, creativity, originality, prompt adherence, naturalness, and cultural appropriateness. Compare outputs to published songs, identify overlaps, flag awkward or inappropriate language, assess word choice, slang, idioms, and regional expressions, and provide clear feedback to improve generative music models. Apply detailed evaluation guidelines consistently across genres and use critical listening and professional musical judgment.

Coordinate AI research, training-data, and data operations programs. Serve as the day-to-day contact between leadership, research teams, and domain experts; track deliverables, onboard experts, document processes, monitor quality, and drive project communications using Excel/Google Sheets and SQL.

Define task-specific grading criteria for accounting deliverables and evaluate AI-generated and human work. Provide evidence-based written justifications, identify errors or unsupported conclusions, ensure reproducible, objective assessments, and refine criteria from reviewer feedback.

Design realistic instructional scenarios, create assessment items and rubrics, evaluate AI-generated educational content for accuracy, standards alignment, and pedagogical quality, provide detailed written feedback, and collaborate asynchronously with research teams to improve AI systems across K-12 and higher education contexts.

Evaluate AI-generated Swedish lyrics and music outputs for quality, originality, cultural and linguistic authenticity, and prompt adherence. Compare outputs to published songs, identify unnatural or problematic language, apply evaluation guidelines consistently, and provide clear feedback. Use professional music knowledge and familiarity with the Swedish music scene to judge creativity and authenticity.

Evaluate AI-generated and human brand and design deliverables by creating task-specific grading criteria, scoring work against professional standards, and providing detailed, evidence-based written feedback on visual quality, strategic alignment, consistency, usability, and brand effectiveness.

Evaluate and improve AI-generated fund-related legal work by drafting, reviewing, negotiating, and redlining fund documents; develop evaluation frameworks and scoring rubrics; collaborate with product, research, and engineering teams to refine AI training data and legal guidelines; identify contractual risks and provide expert legal feedback.

Part-time contractor M&A attorney to draft, review, negotiate, and redline transaction documents; evaluate AI-generated legal outputs; develop evaluation frameworks and scoring rubrics; provide subject-matter expertise to improve AI training data and legal analysis; collaborate with product, research, and engineering teams to refine legal guidelines and best practices.

Part-time contractor role evaluating and training AI for contract review. Draft, review, negotiate, and redline commercial technology agreements; assess AI-generated contract responses; develop evaluation criteria and scoring rubrics; collaborate with product, research, and engineering teams to improve AI legal workflows and identify contractual risks.

Paid remote research study recruiting senior design professionals to participate in structured, recorded sessions (4-5 hours) to discuss design decision-making, critique, quality standards, and readiness to ship. Participants may act as interviewees or interviewers. Requires a professional portfolio and strong ability to articulate design rationale and trade-offs.