Top Tech Jobs & Startup Jobs in San Francisco Bay Area, CA

Design real-world computer vision tasks, build reference solutions and evaluation components in Python, assess AI model outputs, identify failure modes, and develop structured rubrics and guidelines. Collaborate with experts to maintain high-quality training data and evaluation standards for multimodal and generative vision systems. Part-time, remote contractor role (~20 hours/week).

Evaluate and review AI-generated legal content for accuracy and quality, answer legal questions, recommend authoritative references, share real-world legal workflows and standards, and collaborate with a multidisciplinary team to improve AI performance in legal domains. Part-time, remote contractor role (~10 hours/week).

Evaluate and annotate physics content, create problem sets and technical documentation, and assess AI-generated responses for scientific accuracy. Contribute to dataset creation and provide expert feedback to improve AI model training. Collaborate remotely with project teams to ensure timely, high-quality deliverables and improve evaluation methodologies.

Contribute financial expertise to train and evaluate AI language models: design finance tasks, produce reference solutions, evaluate AI outputs with rubrics, collaborate with SMEs, and identify knowledge gaps to improve AI reasoning in finance. Independent contractor role requiring at least 10 hours/week.

Contractor engineering SME to review and create technical engineering content for AI training: analyze documentation, develop examples and datasets, evaluate AI outputs for technical accuracy, and collaborate with teams to improve model performance and processes.

Evaluate and author high-quality computer science content to improve AI model reasoning and accuracy. Analyze complex CS problems, create scenarios/datasets, review AI outputs for correctness, and collaborate remotely to refine guidelines and documentation.

Perform structured evaluations of AI assistants using MCP and plugins: design realistic prompts, execute multi-step personal workflows (screen-recorded), assess outputs for usefulness and safety, identify failures, and write detailed reports and rubrics. Remote, US-based contractor role requiring 20+ hours/week and rapid task turnaround.

Design and evaluate performance engineering tasks for AI training/evaluation. Optimize runtime, compilers, memory, CPU/GPU and concurrency. Produce documented solutions, evaluate AI-generated code, and build evaluation frameworks and scoring rubrics while collaborating with researchers and SMEs.

Design real-world ML and NLP tasks, build reference solutions and evaluation frameworks in Python, assess LLM outputs for correctness and reasoning, identify failure modes, create scoring rubrics, and collaborate with experts to improve model capabilities. Part-time, remote contractor (~20 hours/week).

Create clear, structured rater guidelines, evaluation rubrics, and reviewer instructions for human evaluators across domains. Review and revise documentation to remove ambiguity, design scoring frameworks, handle edge cases, and collaborate with researchers and SMEs to ensure consistent, high-quality AI evaluations.