The future of AI — whether in training or evaluation, classical ML or agentic workflows — starts with high-quality data.
At HumanSignal, we’re building the platform that powers the creation, curation, and evaluation of that data. From fine-tuning foundation models to validating agent behaviors in production, our tools are used by leading AI teams to ensure models are grounded in real-world signal, not noise.
Our open-source product, Label Studio, has become the de facto standard for labeling and evaluating data across modalities — from text and images to time series and agents-in-environments. With over 250,000 users and hundreds of millions of labeled samples, it’s the most widely adopted OSS solution for teams working on building AI systems.
Label Studio Enterprise builds on that traction with the security, collaboration, and scalability features needed to support mission-critical AI pipelines — powering everything from model training datasets to eval test sets to continuous feedback loops.We started before foundation models were mainstream, and we’re doubling down now that AI is eating the world. If you're excited to help leading AI teams build smarter, more accurate systems — we’d love to talk.
HumanSignal is seeking highly qualified STEM (Science, Technology, Engineering, Mathematics) experts to contribute to cutting-edge AI development projects. This role involves evaluating, annotating, and validating scientific and technical content across multiple STEM disciplines to improve AI model performance in scientific reasoning, problem-solving, and explanation.
CompensationUp to $110 USD/hour based on qualifications and project complexity
Required QualificationsEducation- Master's degree required in a STEM-related field
- PhD strongly preferred in:
- Physics
- Chemistry
- Biology
- Engineering (any discipline)
- Earth Sciences
- Materials Science
- Astronomy/Astrophysics
- Or closely related scientific disciplines
Candidates must hold degrees directly in STEM fields. Acceptable programs include:
- Physics (Theoretical, Experimental, Applied)
- Chemistry (Organic, Inorganic, Physical, Analytical)
- Biology (Molecular, Cellular, Ecology, Genetics)
- Engineering (Mechanical, Electrical, Chemical, Civil, etc.)
- Materials Science
- Earth Sciences/Geology
- Astronomy/Astrophysics
- Biochemistry/Biophysics
- Environmental Science
- Review and evaluate scientific content for accuracy, rigor, and clarity
- Annotate scientific reasoning steps and experimental methodologies
- Validate AI-generated scientific explanations across various complexity levels
- Identify errors in scientific concepts, calculations, and experimental design
- Provide detailed feedback on scientific writing and problem-solving approaches
- Work with problems spanning introductory to advanced STEM topics
- Assess the appropriateness of scientific analogies and explanations
- Deep understanding of scientific principles across one or more STEM domains
- Strong analytical and critical thinking skills
- Excellent attention to detail and scientific precision
- Ability to clearly articulate complex scientific concepts
- Experience with scientific notation, units, and dimensional analysis
- Familiarity with experimental design and data analysis
- Knowledge of scientific literature and research methodologies
- Ability to work independently and meet deadlines
- Flexible, project-based work - work on your own schedule
- Remote position - work from anywhere
- Variable hours based on project availability and your capacity
- Ongoing training and calibration provided
- Quality-focused environment with performance feedback
- Active researchers, professors, industry scientists, or recent graduates in STEM fields
- Strong publication record or demonstrated scientific expertise
- Experience in scientific research, teaching, or industry applications
- Ability to work across multiple STEM disciplines
- Passion for advancing AI capabilities in scientific domains
Interested candidates should be prepared to:
- Submit CV/resume highlighting STEM qualifications
- Provide proof of advanced degree(s)
- Complete a brief STEM content assessment
- Participate in a qualification review
HumanSignal is a leading provider of AI data annotation and labeling services, powering the development of next-generation AI systems. We work with top technology companies and research institutions to create high-quality training data.
HumanSignal is an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees.
Top Skills
HumanSignal San Francisco, California, USA Office
San Francisco, California, United States, 94103
Similar Jobs
What you need to know about the San Francisco Tech Scene
Key Facts About San Francisco Tech
- Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Google, Apple, Salesforce, Meta
- Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
- Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
- Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine
