Welo Global Logo

Welo Global

Project Perseus | Data Labeling Associate - Italian Speakers (Human-in-the-Loop AI)

Posted 3 Days Ago
Be an Early Applicant
In-Office or Remote
4 Locations
34-34 Hourly
Junior
In-Office or Remote
4 Locations
34-34 Hourly
Junior
Evaluate AI outputs, audit model behavior, apply and refine labeling guidelines, identify failure modes and trends, document findings, and collaborate with cross-functional teams to improve model evaluation and data quality.
The summary above was generated by AI

Overview

Welo Data is looking for sharp, curious, and detail-oriented individuals to join our team as Data Labeling Associate.

This is not a traditional annotation role.

You’ll be working directly with cutting-edge AI systems — evaluating outputs, identifying gaps, and helping improve how these systems behave in real-world scenarios. The work sits at the intersection of data quality, model evaluation, and human judgment, where your ability to think critically matters just as much as following guidelines.

We’re looking for people who are naturally curious about AI, comfortable forming opinions, and confident in contributing to conversations with teammates, leads, and stakeholders.

Project Details

  • Job Title: Data Labeling Associate
  • Hiring in: NYC, Seattle, Bellevue, Redmond, San Francisco, Sunnyvale, Burlingame, Austin, Los Angeles, Washington DC, Chicago, Boston
  • Hours: Full-time, 40 hours per week
  • Employment Type: W2 Full-Time Employee
  • Work Authorization: Must be authorized to work in the U.S. (no visa sponsorship)
  • Pay Rate: $34/hour
  • Contract Duration: 1-year contract with possibility of extension
Important: This is a 100% onsite position — remote work is not available for this role. To be considered, candidates must be located in or able to commute to one of the following cities: New York City, Seattle, Bellevue, Redmond, San Francisco, Sunnyvale, Burlingame, Austin, Los Angeles, Washington DC, Chicago, Boston. Please only apply if you meet this location requirement.

What You’ll Do

  • Evaluate AI model outputs and provide structured, high-quality feedback
  • Perform audit-based reviews of data and model behavior — identifying patterns, edge cases, and failure modes
  • Apply guidelines thoughtfully — and flag when they don’t reflect real-world scenarios
  • Contribute to improving evaluation frameworks, not just executing them
  • Identify trends in model performance and communicate insights clearly
  • Participate in team discussions, calibrations, and stakeholder syncs
  • Partner with leads and cross-functional teams to refine quality standards
  • Document findings in a clear, concise, and actionable way

What We’re Looking For

  • Native-level language proficiency and a university degree (Bachelor’s or higher).
  • B2 or superior level of English.  
  • 1–2 years of professional writing experience with strong, structured writing skills
  • Ability to apply complex writing rules and guidelines consistently
  • Strong understanding of safety considerations in GenAI data delivery, with 2+ years of relevant experience
  • Strong critical thinking and attention to detail
  • Ability to make sound judgment calls in ambiguous situations
  • Naturally curious about AI, technology, and how systems behave
  • Comfortable speaking up, asking questions, and contributing ideas
  • Strong written and verbal communication skills
  • Ability to stay consistent while working with evolving guidelines
  • Experience in data quality, QA, annotation, or analysis is helpful — but not required

Benefits

  • Paid Vacation: 6 days
  • Paid Company Holidays: 2 days (Memorial Day and Labor Day)
  • Paid Sick Leave: accrued per applicable state law and company policy
  • Medical, Dental, and Vision Insurance (eligibility applies)
  • Health Savings Account (HSA)
  • 401(k) Retirement Plan
  • Employee Assistance Program
  • Additional voluntary benefits (life, accident, critical illness, etc.)
  • Free Gourmet Food: Free breakfast, lunch, and dinner are provided, featuring a wide variety of cuisines in multiple cafes.
  • Micro-kitchens & Snacks: Offices are stocked with free snacks and beverages, including premium coffee and La Croix.
  • Unique Campus Features: Some locations include roof-top nature parks
  • Commuter Benefits: Free transport, shuttles, and sometimes bike-to-work perks.

Similar Jobs

5 Minutes Ago
Remote or Hybrid
United States
42K-42K Annually
Junior
42K-42K Annually
Junior
Fintech • Information Technology • Insurance • Financial Services • Big Data Analytics
Serve as primary contact for customers via phone and digital channels, resolving complex policy, billing, and coverage issues end-to-end. Use AI-powered tools and guided workflows, validate AI-generated summaries, document interactions per regulatory/privacy requirements, escalate when needed, and contribute feedback and continuous improvement. Participate in required training and ongoing skill development.
Top Skills: Ai-Powered ToolsAutomated SummarizationCopilotCrm PlatformsGuided Decision WorkflowsKnowledge Bases
5 Minutes Ago
Remote or Hybrid
United States
42K-42K Annually
Junior
42K-42K Annually
Junior
Fintech • Information Technology • Insurance • Financial Services • Big Data Analytics
Provide end-to-end customer support across phone and digital channels for disability/intake inquiries, using AI-guided tools and CRM systems to resolve complex issues, document interactions, escalate when needed, and contribute to process improvements while following compliance and privacy requirements.
Top Skills: Ai-Powered ToolsAutomated SummarizationCopilotCustomer Communication SystemsCustomer Relationship Management PlatformsGuided Decision WorkflowsKnowledge Bases
6 Minutes Ago
Remote or Hybrid
United States
42K-42K Annually
Junior
42K-42K Annually
Junior
Fintech • Information Technology • Insurance • Financial Services • Big Data Analytics
Serve as the primary contact for customers via phone and digital channels, resolving complex policy, coverage, billing, and service inquiries end-to-end. Use guided, AI-powered tools, validate call summaries, document interactions per privacy and regulatory standards, escalate issues as needed, and participate in training and continuous improvement.
Top Skills: Ai-Powered ToolsCustomer Communication SystemsCustomer Relationship Management (Crm) PlatformsKnowledge Bases

What you need to know about the San Francisco Tech Scene

San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.

Key Facts About San Francisco Tech

  • Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Google, Apple, Salesforce, Meta
  • Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
  • Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
  • Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account