Unity Logo

Unity

Staff Data Scientist - Ads Experimentation & Measurements

Posted 2 Days Ago
Be an Early Applicant
Hybrid
San Francisco, CA, USA
158K-237K Annually
Senior level
Hybrid
San Francisco, CA, USA
158K-237K Annually
Senior level
Lead experimentation and evaluation initiatives for Unity's Ads Platform by enhancing A/B testing methods, developing automated ML experimentation frameworks, and ensuring statistical rigor in product lifecycle.
The summary above was generated by AI

The opportunity
Unity’s Ads Experimentation Platform team is looking for a Staff Data Scientist to lead the evolution of how we validate and optimize our global advertising ecosystem. At Unity, our ads reach billions of devices, and the ability to rapidly iterate on machine learning models or ads delivery pipelines is critical to our growth.

In this role, you will be the technical authority for our experimentation and evaluation roadmap. You will bridge the gap between advanced statistical methodology and large-scale engineering, building the tools that allow ML teams to iterate faster and with higher confidence. You will join a team focused on high-velocity innovation, moving beyond standard A/B testing into the next generation of causal inference and high-sensitivity evaluation methodologies.

What you'll be doing

  • Advance A/B Testing Efficiency: Lead the implementation of variance reduction (CUPED) and sequential testing to increase platform sensitivity and speed. You will develop strategies to mitigate interference and network effects, ensuring results reflect true causal impact in a complex auction environment.
  • Scale Ranking Evaluations: Architect and deploy interleaving frameworks to rapidly assess ranking model performance in real-time. This enables the team to identify winning candidates orders-of-magnitude faster than standard bucket testing.
  • Reduce Budget Cannibalization Effects: Design methodologies to account for finite advertiser budgets and prevent experimental groups from cannibalizing each other's spend. You will develop pacing-aware evaluation techniques to maintain marketplace integrity and ensure unbiased results.
  • Define Long-Term Value (LTV) Proxy Metrics: Research and validate surrogate metrics that correlate highly with long-term user retention and value. You will provide ML teams with short-term signals that accurately predict long-term impact, enabling faster optimization for long-term growth.
  • Drive Automated ML Experimentation: Build the statistical foundations for automated pipelines that autonomously test and select optimal features and hyperparameters. This reduces manual engineering overhead and accelerates the deployment of high-performing models at scale.
  • Cross-Functional Technical Leadership: Serve as the lead subject matter expert on experimentation for ML, Product, and Engineering teams. You will ensure statistical rigor is integrated throughout the product lifecycle, from initial model training to live production auctions.

What we're looking for

  • Extensive Experience: 8+ years of experience in Data Science or Applied Research, specifically within Ad Tech, Marketplaces, or high-scale experimentation platforms.
  • Advanced Education: An MS or PhD in a quantitative field (Statistics, Economics, Computer Science, Operations Research, or equivalent).
  • Statistical Mastery: Deep expertise in causal inference, experimental design, and frequentist/Bayesian statistics, with a proven track record of applying these to high-volume, real-time data.
  • Technical Proficiency: Strong programming skills in Python or Scala, and experience with large-scale data processing frameworks like Spark, Snowflake, or BigQuery.
  • Specialized Knowledge: Practical experience implementing advanced testing methodologies like CUPED, interleaving, or switchback testing in production environments.
  • Strategic Leadership: Ability to translate complex statistical concepts into clear product roadmaps and mentor engineering teams on experimental rigor.

Additional information

  • Relocation support is not available for this position
  • Work visa/immigration sponsorship is not available for this position

Benefits
At Unity, we want our team members to thrive. We offer a wide range of benefits designed to support well-being and work-life balance.

Please note: Benefits eligibility, specific offerings, and coverage vary based on the country and employment status.

While specific benefits vary, here are some of the ways we strive to take care of our eligible team members globally: Comprehensive health, life, and disability insurance | Commute subsidy | Employee stock ownership | Competitive retirement/pension plans | Generous vacation and personal days | Support for new parents through leave and family-care programs | Office food snacks | Mental Health and Wellbeing programs and support | Employee Resource Groups | Global Employee Assistance Program | Training and development programs | Volunteering and donation matching program

Life at Unity
Unity [NYSE: U] is the world’s leading game engine, powering play for more than 3 billion consumers each month. The top mobile games in the world, the most played PC indie titles, the most innovative console games, and virtually all of the top XR and Web Games are developed, deployed, and grown in Unity. Unity also enables teams across industries like automotive, manufacturing, and healthcare to design, simulate, and collaborate in 3D — closing the gap between ideas and reality. For more information, please visit www.unity.com.

Unity is a proud equal opportunity employer. We are committed to fostering an inclusive, innovative environment and celebrate our employees across age, race, color, ancestry, national origin, religion, disability, sex, gender identity or expression, sexual orientation, or any other protected status in accordance with applicable law. Our differences are strengths that enable us to support the growing and evolving needs of our customers, partners, and collaborators. If you have a disability that means there are preparations or accommodations we can make to help ensure you have a comfortable and positive interview experience, please fill out this form to let us know.

Pursuant to the San Francisco Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records.

This position requires the incumbent to have a sufficient knowledge of English to have professional verbal and written exchanges in this language since the performance of the duties related to this position requires frequent and regular communication with colleagues and partners located worldwide and whose common language is English.

Headhunters and recruitment agencies may not submit resumes/CVs through this Web site or directly to managers. Unity does not accept unsolicited headhunter and agency resumes. Unity will not pay fees to any third-party agency or company that does not have a signed agreement with Unity.

Your privacy is important to us. Please take a moment to review our Prospect Privacy Policy and Applicant Privacy Policy. Should you have any concerns about your privacy, please contact us at [email protected].

#SEN

*Note: Certain locations require a good faith disclosure of the base salary range for the role. The actual salary for the successful candidate may differ based on location, experience, and other job-related factors.

Gross pay salary
$157,800$236,800 USD

Top Skills

BigQuery
Python
Scala
Snowflake
Spark

Unity San Francisco, California, USA Office

Work at Unity includes a ton of flexibility, depending on your role, the needs of your team and ultimately the way you and your team work best together.

Similar Jobs

An Hour Ago
Hybrid
Menlo Park, CA, USA
156K-187K Annually
Senior level
156K-187K Annually
Senior level
Artificial Intelligence • Big Data • Healthtech • Machine Learning • Software • Biotech
The Senior Data Scientist will apply machine learning to improve cancer detection, collaborating across teams to analyze genomic data and develop innovative solutions.
Top Skills: CC++GitGoJavaPythonR
An Hour Ago
Remote or Hybrid
San Francisco, CA, USA
184K-288K Annually
Expert/Leader
184K-288K Annually
Expert/Leader
Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
The Vendor Finance Controller oversees global partnerships with Media Agencies, ensuring contract compliance, managing budgets, and optimizing performance and costs while maintaining rigorous financial governance and cross-functional collaborations.
2 Hours Ago
Remote or Hybrid
San Francisco, CA, USA
Junior
Junior
Artificial Intelligence • Fintech • Payments • Business Intelligence • Financial Services • Generative AI
The Senior Associate, Revenue Operations will manage territory, improve processes, own reporting, analyze data, and develop compensation plans in collaboration with sales leadership.
Top Skills: ClayExcelGsheetsLookerOutreachSalesforceZoominfo

What you need to know about the San Francisco Tech Scene

San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.

Key Facts About San Francisco Tech

  • Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Google, Apple, Salesforce, Meta
  • Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
  • Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
  • Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account