Similar Jobs
As a company, Reddit primarily generates revenue through advertising, and we're working towards building a massive business to fund our mission. We distinguish ourselves from other digital ad platforms by attracting advertisers who want to connect with a specific target audience because of our passionate and engaged communities.
Reddit ads marketplace is a dynamic and complicated environment where millions of engagements among Reddit users, advertisers and the platform occur every second. It’s critical for us to extract useful and statistically significant signals from the massive volume of events to guide the product developments and decisions in a scientific way.
The Ads Experimentation Platform (AEXP) team builds tools for our engineers and scientists to accurately test new products and efficiently verify new ideas in the ads marketplace. Have you heard about Budget Cannibalization? Have you wondered why a user-split A/B testing is insufficient in testing products in the Ads marketplace? How can we make the most out of rare and sparse samples (e.g. conversion events)? How can I explore 100 algorithmic candidates at the same time? These are the typical problems we are dealing with on a daily basis.
Meanwhile, Ads Pacing plays a crucial role in both supporting the dynamism of the marketplace and accommodating the budget-aware A/B experiments, therefore our team is also committed to building scalable and flexible pacing infrastructures that improves the market efficiency and budget-aware testing capacity.
Some of the project highlights include:
- An A/B testing framework that split both users and ad budgets to create parallel and mutually exclusive control/treatment sub ads marketplaces,
- An exploration tool that can run multiple (hundreds of) A/B testing pairs of campaigns over multiple algorithmic candidates for pacing,
- Partitioning the pacing and budgeting systems to accommodate the growing number of advertisers and maintain the refreshing rate above once per minute,
As a senior software engineer in the Ads Experimentation Platform team, you will work closely with data science partners and product leaders to improve the capacity and efficiency of existing experimentation tools, research and build new testing methodologies and tools, and lead the experimentation practices across the Ads marketplace teams. You will collaborate with cross-functional engineering, product, and data science teams to ensure that our customers’ voices are represented in your work..
Responsibilities:
- Building A/B testing tools customized for Ads marketplace,
- Building A/B testing tools for measuring infra cost by each ad product,
- Building advertiser-facing tools for exploring through Reddit Ads products and optimizing for the best performances,
- Building scalable and reliable ad pacing platform to enable efficient experimentation and research on the control algorithms,
Who You Might Be:
- Degree in a quantitative discipline: engineering, statistics, operations research, computer science, informatics, applied mathematics, economics, etc.
- 5+ years of contributing high-quality code to production systems that operate at scale.
- 3+ years of experience building ads-serving related systems, including but not limited to ads targeting, ads ranking, ads pacing.
- Experience building A/B testing frameworks for multiparty marketplace scenarios, e.g. food delivery service, ride sharing, ads marketplace.
- Experience leading large engineering teams and collaborating with cross-functional partners is required, especially with data science partners.
Required qualifications:
- Significant experience in one or more backend programming languages, experience with Go or Scala is preferable.
- Significant experience with API development and service frameworks, e.g. Thrift and Protobuf.
- Data processing frameworks like Spark, Flink, Kafka, Druid, etc.
- A cloud service provider like AWS or GCP
- Tools: Kubernetes, Drone, CircleCI, Spinnaker, Argo, Airflow, Docker.
- Datastores: ElasticSearch / Amazon OpenSearch, Redis, Postgres, Cassandra, BigQuery
Benefits:
- Comprehensive Healthcare Benefits and Income Replacement Programs
- 401k Match
- Family Planning Support
- Gender-Affirming Care
- Mental Health & Coaching Benefits
- Flexible Vacation & Reddit Global Days Off
- Generous paid Parental Leave
- Paid Volunteer time off
#li-remote
Pay Transparency:
This job posting may span more than one career level.
In addition to base salary, this job is eligible to receive equity in the form of restricted stock units, and depending on the position offered, it may also be eligible to receive a commission. Additionally, Reddit offers a wide range of benefits to U.S.-based employees, including medical, dental, and vision insurance, 401(k) program with employer match, generous time off for vacation, and parental leave. To learn more, please visit https://www.redditinc.com/careers/.
To provide greater transparency to candidates, we share base pay ranges for all US-based job postings regardless of state. We set standard base pay ranges for all roles based on function, level, and country location, benchmarked against similar stage growth companies. Final offer amounts are determined by multiple factors including, skills, depth of work experience and relevant licenses/credentials, and may vary from the amounts listed below.
In select roles and locations, the interviews will be recorded, transcribed and summarized by artificial intelligence (AI). You will have the opportunity to opt out of recording, transcription and summarization prior to any scheduled interviews.
During the interview, we will collect the following categories of personal information: Identifiers, Professional and Employment-Related Information, Sensory Information (audio/video recording), and any other categories of personal information you choose to share with us. We will use this information to evaluate your application for employment or an independent contractor role, as applicable. We will not sell your personal information or disclose it to any third party for their marketing purposes. We will delete any recording of your interview promptly after making a hiring decision. For more information about how we will handle your personal information, including our retention of it, please refer to our Candidate Privacy Policy for Potential Employees and Contractors.
Reddit is proud to be an equal opportunity employer, and is committed to building a workforce representative of the diverse communities we serve. Reddit is committed to providing reasonable accommodations for qualified individuals with disabilities and disabled veterans in our job application procedures. If, due to a disability, you need an accommodation during the interview process, please let your recruiter know.
Reddit San Francisco, California, USA Office
1455 Market St., San Francisco, CA, United States, 94103
What you need to know about the San Francisco Tech Scene
Key Facts About San Francisco Tech
- Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Google, Apple, Salesforce, Meta
- Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
- Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
- Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine
