About the company
Our client is a fast-growing software company.
The role
Raydar is recruiting for this role on behalf of our client. Own production infrastructure that supports large-scale automated data collection from websites that try to restrict it. The work spans network routing, session handling and troubleshooting stubborn intermittent faults, with full ownership from the first day.
What you'll do
- Design and run proxy pools, session handling and isolated outbound traffic at scale.
- Maintain a high rate of successful requests even when target sites deploy strong anti-automation protections.
- Develop and maintain systems that manage browser identity signals and handle verification challenges.
- Oversee the reliability and cost profile of the proxy layer.
- Investigate elusive, intermittent failures across the stack and resolve them permanently.
Requirements
What we're looking for
- Hands-on, production-scale experience building proxy systems or data extraction pipelines that operate against hostile website defenses.
- Recent experience, within the last 2 years, working around strong anti-bot protections as a hands-on individual contributor.
- Production experience managing browser and TLS identity signals and automated challenge handling.
- Proficiency in Go and/or Python.
- Strong grounding in core networking, such as transport and application protocols, connection reuse and proxy coordination.
- Full ownership of production systems, including on-call duty.
- A commitment to reliability and comfort working on messy, adversarial problems.
- A preference for shipping, measuring and iterating quickly.
Bonus points
- Experience with monitoring and alerting tools such as Prometheus and Grafana.
Benefits
Compensation and benefits
- Base salary: USD 235,000 to 260,000 per year
- Equity
- Health, dental and vision coverage
- Life and disability insurance
- Paid parental leave
- Flexible time off
- Retirement plan
Location and work model
- San Francisco Bay Area, California, United States
- Hybrid
- Full-time
Similar Jobs
What you need to know about the San Francisco Tech Scene
Key Facts About San Francisco Tech
- Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Google, Apple, Salesforce, Meta
- Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
- Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
- Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine
