About the company
Our client is a software company.
The role
Raydar is recruiting for this role on behalf of our client. Own low-level performance work for machine learning model serving in production, tuning compute clusters and building the tooling that measures results. Partner with researchers to bring new model designs into live systems, and speak directly with customers when technical needs have to be pinned down.
What you'll do
- Design, deploy and tune model serving systems across multi-node clusters to raise throughput and cut response times for production workloads.
- Implement targeted performance improvements and benchmark their impact.
- Diagnose performance bottlenecks across the stack, from GPU execution to memory limits.
- Build test and benchmarking tooling that compares quality, speed and resource usage across different parallelism approaches.
- Partner with research scientists to move new model architectures and optimizations into production infrastructure.
- Keep up with academic and open-source work and apply promising ideas to improve performance.
- Talk with customers to understand and clarify their technical needs.
Requirements
What we're looking for
- Software engineering background at companies that build hardware or chip design tools.
- Track record of tuning performance for high-performance computing and machine learning workloads.
- Experience shipping native compiled software that runs in customer environments, in a language such as C, Rust or Go.
- Strong skills in Python and C++/CUDA, plus hands-on use of a common model serving framework such as PyTorch.
- A degree in electrical engineering, computer science or a closely related discipline.
- Comfortable engaging customers directly and representing the company in a professional manner.
Bonus points
- Background building performance-critical engines or algorithms at chip design software vendors.
- Familiarity with C++ performance modeling and simulation libraries.
- Experience with machine learning or heavy numerical workloads running on consumer devices.
- Experience in scientific or numerical computing.
Benefits
Compensation and benefits
- Base salary: USD 180,000 to 350,000 per year
- Equity
- Health, dental and vision coverage
- Retirement plan
- Flexible time off
- Relocation support
Location and work model
- San Jose, California, United States
- On-site, 5 days per week in office
- Full-time
Similar Jobs
What you need to know about the San Francisco Tech Scene
Key Facts About San Francisco Tech
- Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Google, Apple, Salesforce, Meta
- Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
- Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
- Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine
