Anyscale Logo

Anyscale

Software Engineer (Ray Data)

Posted One Month Ago
In-Office
San Francisco, CA, USA
215K-230K Annually
Mid level
In-Office
San Francisco, CA, USA
215K-230K Annually
Mid level
Develop and optimize Ray Data, a Python-native distributed data processing engine for AI workloads. Improve performance, scalability, data loading, stability, and fault tolerance across heterogeneous environments. Build production training data solutions and collaborate with customers and AI-native companies to scale large machine learning workloads.
The summary above was generated by AI

About Anyscale:

At Anyscale, we're on a mission to democratize distributed computing and make it accessible to software developers of all skill levels. We’re commercializing Ray, a popular open-source project that's creating an ecosystem of libraries for scalable machine learning. Companies like OpenAI, Uber, Spotify, Instacart, Cruise, and many more, have Ray in their tech stacks to accelerate the progress of AI applications out into the real world.

With Anyscale, we’re building the best place to run Ray, so that any developer or data scientist can scale an ML application from their laptop to the cluster without needing to be a distributed systems expert.

Proud to be backed by Andreessen Horowitz, NEA, and Addition with $250+ million raised to date.

About Ray Data Team:

Ray Data is Python-native data processing engine that is a one stop shop for all AI data processing needs. Ray Data provides performant, first-class integration with cutting edge AI frameworks using both multi-modal and structured data.

The Ray Data team currently develops and maintains Ray Data. We are a team of engineers passionate about building a Data processing engine which is a one-stop shop for all of your ML/AI needs. We are looking for exceptional engineers to build, optimize, and scale Ray for modern and increasingly complex AI workloads.

As part of this role, you will:

  • Improve the performance of Ray Data and multi-modal batch inference use cases.

  • Ensure efficient scaling across different stages of the Data pipeline in a heterogeneous environment.

  • Building data loading solutions for production training workloads.

  • Focus on stability and fault tolerance at high scale

  • Working with customers and new age AI native companies in scaling their AI workloads.

We'd love to hear from you if have:

  • At least 3-4 years of relevant work experience

  • Solid background in building scalable and fault-tolerant distributed systems

  • Experience with data processing, database internals.

  • Passionate about large scale systems and performance for AI.

 
Why Anyscale
  • We're on a mission to make scalable computing effortless. Ray is the AI Compute Engine at the center of some of the world's most powerful AI platforms

  • Our tech is in production at companies like OpenAI, Uber, Spotify, Instacart, and Cruise

  • We're backed by Andreessen Horowitz, NEA, and Addition, with $250M+ raised to date

  • Recent partnerships with Azure, CoreWeave, and Google Cloud are putting AI-native compute directly into enterprise environments

  • Competitive salary and equity, plus health/dental/vision coverage (many plans up to 99% employer-covered)

  • We offer flexible time off, paid parental leave, and mental health support

Anyscale Inc. is an Equal Opportunity Employer. Candidates are evaluated without regard to age, race, color, religion, sex, disability, national origin, sexual orientation, veteran status, or any other characteristic protected by federal or state law. 

Anyscale Inc. is an E-Verify company and you may review the Notice of E-Verify Participation and the Right to Work posters in English and Spanish

HQ

Anyscale San Francisco, California, USA Office

San Francisco, CA, United States, 94105

Anyscale Palo Alto, California, USA Office

Palo Alto, United States

Similar Jobs

12 Days Ago
In-Office
San Francisco, CA, USA
230K-260K Annually
Senior level
230K-260K Annually
Senior level
Artificial Intelligence • Software
Design, build, optimize, and scale Ray Data’s distributed data processing infrastructure for large-scale AI training and inference. Responsibilities include distributed execution, scheduling, resource management, data partitioning, fault tolerance, performance optimization, and system architecture. The role also involves collaborating with customers and AI-native companies to solve complex workload-scaling challenges.
Top Skills: Ai InfrastructureDistributed SystemsPythonRayRay Data
A Minute Ago
Hybrid
156K-281K Annually
Expert/Leader
156K-281K Annually
Expert/Leader
Artificial Intelligence • Fintech • Insurance • Marketing Tech • Software • Analytics
Leads Risk Engineering across the US and Latin America, focusing on energy and construction risks. Manages regional teams, staffing, budgets, workflows, technical standards, survey strategy, and client service plans. Partners with underwriting, claims, actuarial, finance, and product leadership on risk, pricing, portfolio, and referral decisions. Represents the organization with brokers, clients, and industry stakeholders through business development, conferences, presentations, and thought leadership. Oversees risk appraisals, inspections, recommendations, and regional implementation of global strategy.
Top Skills: Microsoft Office Suite
A Minute Ago
Hybrid
91K-278K Annually
Expert/Leader
91K-278K Annually
Expert/Leader
Artificial Intelligence • Fintech • Insurance • Marketing Tech • Software • Analytics
Independently underwrites complex environmental insurance risks, evaluates and prices business, manages broker and client portfolios, and develops profitable underwriting strategies. Maintains senior market relationships, provides analytical input to business planning, interprets relevant legal and regulatory developments, and supports process-improvement initiatives. Mentors and trains underwriters while collaborating with claims, actuarial, underwriting support, and leadership teams.

What you need to know about the San Francisco Tech Scene

San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.

Key Facts About San Francisco Tech

  • Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Google, Apple, Salesforce, Meta
  • Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
  • Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
  • Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account