Anyscale Logo

Anyscale

Software Engineer (Ray Data)

Posted 2 Months Ago
In-Office
San Francisco, CA, USA
215K-230K Annually
Mid level
In-Office
San Francisco, CA, USA
215K-230K Annually
Mid level
Develop and optimize Ray Data, a Python-native distributed data processing engine for AI workloads. Improve performance, scalability, data loading, stability, and fault tolerance across heterogeneous environments. Build production training data solutions and collaborate with customers and AI-native companies to scale large machine learning workloads.
The summary above was generated by AI

About Anyscale:

At Anyscale, we're on a mission to democratize distributed computing and make it accessible to software developers of all skill levels. We’re commercializing Ray, a popular open-source project that's creating an ecosystem of libraries for scalable machine learning. Companies like OpenAI, Uber, Spotify, Instacart, Cruise, and many more, have Ray in their tech stacks to accelerate the progress of AI applications out into the real world.

With Anyscale, we’re building the best place to run Ray, so that any developer or data scientist can scale an ML application from their laptop to the cluster without needing to be a distributed systems expert.

Proud to be backed by Andreessen Horowitz, NEA, and Addition with $250+ million raised to date.

About Ray Data Team:

Ray Data is Python-native data processing engine that is a one stop shop for all AI data processing needs. Ray Data provides performant, first-class integration with cutting edge AI frameworks using both multi-modal and structured data.

The Ray Data team currently develops and maintains Ray Data. We are a team of engineers passionate about building a Data processing engine which is a one-stop shop for all of your ML/AI needs. We are looking for exceptional engineers to build, optimize, and scale Ray for modern and increasingly complex AI workloads.

As part of this role, you will:

  • Improve the performance of Ray Data and multi-modal batch inference use cases.

  • Ensure efficient scaling across different stages of the Data pipeline in a heterogeneous environment.

  • Building data loading solutions for production training workloads.

  • Focus on stability and fault tolerance at high scale

  • Working with customers and new age AI native companies in scaling their AI workloads.

We'd love to hear from you if have:

  • At least 3-4 years of relevant work experience

  • Solid background in building scalable and fault-tolerant distributed systems

  • Experience with data processing, database internals.

  • Passionate about large scale systems and performance for AI.

 
Why Anyscale
  • We're on a mission to make scalable computing effortless. Ray is the AI Compute Engine at the center of some of the world's most powerful AI platforms

  • Our tech is in production at companies like OpenAI, Uber, Spotify, Instacart, and Cruise

  • We're backed by Andreessen Horowitz, NEA, and Addition, with $250M+ raised to date

  • Recent partnerships with Azure, CoreWeave, and Google Cloud are putting AI-native compute directly into enterprise environments

  • Competitive salary and equity, plus health/dental/vision coverage (many plans up to 99% employer-covered)

  • We offer flexible time off, paid parental leave, and mental health support

Anyscale Inc. is an Equal Opportunity Employer. Candidates are evaluated without regard to age, race, color, religion, sex, disability, national origin, sexual orientation, veteran status, or any other characteristic protected by federal or state law. 

Anyscale Inc. is an E-Verify company and you may review the Notice of E-Verify Participation and the Right to Work posters in English and Spanish

HQ

Anyscale San Francisco, California, USA Office

San Francisco, CA, United States, 94105

Anyscale Palo Alto, California, USA Office

Palo Alto, United States

Similar Jobs

One Month Ago
In-Office
San Francisco, CA, USA
240K-270K Annually
Senior level
240K-270K Annually
Senior level
Artificial Intelligence • Software
Design, build, optimize, and scale Ray Data’s distributed data processing infrastructure for large-scale AI training and inference. Responsibilities include distributed execution, scheduling, resource management, data partitioning, fault tolerance, performance optimization, and system architecture. The role also involves collaborating with customers and AI-native companies to solve complex workload-scaling challenges.
Top Skills: Ai InfrastructureDistributed SystemsPythonRayRay Data
6 Minutes Ago
In-Office
Richmond, CA, USA
30K-90K Annually
Entry level
30K-90K Annually
Entry level
Fintech • Payments • Financial Services
Own a local territory, prospect face-to-face, build relationships with business owners, and win new members for Teya’s financial products. Responsibilities include consultative selling, pipeline and target management, onboarding customers, representing the brand locally, learning products and sales methods, and sharing field insights. The role requires strong communication, resilience, commercial awareness, self-discipline, a full UK driving licence, access to a car, and regular territory travel.
Top Skills: Financial Technology (Fintech)Payment Processing
27 Minutes Ago
Remote or Hybrid
16 Locations
160K-200K Annually
Senior level
160K-200K Annually
Senior level
Information Technology • Productivity • Software • Infrastructure as a Service (IaaS)
Lead development of scalable Java backend applications and high-availability cloud services. Design architectures, REST APIs, databases, caching systems, and distributed session infrastructure. Mentor engineers, drive technical initiatives, address performance and scalability challenges, and uphold quality and automation practices for endpoint management products.
Top Skills: AWSC++Caching SystemsData WarehousesGoJavaKotlinPostgresRelational DatabasesRestSpring

What you need to know about the San Francisco Tech Scene

San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.

Key Facts About San Francisco Tech

  • Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Google, Apple, Salesforce, Meta
  • Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
  • Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
  • Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account