Develop and enhance Alluxio's distributed data services by solving complex problems in system efficiency, concurrency, and caching, while collaborating with senior engineers.
About Alluxio
Alluxio powers the data layer for modern AI and analytics. Proven in production at eight of the top ten internet companies and seven of the ten highest-valued enterprises globally, Alluxio’s data orchestration platform unifies data across storage systems, regions, and clouds providing a high-performance distributed caching layer built for large-scale AI workloads.
Spun out of UC Berkeley’s AMPLab by the creators of Tachyon and backed by Andreessen Horowitz, Hillhouse Capital, and Seven Seas Partners, Alluxio sits at the intersection of data, distributed systems, and AI infrastructure.
Our technology is deployed at scale by organizations such as Meta, Uber, Tencent, TikTok, Alibaba, Expedia, Rakuten, Microsoft, and Walmart, orchestrating data for billions of operations per day. Learn more at alluxio.io or on Wikipedia.
The Role
We’re looking for experienced distributed-systems engineers to join our Core Product team and advance the next generation of Alluxio’s data-orchestration engine - the foundation for AI and analytics at global scale.
As a Staff Software Engineer, you’ll work on high-impact systems problems such as:
1. Optimizing metadata management, caching, and replication across thousands of nodes.
2. Designing concurrent, fault-tolerant services for multi-region and multi-cloud environments.
3. Evolving Alluxio’s storage abstraction and scheduling layer to support large-scale AI/ML data pipelines.
4. Collaborating with internal product teams to push the limits of distributed I/O performance.
This is a hands-on, architecture-plus-implementation role for engineers who love deep systems work and want visible impact in a small, senior, highly technical team.
What You’ll Own
- Cache and metadata consistency - advance Alluxio’s intelligent caching framework for multi-tenant environments (TTL policies, write-back consistency, invalidation protocols, and distributed metadata scaling).
- High-throughput data I/O optimization - profile and optimize Alluxio’s data path across S3, GCS, HDFS, and POSIX interfaces using adaptive prefetching, async I/O, and tier-aware scheduling.
- Scaling for AI and analytics workloads - evolve the coordination layer to efficiently serve distributed AI training clusters, accelerating model load and shuffle operations across regions and clouds.
- Observability and performance insights - build fine-grained metrics and tracing for cache efficiency, throughput, and latency across storage tiers.
- Open-source leadership - drive design discussions, mentor contributors, and represent Alluxio’s core-systems direction within the OSS community.
What You’ll Do
- Design and implement core components of Alluxio’s distributed file and object-access layer.
- Optimize performance for large-scale, high-throughput environments using advanced concurrency and caching techniques.
- Build scalable metadata and coordination systems that ensure strong consistency, high availability, and minimal latency.
- Collaborate cross-functionally with product, solution-engineering, and research teams to drive roadmap and customer success.
What We’re Looking For
- Strong computer-science fundamentals and a passion for large-scale distributed systems.
- Professional experience developing in Java, C++, or Go.
- Deep understanding of concurrency, replication, fault tolerance, and performance optimization.
- Experience with distributed storage, data-access layers, or cloud infrastructure (e.g., Spark, Presto, Hadoop, Kubernetes).
- Bachelor’s or advanced degree in Computer Science or related technical field (or equivalent experience).
- Demonstrated technical leadership: defining architecture, mentoring peers, or driving major projects from design through release.
Why Alluxio
- Build infrastructure trusted by the world’s largest AI and data-driven companies.
- Join a small, senior engineering team where your designs shape the product’s evolution.
- Work directly with the original creators of open-source Alluxio.
- A culture of empathy, curiosity, and ownership - where engineers collaborate closely to solve hard problems.
Alluxio is an equal opportunity employer and does not discriminate in employment on the basis of race, color, religion, sex (including pregnancy and gender identity), national origin, political affiliation, sexual orientation, marital status, disability, genetic information, age, membership in an employee organization, retaliation, parental status, military service, or other non-merit factors.
The salary range for this US full-time position is $240,000-$315,000, depending on experience, and subject to standard withholding and applicable taxes. All candidates receive generous equity (stock options) and access to a comprehensive benefits offering. The base salary range reflects the minimum and maximum target for candidates across all US locations. Work location, skills, experience, and any relevant education or training determine the compensation awarded to the candidate. The Recruiting Team or Hiring Manager can share more about the specific salary range with you during the recruitment process.
Top Skills
C/C++
Go
Java
Alluxio San Mateo, California, USA Office
1825 S Grant St, Suite 800, San Mateo, CA, United States, 94402
Similar Jobs
Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
The Staff Software Engineer will develop scalable code, collaborate with product owners, enhance products, mentor colleagues, and apply AI in workflows.
Top Skills:
AngularJavaJavaScriptReactVue
Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
Design and develop scalable software components, mentor junior engineers, collaborate with product teams, and integrate AI in workflows.
Top Skills:
AngularJavaJunitPythonReactSeleniumTestngUnix-Based SystemsVue
Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
Design and implement scalable software systems, mentor junior engineers, and integrate automated testing while collaborating to improve platform performance and resilience.
Top Skills:
AngularJavaJunitPythonReactSeleniumTestngVue
What you need to know about the San Francisco Tech Scene
San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.
Key Facts About San Francisco Tech
- Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Google, Apple, Salesforce, Meta
- Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
- Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
- Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine
