The Staff Engineer will lead the architecture and technical vision for the Acceldata Open Data Platform, focusing on distributed systems, mentoring engineers, and contributing to open-source communities.
ABOUT THE ROLE
WHY JOIN US
We are seeking a Staff Engineer with at least 9 years of experience in distributed systems or data platform development. In this role, you will be a technical leader responsible for architecting and driving the technical direction of critical components within the Acceldata Open Data Platform (ODP). You will work on solving the most challenging distributed systems problems, contribute to open-source communities, and mentor senior engineers while shaping the future of large-scale data infrastructure.
You'll lead high-impact initiatives that directly influence how petabyte-scale data is managed, observed, and optimized across hybrid and cloud ecosystems. You'll collaborate with industry experts, Apache committers, and seasoned engineers who share your passion for distributed systems and open-source innovation.
WHY JOIN US
At Acceldata, you won't just be writing code; you'll be defining the architecture and technical vision for modern data platforms used by some of the world's largest enterprises.
Your technical decisions will shape mission-critical systems, and your contributions will be visible across the global data ecosystem. If you're ready to take ownership of complex technical challenges and drive innovation at scale, Acceldata is where you belong.
RESPONSIBILITIES
- Own the end-to-end architecture of major platform components, driving design decisions that impact scalability, reliability, and performance.
- Architect and implement next-generation distributed data storage, processing, and query optimization systems.
- Partner with product, engineering leadership, and stakeholders to define technical roadmaps and translate business requirements into scalable solutions.
- Lead contributions to Apache projects and open-source communities, establishing Acceldata's presence and technical reputation.
- Identify and resolve complex performance bottlenecks across distributed systems, optimizing for cost, latency, and throughput.
- Mentor and guide Senior Software Engineers, fostering technical excellence and a culture of continuous learning.
- Establish and enforce coding standards, perform thorough code reviews, and ensure architectural consistency across the platform.
- Evaluate and recommend emerging technologies, tools, and frameworks that align with platform goals.
- Lead root cause analysis for critical production issues and drive systemic improvements to prevent recurrence.
- Work across diverse environments: Bare Metals, VM, Kubernetes, and multi-cloud architectures.
REQUIREMENTS
- 9+ years of hands-on software development experience with at least 5 years focused on distributed systems or big data platforms.
- Expert-level proficiency in Java or Scala, with strong Python skills. Experience with systems languages is a plus.
- Deep understanding of distributed computing principles, including consensus algorithms, data partitioning, replication, fault tolerance, and consistency models.
- Extensive hands-on experience with multiple components of the big data stack (Hadoop, Spark, Hive, Trino, Kafka, Flink, NiFi or similar).
- Expert-level Linux proficiency, including kernel tuning, performance analysis, and debugging at the system level.
- Strong experience with Kubernetes, Docker, and cloud platforms (AWS, GCP, or Azure).
- Deep expertise with Maven, Gradle, or SBT; experienced in CI/CD pipelines, GitHub, and artifact management (Nexus).
- Proven ability to diagnose and resolve complex issues, including memory leaks, deadlocks, GC tuning, and distributed system failures.
- Strong understanding of architectural patterns for scalable, fault-tolerant distributed systems.
- Excellent written and verbal communication skills; ability to articulate complex technical concepts to diverse audiences, including senior leadership.
- Demonstrated ability to work effectively with cross-functional teams, external contributors, and the open-source community. PREFERRED SKILLS
- History of significant contributions or committer status in Apache projects (e.g., Spark, Kafka, Hive, Iceberg, Flink, etc.).
- Experience with modern table formats (Apache Iceberg, Delta Lake, Hudi) and data lake architectures.
- Experience developing or optimizing query engines, query planners, or execution frameworks.
- Familiarity with data governance, security, lineage, and compliance frameworks.
- Experience leading large-scale data platform migrations or Hadoop distribution upgrades.
- Published technical blogs, papers, or conference presentations on distributed systems topics.
- Experience leading or maintaining open-source projects.
acceldata Campbell, California, USA Office
2105 S Bascom Ave, Campbell, CA, United States, 95008
Similar Jobs
Artificial Intelligence • Cloud • Computer Vision • Hardware • Internet of Things • Software
Manage enterprise customers after implementation, helping them achieve business value from Samsara’s IoT platform. Develop joint success plans, lead executive business reviews and customer workshops, recommend workflow improvements, explain platform capabilities, resolve barriers, and mentor Customer Success and Support teams. Collaborate with Sales, Support, Sales Engineering, Product, and Engineering while supporting customers across transportation, utilities, field services, and other physical-operation industries.
Top Skills:
Internet Of Things (Iot)SaaS
Cloud • Information Technology • Internet of Things • Machine Learning • Software • Cybersecurity • Infrastructure as a Service (IaaS)
Develop and integrate scheduler, baseband, and radio resource management software for 5G/6G Cloud RAN vDU systems. Translate 3GPP standards into reliable embedded real-time software, debug complex issues, create development tools, and contribute to testing, documentation, CI/CD, and AI/ML-enabled RAN solutions.
Top Skills:
3Gpp5G6GAi/MlBashCC++Ci/CdCloud RanEmbedded SystemsGerritGitGitlabJenkinsLinuxmacOSPdcpPythonReal-Time SoftwareRlcRrmVdu
eCommerce • Fashion • Retail • Sales • Wearables • Design
Serve as a Coach brand ambassador by providing personalized luxury-retail styling and sales service. Build client relationships, meet individual and team sales goals, use POS and clienteling tools, process transactions, and support omnichannel selling. Handle inventory receiving, replenishment, visual merchandising, cash wrap, stockroom organization, and online pickups while maintaining store standards. Work collaboratively in a fast-paced environment with flexible availability, including nights, weekends, holidays, and peak seasons.
Top Skills:
Clienteling ToolsIpadLaptopMobile PosPosShort-Form VideoSocial Selling PlatformsWalkie-Talkie
What you need to know about the San Francisco Tech Scene
San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.
Key Facts About San Francisco Tech
- Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Google, Apple, Salesforce, Meta
- Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
- Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
- Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine
