Cloudera Logo

Cloudera

Senior Software Engineer

Reposted 24 Days Ago
Be an Early Applicant
In-Office
San Jose, CA, USA
5-5 Annually
Senior level
In-Office
San Jose, CA, USA
5-5 Annually
Senior level
As a Senior Software Engineer, you will develop scalable catalog services, contribute to open-source projects, and support customer deployments while collaborating with teams.
The summary above was generated by AI

Business Area:

Engineering

Seniority Level:

Mid-Senior level

Job Description: 

At Cloudera, we empower people to transform complex data into clear and actionable insights. With as much data under management as the hyperscalers, we're the preferred data partner for the top companies in almost every industry.  Powered by the relentless innovation of the open source community, Cloudera advances digital transformation for the world’s largest enterprises.

The Data Platform Pillar is the bedrock of Cloudera’s technology, where we design and build the core components that let our customers store, manage, and process data with unmatched scalability, security, and performance. 

Within this pillar, the Cloudera Data Platform (CDP) team is looking for a passionate, self-driven Senior Software Engineer with deep expertise in distributed systems to join our core engineering group. CDP provides a unified, integrated environment for data warehousing, engineering, and AI/ML across the world’s largest enterprises.

As we continue to innovate, we are building next-generation capabilities to enable seamless data sharing between CDP-hosted datasets and external applications. This requires engineers who can design and develop highly scalable enterprise products that bridge distributed computation and storage—spanning public cloud (S3, ADLS) and high-performance on-prem systems like Ozone or Dell ECS. If you enjoy solving complex interoperability challenges at a massive scale, this is the team for you.

As a Senior Software Engineer you will:

  • Develop and support a highly scalable Catalog service built around the Apache Iceberg REST specification for Cloudera Data Platform (CDP) across hybrid cloud environments.

  • Design and develop a Unified Catalog service that serves as a single endpoint for segregated data sets.

  • Contribute to premier open-source projects, building the tools that define how the industry interacts with large-scale unstructured data.

  • Work daily with a high-impact stack featuring Apache Iceberg, Spark, Impala, and Hive.

  • Work on supporting customer deployments, escalations and improving stability of the product.

We’re excited about you if you have:

  • Bachelor’s with 5+ years (or Master’s with 3+ years) of industry experience, including 3+ years building scalable, high-performance large-scale systems.

  • Proven expertise in Java (preferred) or other OOP languages, with strong skills in data structures, algorithms, and clean coding habits.

  • Solid understanding of public cloud concepts (AWS/Azure/GCP) with experience in cloud storage integration and access-control APIs.

  • Familiarity with authentication and authorization mechanisms specifically for public cloud deployments.

  • Strong debugging skills in Java environments, including experience analyzing logs, thread dumps, and heap dumps.

  • Self-starter with the ability to work independently and collaborate effectively with geographically distributed teams.

  • Strong oral and written communication skills with a sharp attention to detail and a focus on software quality.

You may also have:

  • Experience with the Big Data ecosystem and open table formats such as Apache Iceberg or Apache Hudi.

  • Proven experience developing REST-based services, with a specific focus on metadata services.

  • Working knowledge of AWS STS (Security Token Service) or similar cloud identity and access management tools.

  • Strong understanding of database internals, including query processing and query optimization techniques.

  • Active contributions to Apache open-source projects or a history of involvement in the developer community.

Why this role matters: 

You will tackle complex distributed systems challenges, crafting the foundational software for the control and data planes that powers CDP and keeps it running at massive scale. Working at the forefront of hybrid and multi-cloud technology, you will empower data scientists, engineers, and analysts with the tools and infrastructure they need for advanced analytics and modeling.

Collaboration is key, you will work alongside brilliant minds across product, data science, and engineering to drive innovation, standardize best practices, and shape the future of enterprise AI and data platforms. This is your chance to build the future of data and see your work make a global impact.

This role is not eligible for immigration sponsorship.

What you can expect from us:

  • Generous PTO Policy 

  • Support work life balance with Unplugged Days

  • Flexible WFH Policy 

  • Mental & Physical Wellness programs 

  • Phone and Internet Reimbursement program 

  • Access to Continued Career Development 

  • Comprehensive Benefits and Competitive Packages 

  • Paid Volunteer Time

  • Employee Resource Groups

EEO/VEVRAA

#LI-HYBRID

#LI-REMOTE

#LI-BV1

HQ

Cloudera Palo Alto, California, USA Office

395 Page Mill Rd, Palo Alto, CA, United States, 94304

Cloudera San Francisco, California, USA Office

525 Market St, San Francisco, CA, United States, 94105

Similar Jobs

Yesterday
Hybrid
San Francisco, CA, USA
185K-200K Annually
Senior level
185K-200K Annually
Senior level
Artificial Intelligence • HR Tech • Software • Business Intelligence
Lead development and operation of backend services and AWS infrastructure, focusing on Django/Postgres backends, reliability, scalability, CI/CD, automation, observability, incident response, and platform engineering to support AI/ML and data warehouse systems.
Top Skills: AWSCi/CdContainersDjangoInfrastructure As CodeKubernetesMl OpsObservabilityPostgresPython
4 Days Ago
Hybrid
200K-425K Annually
Senior level
200K-425K Annually
Senior level
Artificial Intelligence • Big Data • Consumer Web • eCommerce
Own and ship a consumer-facing "chat truth" surface end-to-end: define specs and mockups, direct agent-driven builds, create evals and verification gates for citation-bearing streaming UIs across web, extension, ChatGPT app, and mobile, and measure falsifiable outcomes.
4 Days Ago
In-Office
250K-480K Annually
Senior level
250K-480K Annually
Senior level
Artificial Intelligence • Big Data • Consumer Web • eCommerce
Own and operate a profitable revenue engine end-to-end: the publishing pipeline, promo-code verification, and conversion paths. Drive real-dollar outcomes (conversion, retention, revenue), model freshness/decay, integrate agent/AI access, and iterate in production with autonomy. Prove improvements with measurable financial impact.

What you need to know about the San Francisco Tech Scene

San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.

Key Facts About San Francisco Tech

  • Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Google, Apple, Salesforce, Meta
  • Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
  • Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
  • Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account