ZipRecruiter Logo

ZipRecruiter

Senior Software Engineer, Big Data

Reposted 24 Days Ago
In-Office
Palo Alto, CA, USA
140K-200K Annually
Senior level
In-Office
Palo Alto, CA, USA
140K-200K Annually
Senior level
The Senior Software Engineer will develop data processing pipelines, ML infrastructure, and scalable applications for a hybrid work marketplace, requiring expertise in big data technologies.
The summary above was generated by AI

We offer a hybrid work environment. Most US-based positions can also be performed remotely (any exceptions will be noted in the Minimum Qualifications below.)

Our Mission: 

To actively connect people to their next great opportunity. 

Who We Are: 

ZipRecruiter is a leading online employment marketplace. Powered by AI-driven smart matching technology, the company actively connects millions of all-sized businesses and job seekers through innovative mobile, web, and email services, as well as through partnerships with the best job boards on the web. ZipRecruiter has the #1 rated job search app on iOS & Android.

Summary:

Our team has a unique opportunity to work on applications and data at scale, serving millions of jobseekers and tens of thousands of customers. We’re working on building an efficient marketplace of jobseekers and employers and need generalist software engineers to build fast, scalable, and effective applications, stream and batch data processing, ML infrastructure and a variety of other systems all to help connect people to their next job. We provide an essential service and have a thriving business as a result.

Our stack is complex and we’re looking for engineers who know how to write evolvable, properly instrumented, and efficient code as part of a growing distributed system. We’re working on data driven systems and applications and need people who can build fast services and processes to power all of the intelligence we use to help change people’s lives.

Responsibilities:

  • Build data processing and exploration pipelines along with ML infrastructure to power our intelligence
  • Deploy a range of cloud-based technologies for critical projects
  • Write, test, instrument, and deploy code to our Kubernetes environment
  • Help drive the innovation and evolution of ZipRecruiter

Minimum Qualifications:

  • 5+ years of professional software development experience with a focus on big data technologies
  • Experience with Hadoop, Spark, Hive, and/or other big data technologies
  • Comprehensive computer science fundamentals in coding, object-oriented programming, data structures, and algorithms
  • Experience with containerization technologies like Docker and/or Kubernetes

Preferred Qualifications:

  • 8+ years of professional software development experience, with a focus on big data technologies
  • BS/MS/PhD in Mathematics, Computer Science, Physics, related technical field or equivalent practical experience
  • Experience with data integration tools like Apache Kafka, Flume, and NiFi
  • Familiarity with data storage technologies such as Delta Lake, HBase, Cassandra, and MongoDB
  • Familiarity with Apache Hudi, Apache Beam, Apache Flink, Google Cloud Dataflow, Amazon Kinesis Data Analytics, and/or Azure Databricks

As part of our team you’ll enjoy:

  • Competitive compensation
  • Exceptional benefits package
  • Flexible Vacation & Paid Time Off
  • Employer-matched 401(k) plan 

The US base salary range for this full-time position is $140,000-$200,000. Our salary ranges are determined by role, level, and location, and the range displayed on each job posting reflects the minimum and maximum target for new hire salaries for the position across all US locations. Within the range, individual pay is determined by work location, role-related knowledge and skills, depth of experience, relevant education or training, and additional role-related considerations.

Depending on the position offered, equity, bonuses, commission, or other forms of compensation may also be provided as part of a total compensation package, in addition to a full range of medical, financial, and other benefits.

#LI-Remote

#LI-DA1

ZipRecruiter is proud to be an equal opportunity employer and provides equal employment opportunities (EEO) to all employees and applicants without regard to race, color, religion, sex, national origin, age, disability, veteran status, sexual orientation, gender identity or genetics.

Privacy Notice: For information about ZipRecruiter's collection and processing of job applicant personal data for this job, please see our Privacy Notice at: https://www.ziprecruiter.com/careers/job-applicant-privacy-notice

Similar Jobs

20 Days Ago
In-Office
San Francisco, CA, USA
130K-197K Annually
Senior level
130K-197K Annually
Senior level
Big Data • Cloud • Marketing Tech • Social Impact • Software
Lead the development of scalable big data solutions, focusing on batch processing and API development while ensuring security and compliance. Collaborate with teams to modernize applications and enhance performance.
Top Skills: AWSAzureBig DataDockerGCPHadoopJavaKubernetesSparkSQLTerraform
12 Days Ago
Hybrid
San Francisco, CA, USA
145K-168K Annually
Mid level
145K-168K Annually
Mid level
AdTech • Software
As a Software Engineer focused on Big Data, you will develop and optimize large-scale data processing systems, maintain infrastructure, and support data-driven workflows.
Top Skills: AirflowSparkDockerHdfsJavaKubernetesPython
24 Days Ago
In-Office
140K-200K Annually
Senior level
140K-200K Annually
Senior level
Big Data • HR Tech • Mobile • Software • Database
Senior Software Engineers will build data processing pipelines and deploy cloud technologies, focusing on big data and machine learning infrastructure. They are expected to write and deploy efficient code within a Kubernetes environment.
Top Skills: Amazon Kinesis Data AnalyticsApache BeamApache FlinkApache HudiApache KafkaAzure DatabricksCassandraDelta LakeDockerFlumeGoogle Cloud DataflowHadoopHbaseHiveKubernetesMongoDBNifiSpark

What you need to know about the San Francisco Tech Scene

San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.

Key Facts About San Francisco Tech

  • Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Google, Apple, Salesforce, Meta
  • Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
  • Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
  • Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account