LiveRamp Logo

LiveRamp

Sr. Software Engineer - Big Data

Posted 6 Days Ago
Hybrid
San Francisco, CA, USA
130K-197K Annually
Senior level
Hybrid
San Francisco, CA, USA
130K-197K Annually
Senior level
Lead the design, implementation, modernization, and optimization of large-scale big data systems processing trillions of identity graph connections. Develop batch processing solutions, REST APIs, and scalable applications using Spark, cloud platforms, and modern infrastructure tools. Collaborate with product managers and engineering teams while emphasizing performance, reliability, security, privacy, compliance, and cost effectiveness.
The summary above was generated by AI

LiveRamp is shaping the future of responsible data collaboration between the world’s leading brands, retailers, financial services providers, and healthcare innovators. As consumers embrace new AI-driven experiences, the LiveRamp data collaboration network exponentially expands the breadth and accuracy of the data on which marketing AI capabilities operate, powering deeper customer insight and measurable performance on a global scale. LiveRamp is headquartered in San Francisco, California, with offices worldwide. Learn more at LiveRamp.com.

We on the Identity Engineering team maintain the graph processing engine that connects the trillions of different identifiers for consumers and the devices they use online. Help us process this trillion edge graph as quickly and efficiently as possible.

We handle product requests and enhancements, focusing on scalability, modernization, performance, cost, security, legal compliance, reliability, and quality. Projects include architectural refreshes like POCs for batch data processing, developing new REST APIs, and migrating applications to Spark and SingleStore. These initiatives aim to improve processing speed, scalability, maintainability, and cost-effectiveness.

You will:
  • Lead complex problems, by breaking into their essential components, design and implement elegant solutions focussing on value delivered.

  • Deliver on the problems problems by collaborating with the team and cross functional teams

  • Modernize our applications to be modular, scalable by leveraging the latest stack

  • Collaborate closely with product managers, and other engineers to deliver high-quality software

  • Design with privacy and security-first principles and err on the side of shipping fast and iterating.

About you:
  • 6+ years of professional software development experience, primarily focused on big data technologies.

  • 3+ years of experience writing and optimizing large-scale batch processing using Spark/Hadoop or similar

  • 3+ years of Java , SQL programming skills

  • 2+ years of experience using cloud based platforms such as GCP, AWS, Azure or similar technologies.

  • Experience with technologies like Docker, Terraform and/or Kubernetes

  • Startup personality and enjoy working as part of a team: smart, ethical, friendly, hard-working, and productive.

Preferred Qualifications:
  • Experience with GCP products such as BigTable, BigQuery, Dataproc, PubSub or other data tools like Kafka, Hive, or Apache Beam

  • Experience with development tools such as Terraform, Kubernetes, Helm, or Gradle

  • Experience with designing and implementing interfaces and infrastructure for large scale systems and RESTful APIs

The approximate annual base compensation range is $130,000 to $196,500. The actual offer, reflecting the total compensation package and benefits, will be determined by a number of factors including the applicant's experience, knowledge, skills, and abilities, geography, as well as internal equity among our team.

We use automated decision systems (ADS) as part of our recruitment and hiring process. If you require an accommodation or believe that the use of an ADS may create a barrier to your application or participation in the hiring process due to a disability or other protected characteristic, please let us know. We are committed to providing reasonable accommodations and ensuring an equitable hiring experience for all candidates.

To all recruitment agencies: LiveRamp does not accept agency resumes. Please do not forward resumes to our jobs alias, LiveRamp employees or any other company location. LiveRamp is not responsible for any fees related to unsolicited resumes.

HQ

LiveRamp San Francisco, California, USA Office

225 Bush Street, San Francisco, CA, United States, 94104

Similar Jobs

2 Months Ago
In-Office or Remote
San Francisco, CA, USA
124K-255K Annually
Senior level
124K-255K Annually
Senior level
AdTech • Marketing Tech
Design and implement scalable data infrastructure and pipelines on AWS using Spark and Scala. Build fault-tolerant batch and streaming workflows, optimize storage formats and engines, enforce automated data quality checks, and collaborate with Data Science and Product teams to deliver reliable data assets and APIs.
Top Skills: AWSBatch ProcessingCloud Data WarehousesData LakesScalaSparkSQLStreaming Pipelines
2 Months Ago
In-Office or Remote
140K-200K Annually
Senior level
140K-200K Annually
Senior level
Big Data • HR Tech • Mobile • Software • Database
Senior Software Engineers will build data processing pipelines and deploy cloud technologies, focusing on big data and machine learning infrastructure. They are expected to write and deploy efficient code within a Kubernetes environment.
Top Skills: Amazon Kinesis Data AnalyticsApache BeamApache FlinkApache HudiApache KafkaAzure DatabricksCassandraDelta LakeDockerFlumeGoogle Cloud DataflowHadoopHbaseHiveKubernetesMongoDBNifiSpark
15 Minutes Ago
Hybrid
San Ramon, CA, USA
37K-66K Hourly
Senior level
37K-66K Hourly
Senior level
Fintech • Financial Services
Manages and grows relationships with affluent consumer and business banking customers. The role acquires clients, conducts discovery conversations, recommends integrated deposit, credit, lending, investment, and banking solutions, and manages a defined book of business. It partners with Wealth, Home Lending, and Business Banking teams, promotes digital adoption, supports branch colleagues, and maintains strong documentation, risk controls, regulatory compliance, and customer service standards.
Top Skills: Finra Series 6Finra Series 63Finra Series 65Safe RegistrationSecurities Industry Essentials (Sie)State Insurance License(S)

What you need to know about the San Francisco Tech Scene

San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.

Key Facts About San Francisco Tech

  • Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Google, Apple, Salesforce, Meta
  • Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
  • Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
  • Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account