Unity Logo

Unity

Senior Data Engineer

Reposted 25 Days Ago
Hybrid
San Francisco, CA, USA
172K-215K Annually
Senior level
Hybrid
San Francisco, CA, USA
172K-215K Annually
Senior level
The Senior Data Engineer designs and implements scalable data pipelines and reporting infrastructure, ensuring high throughput, reliability, and observability in distributed systems.
The summary above was generated by AI

The opportunity
Unity is building a robust, near real-time reporting platform that powers critical analytics and decision-making across our ecosystem. We are looking for a Data Engineer to help architect and implement the distributed data systems that drive this platform at scale.

In this role, you’ll design and build high-throughput, low-latency data processing pipelines that power reporting used by internal teams and external customers. You’ll operate at the intersection of distributed systems, stream processing, and cloud-native infrastructure — ensuring correctness, reliability, and scalability in a high-volume production environment.

This is a high-impact role where engineering rigor, architectural clarity, and production ownership matter.

What you'll be doing

  • Design and implement near real-time data pipelines and reporting infrastructure.
  • Architect distributed stream and batch processing systems using technologies such as Apache Flink, Spark, and Airflow.
  • Build and maintain data processing frameworks that handle large-scale event ingestion and transformation with strong correctness guarantees.
  • Ensure production-grade reliability, observability, and operability across distributed systems.
  • Define and enforce data processing semantics including:
  • Exactly-once processing
  • Event time vs. processing time handling
  • Stateful stream management
  • Backpressure and fault tolerance strategies
  • Collaborate cross-functionally with data consumers, product, and infrastructure teams to define scalable reporting solutions.
  • Contribute to long-term platform architecture, setting engineering standards for performance, resilience, and maintainability.

What we're looking for

  • Strong foundation in distributed systems and systems design.
  • Hands-on experience building and operating large-scale data processing systems.
  • Deep understanding of streaming concepts:
    -Exactly-once semantics
    -Watermarking and event-time processing
    - Stateful stream processing
    - Checkpointing and recovery
    - Backpressure handling
  • Production experience with frameworks such as Apache Flink, Spark, Kafka, or similar technologies.
  • Proficiency in Python, Java, or Scala.
  • Experience with workflow orchestration tools (e.g., Airflow) for stream and batch coordination.
  • Strong understanding of cloud-native architectures and distributed infrastructure (Kubernetes, containerization, cloud platforms).

You might also have

  • Ability to lead architecture across teams and influence platform strategy.
  • Experience defining technical roadmaps for distributed data systems.
  • Track record of driving reliability improvements and scaling systems to high throughput environments.
  • Mentorship and technical leadership across engineering teams.

Additional information

  • Relocation support is not available for this position
  • Work visa/immigration sponsorship is not available for this position

Benefits
At Unity, we want our team members to thrive. We offer a wide range of benefits designed to support well-being and work-life balance.

Please note: Benefits eligibility, specific offerings, and coverage vary based on the country and employment status.

While specific benefits vary, here are some of the ways we strive to take care of our eligible team members globally: Comprehensive health, life, and disability insurance | Commute subsidy | Employee stock ownership | Competitive retirement/pension plans | Generous vacation and personal days | Support for new parents through leave and family-care programs | Office food snacks | Mental Health and Wellbeing programs and support | Employee Resource Groups | Global Employee Assistance Program | Training and development programs | Volunteering and donation matching program

Life at Unity
Unity [NYSE: U] is the world’s leading game engine, powering play for more than 3 billion consumers each month. The top mobile games in the world, the most played PC indie titles, the most innovative console games, and virtually all of the top XR and Web Games are developed, deployed, and grown in Unity. Unity also enables teams across industries like automotive, manufacturing, and healthcare to design, simulate, and collaborate in 3D — closing the gap between ideas and reality. For more information, please visit www.unity.com.

Unity is a proud equal opportunity employer. We are committed to fostering an inclusive, innovative environment and celebrate our employees across age, race, color, ancestry, national origin, religion, disability, sex, gender identity or expression, sexual orientation, or any other protected status in accordance with applicable law. Our differences are strengths that enable us to support the growing and evolving needs of our customers, partners, and collaborators. If you have a disability that means there are preparations or accommodations we can make to help ensure you have a comfortable and positive interview experience, please fill out this form to let us know.

Pursuant to the San Francisco Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records.

This position requires the incumbent to have a sufficient knowledge of English to have professional verbal and written exchanges in this language since the performance of the duties related to this position requires frequent and regular communication with colleagues and partners located worldwide and whose common language is English.

Headhunters and recruitment agencies may not submit resumes/CVs through this Web site or directly to managers. Unity does not accept unsolicited headhunter and agency resumes. Unity will not pay fees to any third-party agency or company that does not have a signed agreement with Unity.

Your privacy is important to us. Please take a moment to review our Prospect Privacy Policy and Applicant Privacy Policy. Should you have any concerns about your privacy, please contact us at [email protected].

#SEN

*Note: Certain locations require a good faith disclosure of the base salary range for the role. The actual salary for the successful candidate may differ based on location, experience, and other job-related factors.

Gross pay salary
$172,000$215,000 USD

Unity San Francisco, California, USA Office

Work at Unity includes a ton of flexibility, depending on your role, the needs of your team and ultimately the way you and your team work best together.

Similar Jobs

5 Days Ago
In-Office or Remote
IN, USA
165K-190K Annually
Senior level
165K-190K Annually
Senior level
Consumer Web • eCommerce • Food • Healthtech • Natural Language Processing • Social Impact
Thrive Market seeks a Senior Data Engineer to deliver data engineering solutions, collaborate across teams, and manage data architecture, focusing on complex data processing and streaming frameworks.
Top Skills: AirflowSparkAWSDbtGitJenkinsKafkaPythonSnowflakeSQLTerraform
11 Days Ago
Hybrid
150K-450K Annually
Senior level
150K-450K Annually
Senior level
AdTech • Big Data • Digital Media • Software
The Senior Data Engineer will design and optimize large-scale batch and streaming data pipelines using Scala and Spark, oversee the data engineering lifecycle, and engage in technical discussions to improve system efficiency.
Top Skills: AirflowAws Ec2Aws EcsAws KinesisAws RdsAws S3DockerJavaJenkinsScalaSparkTerraform
2 Days Ago
Easy Apply
In-Office
Easy Apply
160K-220K Annually
Senior level
160K-220K Annually
Senior level
Artificial Intelligence • Computer Vision • Machine Learning • Payments • Real Estate • PropTech
The Senior Data Engineer will design and build data pipelines, manage data architecture, ensure privacy compliance, mentor team members, and collaborate with cross-functional teams.
Top Skills: AirflowAutomicAWSDbtDmsEksGlueMs Sql ServerMySQLPostgresPythonSnowflakeSnsSQL

What you need to know about the San Francisco Tech Scene

San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.

Key Facts About San Francisco Tech

  • Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Google, Apple, Salesforce, Meta
  • Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
  • Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
  • Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account