The Punch Agency Logo

The Punch Agency

Senior Data Engineer

Reposted 2 Months Ago
In-Office
San Francisco, CA, USA
150K-150K Annually
Senior level
In-Office
San Francisco, CA, USA
150K-150K Annually
Senior level
Design, build and scale a 500+ TB Audience Management Big Data platform. Own data ingestion, validation, transformation and storage pipelines. Write server-side Spark/Scala code, perform R&D on new technologies, mentor engineers, and partner with product managers to meet roadmap and business needs.
The summary above was generated by AI
Company Description

Punch is a full service digital agency based out of New York, Silicon Valley, LA, Boston, Stockholm and Phuket, Thailand. Here at Punch, we take pride in tackling our clients’ most challenging tasks. Founded by a group of former Google Engineers and now with over 75 staff, Punch is now leading the way in creating new cutting-edge technology.

We're looking for innovative thinkers with a hunger to expand their knowledge!
We are building a more technical world.Go ahead and check out some of our work here: www.punch-agency.com

Job Description

We are seeking an extremely talented senior/lead data engineer to design & implement highly reliable & scalable Audience Management Big Data Platform (500+ Terabytes).

Responsibilities:

- Build, enhance and scale our existing Big Data Platform to process 500+ Terabytes of data from various 3rd party providers.

- Technically own the complete data pipeline module including data ingestion, validation, transformation & storage in the data platform.

- Design and write clean, robust, server-side code using Spark & Scala.

- Perform R & D to evaluate new technologies, generate different ideas & patentable IP to communicate value for company

- Work closely with team members & mentor them technically

- Partner with product managers to support product roadmap & business needs

Required Skills:

- 10 - 15 years experience in software development primarily in Big Data domain using Spark & Hadoop eco system.

- 5+ Years of experience in Spark & Scala (Skill Level: 8 or more out of 10)

- Bachelors degree in Computer Science or equivalent.

- 5+ years experience designing, building and launching extremely efficient & reliable data pipelines to move data (both large and small amounts) using modern data architecture/tools.

- Strong background (5+ years) in ETL processing for large amount of data (250+ Terabytes)

- Multiple years of experience working with 250+ Terabytes of data for ETL using Spark & Scala

- 3+ years experience working in Agile environment (SCRUM)

Nice To Have Skills:

- Experience in digital marketing (Good Domain knowledge on digital marketing Industry)

- Experience working with AWS (S3, EMR, EC2, RDS)

Job Type: Full-time

Required education:

  • Bachelor's

Required experience:

  • designing, building: 5 years

Job Type: Full-time

Required education:

  • Bachelor's

Required experience:

  • designing, building: 5 years

Qualifications

Required Skills:

- 10 - 15 years experience in software development primarily in Big Data domain using Spark & Hadoop eco system.

- 5+ Years of experience in Spark & Scala (Skill Level: 8 or more out of 10)

- Bachelors degree in Computer Science or equivalent.

- 5+ years experience designing, building and launching extremely efficient & reliable data pipelines to move data (both large and small amounts) using modern data architecture/tools.

- Strong background (5+ years) in ETL processing for large amount of data (250+ Terabytes)

- Multiple years of experience working with 250+ Terabytes of data for ETL using Spark & Scala

- 3+ years experience working in Agile environment (SCRUM)

Nice To Have Skills:

- Experience in digital marketing (Good Domain knowledge on digital marketing Industry)

- Experience working with AWS (S3, EMR, EC2, RDS)

Additional Information

We are a team of former Google Engineers and Designers based in Silicon Valley, New York and Phuket, Thailand.

All of our core engineers are paid in the $150,000 range or greater and we also provide our engineers the opportunity to work, all expenses paid, from our Phuket, Thailand office one month a year as a creative outlet to work and enjoy life to the fullest.

In this role you will work with some of the most exciting projects in the industry today with a team of fast moving engineers and designers who have a passion for building disruptive products. 

Similar Jobs

8 Hours Ago
In-Office or Remote
San Francisco, CA, USA
153K-205K Annually
Senior level
153K-205K Annually
Senior level
Blockchain • Fintech • Payments • Financial Services • Cryptocurrency • Web3
Build and operate production data pipelines, models, and data products supporting finance, accounting, treasury, compliance, and regulatory reporting. Partner cross-functionally to define requirements, model on-chain and internal data, and ensure data reliability through reconciliation, quality checks, monitoring, and alerting. Use SQL, Python, cloud data warehouse, Airflow, dbt, and AI tooling. Mentor engineers, review technical work, document systems, and communicate data concepts to technical and non-technical audiences.
Top Skills: Apache AirflowBlockchainCloud Data WarehouseDbtPythonSQL
6 Days Ago
Hybrid
Mountain View, CA, USA
256K-256K Annually
Senior level
256K-256K Annually
Senior level
Automotive • Big Data • Information Technology • Robotics • Software • Transportation • Manufacturing
Build and manage large-scale automotive data infrastructure, telemetry pipelines, analytical models, dashboards, and AI/ML solutions. Analyze battery, vehicle electronics, warranty, and diagnostic data to identify patterns, resolve issues, and support vehicle program decisions. Architect Azure Databricks lakehouse solutions, develop diagnostic and prognostic algorithms, automate root-cause analysis, and maintain production software and reporting systems.
Top Skills: Ai/MlSparkAutomotive Telemetry SystemsAzure Cloud PlatformC#C++Ci/CdData ModelingDatabricksEltETLGenaiIdesJavaLakehouse ArchitectureLarge Language ModelsMatlabExcelNeoviPower BIPythonRReal-Time Telemetry ProcessingSoftware Development LifecycleSql DatabasesTableauVdrVersion ControlVisual Basic
12 Days Ago
Hybrid
San Francisco, CA, USA
180K-225K Annually
Senior level
180K-225K Annually
Senior level
Consumer Web • Healthtech • Professional Services • Social Impact • Software
Designs and maintains scalable data pipelines and infrastructure, establishes data governance and quality standards, and drives technical decisions across Headway’s data platform. Partners with Product, Engineering, Analytics, Data Science, Infrastructure, Finance, and Insurance Systems to improve architecture, performance, reliability, security, and AI-readiness. Ensures data is complete, traceable, trustworthy, and suitable for powering internal tools and AI-driven insights.
Top Skills: AirflowDbtFivetranJupyter NotebooksMetabasePythonSnowflakeSQLTerraform

What you need to know about the San Francisco Tech Scene

San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.

Key Facts About San Francisco Tech

  • Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Google, Apple, Salesforce, Meta
  • Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
  • Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
  • Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account