The Punch Agency Logo

The Punch Agency

Senior Data Engineer

Reposted One Month Ago
In-Office
San Francisco, CA, USA
150K-150K Annually
Senior level
In-Office
San Francisco, CA, USA
150K-150K Annually
Senior level
Design, build and scale a 500+ TB Audience Management Big Data platform. Own data ingestion, validation, transformation and storage pipelines. Write server-side Spark/Scala code, perform R&D on new technologies, mentor engineers, and partner with product managers to meet roadmap and business needs.
The summary above was generated by AI
Company Description

Punch is a full service digital agency based out of New York, Silicon Valley, LA, Boston, Stockholm and Phuket, Thailand. Here at Punch, we take pride in tackling our clients’ most challenging tasks. Founded by a group of former Google Engineers and now with over 75 staff, Punch is now leading the way in creating new cutting-edge technology.

We're looking for innovative thinkers with a hunger to expand their knowledge!
We are building a more technical world.Go ahead and check out some of our work here: www.punch-agency.com

Job Description

We are seeking an extremely talented senior/lead data engineer to design & implement highly reliable & scalable Audience Management Big Data Platform (500+ Terabytes).

Responsibilities:

- Build, enhance and scale our existing Big Data Platform to process 500+ Terabytes of data from various 3rd party providers.

- Technically own the complete data pipeline module including data ingestion, validation, transformation & storage in the data platform.

- Design and write clean, robust, server-side code using Spark & Scala.

- Perform R & D to evaluate new technologies, generate different ideas & patentable IP to communicate value for company

- Work closely with team members & mentor them technically

- Partner with product managers to support product roadmap & business needs

Required Skills:

- 10 - 15 years experience in software development primarily in Big Data domain using Spark & Hadoop eco system.

- 5+ Years of experience in Spark & Scala (Skill Level: 8 or more out of 10)

- Bachelors degree in Computer Science or equivalent.

- 5+ years experience designing, building and launching extremely efficient & reliable data pipelines to move data (both large and small amounts) using modern data architecture/tools.

- Strong background (5+ years) in ETL processing for large amount of data (250+ Terabytes)

- Multiple years of experience working with 250+ Terabytes of data for ETL using Spark & Scala

- 3+ years experience working in Agile environment (SCRUM)

Nice To Have Skills:

- Experience in digital marketing (Good Domain knowledge on digital marketing Industry)

- Experience working with AWS (S3, EMR, EC2, RDS)

Job Type: Full-time

Required education:

  • Bachelor's

Required experience:

  • designing, building: 5 years

Job Type: Full-time

Required education:

  • Bachelor's

Required experience:

  • designing, building: 5 years

Qualifications

Required Skills:

- 10 - 15 years experience in software development primarily in Big Data domain using Spark & Hadoop eco system.

- 5+ Years of experience in Spark & Scala (Skill Level: 8 or more out of 10)

- Bachelors degree in Computer Science or equivalent.

- 5+ years experience designing, building and launching extremely efficient & reliable data pipelines to move data (both large and small amounts) using modern data architecture/tools.

- Strong background (5+ years) in ETL processing for large amount of data (250+ Terabytes)

- Multiple years of experience working with 250+ Terabytes of data for ETL using Spark & Scala

- 3+ years experience working in Agile environment (SCRUM)

Nice To Have Skills:

- Experience in digital marketing (Good Domain knowledge on digital marketing Industry)

- Experience working with AWS (S3, EMR, EC2, RDS)

Additional Information

We are a team of former Google Engineers and Designers based in Silicon Valley, New York and Phuket, Thailand.

All of our core engineers are paid in the $150,000 range or greater and we also provide our engineers the opportunity to work, all expenses paid, from our Phuket, Thailand office one month a year as a creative outlet to work and enjoy life to the fullest.

In this role you will work with some of the most exciting projects in the industry today with a team of fast moving engineers and designers who have a passion for building disruptive products. 

Similar Jobs

Yesterday
Easy Apply
Hybrid
San Francisco, CA, USA
Easy Apply
186K-232K Annually
Senior level
186K-232K Annually
Senior level
Artificial Intelligence • Big Data • Healthtech • Biotech • Pharmaceutical
Build and operate reliable data systems and products supporting clinical operations, drug evaluation, business development, analytics, machine learning, and AI agents. Responsibilities include designing pipelines, canonical data models, data contracts, warehouse transformations, quality and observability practices, governance for regulated data, and incident response. The role partners closely with Product Engineering and Data Science, uses AI-assisted development, contributes to architecture, and mentors other engineers.
Top Skills: DagsterDbtDockerGitLlmsOpentofuPythonSnowflakeSQLTerraform
4 Days Ago
Remote or Hybrid
United States
165K-235K Annually
Senior level
165K-235K Annually
Senior level
Big Data • Cloud • Productivity • Software • Database • Analytics • Automation
Build and maintain Databricks-based data platforms, including ingestion, transformation, storage, governance, data modeling, and serving pipelines. Establish medallion architecture standards, canonical data models, quality controls, lineage, schema evolution, and reliable batch or incremental processing. Improve pipeline observability, scalability, idempotency, and recoverability while moving curated data to systems such as ClickHouse. Collaborate across application and analytics teams to create durable, governed production datasets.
Top Skills: Amazon AuroraAmazon RdsApache AirflowSparkBigQueryCdcClickhouseCloud Object StorageDatabricksDelta LakeIamOpenmetadataPostgresSnowflakeUnity Catalog
8 Days Ago
Remote or Hybrid
United States
Senior level
Senior level
AdTech • Consumer Web • Digital Media • eCommerce • Marketing Tech • SEO
Build and support scalable data platforms and pipelines, leading migrations such as Snowflake to BigQuery and transitioning reporting to Looker. Responsibilities include data architecture, ETL/ELT, API and marketing integrations, data quality, production troubleshooting, warehousing, performance optimization, and platform modernization. The role partners with analytics and business teams, owns projects through production, documents solutions, and provides technical guidance.
Top Skills: AWSAzureBigQueryConfluenceDraw.IoGCPGitJIRAKafkaLookerLucidchartMiroModeNotionPower BIPythonSnowflakeSparkSQLTableauTalend

What you need to know about the San Francisco Tech Scene

San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.

Key Facts About San Francisco Tech

  • Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Google, Apple, Salesforce, Meta
  • Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
  • Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
  • Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account