Gallup Logo

Gallup

Senior Data Engineer

Posted 4 Days Ago
In-Office
San Francisco, CA, USA
230K-280K Annually
Senior level
In-Office
San Francisco, CA, USA
230K-280K Annually
Senior level
Design and build scalable production data pipelines and layered data models (raw→curated→semantic). Implement transformations (dbt), orchestration (Airflow/Dagster), monitoring and data quality, support incident response, modernize legacy systems, collaborate with product/analytics/AI teams, and mentor engineers.
The summary above was generated by AI

Build the data foundation that powers Gallup’s products, analytics and AI innovation.

As a senior data engineer at Gallup, you’ll design and build the production data systems that enable high-quality, analytics-ready data across our product and research teams. You’ll translate architectural vision into scalable pipelines, resilient data models and reliable operational workflows, helping Gallup modernize legacy systems and accelerate our AI ambitions.

What You’ll Do

  • Design and implement reliable, scalable data pipelines that ingest, process and serve structured and unstructured data across Gallup
  • Build transformation pipelines that convert raw data into high-quality datasets for analytics and experimentation
  • Implement layered data models (raw → curated → semantic) to support analytics, experimentation and AI/ML workflows, with attention to reproducibility and data lineage
  • Translate architectural patterns into production-grade pipelines, models and infrastructure
  • Design systems for reliability, scalability and maintainability in complex, evolving environments
  • Implement monitoring, alerting and automated data quality checks to improve reliability and observability
  • Support incident response, root cause analysis and operational improvements
  • Establish and contribute to standards for data modeling, pipeline design and operational workflows
  • Work closely with product managers, analysts, data scientists and software engineers to understand data needs and build scalable solutions
  • Help teams transition from manual and legacy workflows to automated, modern data systems
  • Mentor engineers through code reviews and architectural discussions

What Makes You Stand Out

  • Execution excellence: You have built and operated production data systems and understand the realities of running pipelines reliably at scale.
  • Practical problem solver: You bring sound engineering judgment to incomplete documentation, legacy workflows and evolving requirements. You make thoughtful tradeoffs and sequence work intelligently.
  • Modern data builder: You are fluent in ingestion frameworks, transformation pipelines and layered data modeling, and you translate architectural direction into clean, production-grade implementations.
  • Collaborative partner: You enjoy working across product, analytics and engineering teams and can translate business needs into scalable technical capabilities.
  • AI-forward mindset: You are curious about AI and modern tooling, experiment beyond your day job, and think intentionally about how data modeling and accessibility support AI systems and reproducibility.

What You Need

  • Bachelor’s or master’s degree in computer science, engineering or a related field, or equivalent experience required
  • At least five years of experience in data engineering or backend engineering focused on data systems required
  • Strong SQL skills and deep understanding of data modeling required
  • Experience designing and operating production data pipelines required
  • Experience with orchestration tools such as Airflow or Dagster required
  • Experience running dbt workflows or similar transformation frameworks required
  • Hands-on experience with cloud data platforms such as Snowflake, Databricks or BigQuery required
  • Strong programming experience in Python or similar languages required
  • Experience implementing data quality, monitoring or observability frameworks required
  • Experience leading or participating in data platform modernization or migration from legacy environments strongly preferred
  • Experience with AWS preferred
  • Experience partnering directly with nontechnical stakeholders and influencing business decisions from a technical lens preferred
  • Experience working closely with AI teams in environments where data quality and reproducibility are critical preferred
  • A commitment to working on-site at Gallup’s San Francisco office at least three days per week required

About Gallup

At Gallup, we change the world, one client at a time, through extraordinary analytics and advice on everything important facing humankind. Learn more about our work and life at Gallup. 

Gallup offers a robust benefits package that includes medical, dental, vision, life and other insurance options; a fully vested 401(k) retirement savings plan with company matching; an employee stock ownership program; mass transit reimbursement; family-building benefits; an employee assistance program; and various reimbursements and activities that enhance our associates’ wellbeing. We also offer an estimated annual salary range of $230,000-$280,000 for this role. Salaries are based on a variety of factors, including an individual’s education, experience and skills.

Gallup is an equal opportunity employer. We consider all qualified applicants without regard to race, color, religion, sex, national origin, disability, protected veteran status, sexual orientation, gender identity, or any other legally protected basis, in accordance with applicable law.

To review Gallup’s Privacy Statement, please click this link: https://www.gallup.com/privacy. This privacy policy is meant to help you understand what information we collect, why we collect it, and how you can update, manage and delete your information. Your application and the information you provide will be processed and stored in the United States.

#LI-Hybrid

#LI-KW1

Similar Jobs

3 Days Ago
Hybrid
124K-280K Annually
Senior level
124K-280K Annually
Senior level
Artificial Intelligence • Professional Services • Business Intelligence • Consulting • Cybersecurity • Generative AI
Lead design and delivery of enterprise data architectures, pipelines, and analytics solutions for clients. Build and maintain ETL/data pipelines, leverage AWS/Redshift, implement BI visualizations, manage SLAs in managed services, and coach teams. Engage stakeholders, apply systems thinking, validate outcomes, and drive performance tuning and client satisfaction.
Top Skills: AWSDatastageDb2ETLJavaOracle BiPythonQlikviewRedshiftSQL Server
3 Days Ago
Hybrid
99K-232K Annually
Senior level
99K-232K Annually
Senior level
Artificial Intelligence • Professional Services • Business Intelligence • Consulting • Cybersecurity • Generative AI
Lead data engineering projects and teams to design, build, and maintain scalable ETL/ELT pipelines and architectures. Implement cloud-based analytics and BI solutions (AWS, Redshift, S3, Glue, BIRT), optimize performance, mentor staff, manage client relationships, and drive process improvements to deliver actionable insights and ensure project success.
Top Skills: AWSBirtCdcDatastageDb2Etl/EltGlueGoldengateJavaPythonQlikviewRedshiftS3SpotfireSQL Server
Yesterday
Easy Apply
Remote or Hybrid
United States
Easy Apply
134K-203K Annually
Senior level
134K-203K Annually
Senior level
Artificial Intelligence • Cloud • Computer Vision • Hardware • Internet of Things • Software
Lead design and operation of large-scale data pipelines and data APIs. Build Spark/PySpark workflows on Databricks, optimize job performance, manage data quality and observability, and develop MCP servers and AI-agent integrations. Mentor engineers, define standards, support production incidents and on-call rotations, and collaborate with stakeholders to deliver scalable data platform products.
Top Skills: Apache IcebergApi GatewayAWSAws LambdaAws Rds/AuroraAzureDatabricksDatadogDbtFastapiFivetranGCPGoogle BigqueryLlms/Ai AgentsMcp ServersMs Sql ServerMySQLOraclePostgresPysparkPythonS3SecretsmanagerSnowflakeSnsSparkSplunkSQLSqs

What you need to know about the San Francisco Tech Scene

San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.

Key Facts About San Francisco Tech

  • Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Google, Apple, Salesforce, Meta
  • Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
  • Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
  • Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account