Senior Data Engineer

While technology is the heart of our business, a global and diverse culture is the heart of our success. We love our people and we take pride in catering them to a culture built on transparency, diversity, integrity, learning and growth.
If working in an environment that encourages you to innovate and excel, not just in professional but personal life, interests you- you would enjoy your career with Quantiphi!

About Quantiphi:

Quantiphi is an award-winning Applied AI and Big Data software and services company, driven by a deep desire to solve transformational problems at the heart of businesses. Our signature approach combines groundbreaking machine-learning research with disciplined cloud and data-engineering practices to create breakthrough impact at unprecedented speed.

Quantiphi has seen 2.5x growth YoY since its inception in 2013, we don’t just innovate - we lead. Headquartered in Boston, with 4,000+ Quantiphi professionals across the globe. As an Elite/Premier Partner for Google Cloud, AWS, NVIDIA, Snowflake, and others, we’ve been recognized with:

• 17x Google Cloud Partner of the Year awards in the last 8 years.

• 3x AWS AI/ML award wins.

• 3x NVIDIA Partner of the Year titles.

• 2x Snowflake Partner of the Year awards.

• We have also garnered top analyst recognitions from Gartner, ISG, and Everest Group.

• We offer first-in-class industry solutions across Healthcare, Financial Services, Consumer Goods, Manufacturing, and more, powered by cutting-edge Generative AI and Agentic AI accelerators.

• We have been certified as a Great Place to Work for the third year in a row- 2021, 2022, 2023.

Be part of a trailblazing team that’s shaping the future of AI, ML, and cloud innovation. Your next big opportunity starts here!

For more details, visit: Website or LinkedIn Page.

Experience Level: 8+ years of experience  

Work Location: Atlanta, GA (Preferred)/ Anywhere in USA or Canada

About the Role:

As a Senior Data Engineer, you will play a key role in designing, building, and maintaining scalable data pipelines that power analytics, insights, and business decision-making. You will work across both batch and streaming architectures, leveraging PySpark, SQL, and modern data engineering frameworks to deliver reliable, high-performance data solutions.

What Success Look Like:

• Design, develop, and maintain scalable batch and streaming data pipelines using PySpark, SQL, and modern data engineering frameworks.

• Perform deep-dive analysis into complex source systems to define extraction patterns, transformation logic, and integration workflows.

• Implement data models optimized for analytics, performance, and operational excellence.

• Build and manage data systems across AWS or GCP cloud environments, ensuring reliability, scalability, and cost efficiency.

• Lead and participate in design reviews, provide mentorship to junior engineers, and take ownership of code quality and engineering best practices.

• Collaborate with cross-functional teams including architects, analysts, product, and platform engineers to deliver high-quality data solutions.

• Troubleshoot performance bottlenecks, optimize data processing workflows, and improve pipeline robustness.

Essential Skills/Qualifications:

• 8+ years of experience in data engineering or a related field.

• Strong expertise in PySpark, SQL, and data modeling for high-volume datasets.

• Hands-on experience building and optimizing data pipelines in AWS or GCP environments.

• Track record of working with complex source systems and developing accurate extraction and transformation logic.

• Proven experience in mentoring engineers, performing code reviews, and leading technical design discussions.

• Solid understanding of distributed computing, data partitioning, and performance tuning.

Nice to haves: 

• Expert-level knowledge of Azure and Databricks architecture, including Lakehouse patterns and the Medallion Framework.

• Familiarity with Delta Lake, orchestration tools, or Unity Catalog.

• Experience with CI/CD for data pipelines and automated testing frameworks.

What We Offer:

• Join a high-growth, AI-first digital engineering and transformation company

• Work with Fortune 500 clients and cutting-edge market disruptors

• Collaborate with a talented, dynamic, and driven team

• Gain exposure to the latest technologies in AI, ML, cloud, and data engineering