Quantiphi Logo

Quantiphi

Senior Data Engineer

Posted Yesterday
Remote
Hiring Remotely in USA
Senior level
Remote
Hiring Remotely in USA
Senior level
Design, build, and optimize scalable ETL/ELT data pipelines and data platforms for AI and analytics. Work with large structured and semi-structured datasets, ensure data quality and reliability, implement data models, support healthcare data ingestion and interoperability (EHR/EMR, HL7/FHIR), and maintain CI/CD, testing, and monitoring best practices.
The summary above was generated by AI

While technology is the heart of our business, a global and diverse culture is the heart of our success. We love our people and we take pride in catering them to a culture built on transparency, diversity, integrity, learning and growth.
If working in an environment that encourages you to innovate and excel, not just in professional but personal life, interests you- you would enjoy your career with Quantiphi!

About Quantiphi:

Quantiphi is an award-winning Applied AI and Big Data software and services company, driven by a deep desire to solve transformational problems at the heart of businesses. Our signature approach combines groundbreaking machine-learning research with disciplined cloud and data-engineering practices to create breakthrough impact at unprecedented speed. 

Quantiphi has seen 2.5x growth YoY since its inception in 2013, we don’t just innovate - we lead. 

Headquartered in Boston, with 4,000+ professionals across the globe. Quantiphi leverages Applied AI technologies across multiple a. Industry Verticals (Telco, BFSI, HCLS etc.) and is an established Elite/Premier Partner of NVIDIA, Google Cloud, AWS, Snowflake, and others. 

We’ve been recognized with:

  • 17x Google Cloud Partner of the Year awards in the last 8 years.

  • 3x AWS AI/ML award wins.

  • 3x NVIDIA Partner of the Year titles.

  • 2x Snowflake Partner of the Year awards.

  • We have also garnered top analyst recognitions from Gartner, ISG, and Everest Group.

  • We offer first-in-class industry solutions across Healthcare, Financial Services, Consumer Goods, Manufacturing, and more, powered by cutting-edge Generative AI and Agentic AI accelerators.

  • We have been certified as a Great Place to Work for the third year in a row- 2021, 2022, 2023.

Be part of a trailblazing team that’s shaping the future of AI, ML, and cloud innovation. 

Your next big opportunity starts here!

For more details, visit: Website or LinkedIn Page.

Role: Senior Data Engineer - AI Platforms

Experience Level: 7+ yrs

Work Location: US East/Canada (Remote)

Role Overview:

As a Senior Data Engineer, you will design and build scalable, production-grade data platforms and pipelines that power AI and analytics use cases. This role is highly hands-on and sits at the intersection of data engineering, AI enablement, and cloud platforms.

You will work closely with clients and internal stakeholders to build modern data ecosystems, with a strong focus on healthcare data and interoperability standards.

Key Responsibilities:

  • Design and build scalable data pipelines (ETL/ELT) using modern data engineering frameworks

  • Develop and optimize batch and real-time data processing systems

  • Build and maintain data integration workflows across multiple systems and sources

  • Ensure data quality, integrity, and reliability across the data lifecycle

  • Work with large-scale structured and semi-structured datasets

  • Optimize data pipelines for performance, scalability, and cost efficiency

  • Collaborate with stakeholders to translate business needs into technical solutions

  • Design and implement data models to support analytics and AI use cases

  • Support healthcare data ingestion and transformation, including interoperability standards

  • Maintain best practices for CI/CD, testing, and monitoring of data pipelines

Basic Qualifications:

  • 7+ years of experience in Data Engineering or Data Platform development

  • Strong hands-on experience with at least one of:

    • Python

    • SQL

    • PySpark

  • Experience working with at least one of the following data platforms:

    • Snowflake

    • PostgreSQL

    • BigQuery

    • Amazon Redshift

  • Experience building and maintaining data pipelines using one or more of:

    • ETL / ELT frameworks

    • dbt

    • Dataflow, Dataproc, EMR, or AWS Glue

  • General data pipeline / data integration frameworks

  • Strong SQL expertise (joins, window functions, performance tuning)

  • Experience working with large-scale data processing systems

Other Qualifications (OQs):

  • Experience with cloud platforms (AWS, GCP, or Azure)

  • Familiarity with real-time or streaming data architectures

  • Exposure to modern data stack tools and best practices

  • Experience with data governance, data quality, and observability tools

  • Strong communication skills and experience working with cross-functional teams

Domain Experience (Required):

  • Experience working within Healthcare domain, specifically:

    • Healthcare providers or payer systems

    • Healthcare datasets (EHR/EMR)

  • Familiarity with healthcare interoperability standards such as:

    • HL7 (v2 preferred)

    • FHIR (nice to have)

  • Experience working with systems such as:

    • Epic (preferred)

    • Other clinical or healthcare data platforms

What’s in it for YOU at Quantiphi:

  • Make an impact at one of the world’s fastest-growing AI-first digital engineering companies.

  • Upskill and discover your potential as you solve complex challenges in cutting-edge areas of technology alongside passionate, talented colleagues.

  • Work where innovation happens - work with disruptive innovators in a research-focused organization with 60+ patents filed across various disciplines.

  • Stay ahead of the curve—immerse yourself in breakthrough AI, ML, data, and cloud technologies and gain exposure working with Fortune 500 companies.

If you like wild growth and working with happy, enthusiastic over-achievers, you'll enjoy your career with us!

Quantiphi San Jose, California, USA Office

2460 N 1st Street, San Jose, San Jose, United States, 95131

Similar Jobs

21 Days Ago
In-Office or Remote
92K-164K Annually
Senior level
92K-164K Annually
Senior level
Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
Design, build, and operate enterprise data pipelines and Lakehouse data products on Azure. Lead migrations, implement medallion architectures, optimize Spark and distributed SQL workloads, enforce CI/CD and observability, and support production incident response while partnering with architects, data scientists, and stakeholders.
Top Skills: ArmAzure Ad / Entra IdAzure Data FactoryAzure Data Lake Storage Gen2Azure DatabricksAzure DevopsAzure Key VaultAzure MonitorAzure SqlAzure Synapse AnalyticsBashBicepDelta LakeKqlLog AnalyticsMicrosoft FabricPandasParquetPowershellPrivate EndpointsPysparkPytestPythonSpark SqlSsisSynapse Dedicated Sql PoolT-SqlTeradataTerraformUnity CatalogVnet
11 Days Ago
Easy Apply
Remote or Hybrid
United States
Easy Apply
134K-203K Annually
Senior level
134K-203K Annually
Senior level
Artificial Intelligence • Cloud • Computer Vision • Hardware • Internet of Things • Software
Lead design and operation of large-scale data pipelines and data APIs. Build Spark/PySpark workflows on Databricks, optimize job performance, manage data quality and observability, and develop MCP servers and AI-agent integrations. Mentor engineers, define standards, support production incidents and on-call rotations, and collaborate with stakeholders to deliver scalable data platform products.
Top Skills: Apache IcebergApi GatewayAWSAws LambdaAws Rds/AuroraAzureDatabricksDatadogDbtFastapiFivetranGCPGoogle BigqueryLlms/Ai AgentsMcp ServersMs Sql ServerMySQLOraclePostgresPysparkPythonS3SecretsmanagerSnowflakeSnsSparkSplunkSQLSqs
Yesterday
Remote
USA
Senior level
Senior level
Artificial Intelligence • Big Data • Machine Learning
Design, build, and maintain scalable AWS-based data pipelines, data lakes and warehouses. Implement data modeling and warehousing for Redshift/Athena, ensure data quality, optimize queries, and develop production-grade Amazon QuickSight dashboards with security (RLS), performance tuning, and stakeholder-driven reporting.
Top Skills: Amazon EmrAmazon QuicksightApache AirflowAws AthenaAws GlueAws LambdaAws RedshiftAws S3Aws Step FunctionsDirect QueryPower BIPysparkPythonQlikRow-Level SecuritySpiceSQLTableau

What you need to know about the San Francisco Tech Scene

San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.

Key Facts About San Francisco Tech

  • Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Google, Apple, Salesforce, Meta
  • Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
  • Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
  • Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account