Fractal Logo

Fractal

Data Engg with DQ Exp

Posted 5 Days Ago
Be an Early Applicant
Remote
Hiring Remotely in California, USA
140K-160K Annually
Senior level
Remote
Hiring Remotely in California, USA
140K-160K Annually
Senior level
Design and govern scalable Azure data platforms; build ETL/ELT batch and streaming pipelines; implement lakehouse/warehouse and data quality frameworks; enable metadata, lineage, observability, CI/CD and IaC; lead migrations, mentor engineers, and work with stakeholders across BI, AI/ML, governance, and infrastructure.
The summary above was generated by AI

It's fun to work in a company where people truly BELIEVE in what they are doing!

We're committed to bringing passion and customer focus to the business.

Architect – Azure Data Engineer (Data Quality)

Fractal is a strategic AI partner to Fortune 500 companies with a vision to power every human decision in the enterprise. Fractal is building a world where individual choices, freedom, and diversity are the greatest assets; an ecosystem where human imagination is at the heart of every decision. Where no possibility is written off, only challenged to get better. We believe that a true Fractalite is the one who empowers imagination with intelligence. Fractal has been featured as a Great Place to Work by The Economic Times in partnership with the Great Place to Work® Institute and recognized as a ‘Cool Vendor’ and a ‘Vendor to Watch’ by Gartner.

Please visit Fractal | Intelligence for Imagination for more information about Fractal.

Please Note: We are not offering sponsorship at this time.
 

Role Overview

We are seeking an experienced Azure Architect with strong expertise in Data Engineering and Data Quality (DQ) frameworks to design, implement, and govern scalable enterprise data platforms on Microsoft Azure. The ideal candidate will have deep experience in cloud-native data architectures, modern ETL/ELT pipelines, data governance, and enterprise-grade data quality practices.

The role involves working closely with business stakeholders, data engineers, architects, analytics teams, and leadership to build reliable, secure, and high-performing data ecosystems.

Key Responsibilities

Azure Data Architecture

  • Design scalable and secure enterprise data platforms on Microsoft Azure.
  • Define end-to-end cloud data architecture using Azure-native services.
  • Develop reference architectures, reusable frameworks, and best practices.
  • Lead migration of on-premise data platforms to Azure cloud.
  • Ensure architecture aligns with business, security, governance, and compliance requirements.

Data Engineering

  • Build and optimize large-scale batch and real-time data pipelines.
  • Design ETL/ELT frameworks using modern Azure data services.
  • Implement lakehouse/data warehouse architectures.
  • Enable data integration from structured, semi-structured, and unstructured sources.
  • Optimize performance, scalability, and cost of Azure data solutions.

Data Quality & Governance

  • Define enterprise data quality standards, controls, and monitoring frameworks.
  • Implement DQ checks including completeness, accuracy, consistency, uniqueness, and timeliness.
  • Design automated DQ validation and reconciliation frameworks.
  • Collaborate with governance teams on metadata management, lineage, and master data initiatives.
  • Establish data observability and monitoring mechanisms.

Stakeholder Management

  • Work with business users to understand analytical and operational data requirements.
  • Collaborate with cross-functional teams including BI, AI/ML, governance, and infrastructure teams.
  • Mentor junior engineers and provide technical leadership.
  • Participate in architecture reviews, design discussions, and client presentations.

Required Skills & Experience

Technical Skills

Azure Services

Strong hands-on expertise in:

  • Azure Data Factory (ADF)
  • Azure Databricks
  • Azure Synapse Analytics
  • Azure Data Lake Storage (ADLS)
  • Azure SQL Database
  • Azure Purview / Microsoft Purview
  • Azure Event Hub / Stream Analytics
  • Azure Functions
  • Azure DevOps

Data Engineering

  • Expertise in SQL and Python/PySpark.
  • Strong understanding of data modeling techniques.
  • Experience building distributed data processing systems.
  • Knowledge of batch and streaming architectures.
  • Experience with Delta Lake/Lakehouse concepts.

Data Quality

  • Experience implementing enterprise Data Quality frameworks.
  • Knowledge of DQ tools/frameworks such as Great Expectations, Deequ, Monte Carlo, Informatica DQ, or custom validation frameworks.
  • Experience in data profiling, validation, reconciliation, and anomaly detection.
  • Understanding of data governance and metadata management.

Cloud & DevOps

  • CI/CD implementation for data pipelines.
  • Infrastructure as Code (IaC) exposure using Terraform/Bicep/ARM templates.
  • Experience with monitoring and logging frameworks.
  • Understanding of cloud security best practices.

Qualifications

  • Bachelor’s or Master’s degree in Computer Science, Information Systems, Engineering, or related field.
  • 8+ years of experience in Data Engineering and Cloud Architecture.
  • 4+ years of hands-on experience with Azure Data Platform.
  • Experience working in enterprise-scale cloud transformation programs.
  • Azure certifications preferred:
    • Azure Solutions Architect Expert
    • Azure Data Engineer Associate
    • Azure AI Engineer (preferred)

Preferred Experience

  • Experience in BFSI, Healthcare, Retail, Manufacturing, or CPG domains.
  • Exposure to AI/ML data platforms.
  • Experience with multi-cloud or hybrid-cloud environments.
  • Familiarity with Agile delivery models.
  • Client-facing consulting experience.

Soft Skills

  • Strong communication and stakeholder management skills.
  • Excellent problem-solving and analytical thinking.
  • Ability to lead technical discussions and architecture reviews.
  • Strong collaboration and mentoring capabilities.
  • Ability to work in fast-paced and cross-functional environments.

Note: The job description may be subject to modification based on business requirements and evolving project needs.

Pay:

The wage range for this role takes into account the wide range of factors that are considered in making compensation decisions including but not limited to skill sets; experience and training; licensure and certifications; and other business and organizational needs.  The disclosed range estimate has not been adjusted for the applicable geographic differential associated with the location at which the position may be filled.  At Fractal, it is not typical for an individual to be hired at or near the top of the range for their role and compensation decisions are dependent on the facts and circumstances of each case.  A reasonable estimate of the current range is: $140,000 - $160,000. In addition, you may be eligible for a discretionary bonus for the current performance period.

Benefits:

As a full-time employee of the company or as an hourly employee working more than 30 hours per week, you will be eligible to participate in the health, dental, vision, life insurance, and disability plans in accordance with the plan documents, which may be amended from time to time.  You will be eligible for benefits on the first day of employment with the Company.  In addition, you are eligible to participate in the Company 401(k) Plan after 30 days of employment, in accordance with the applicable plan terms.   The Company provides for 11 paid holidays and 12 weeks of Parental Leave. We also follow a “free time” PTO policy, allowing you the flexibility to take time needed for either sick time or vacation.

Fractal provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws.

If you like wild growth and working with happy, enthusiastic over-achievers, you'll enjoy your career with us!

Not the right fit?  Let us know you're interested in a future opportunity by clicking Introduce Yourself in the top-right corner of the page or create an account to set up email alerts as new job postings become available that meet your interest!

Fractal Palo Alto, California, USA Office

SFO- Fractal 2100 Geng Road Suite 210 , Office # 245, Palo Alto, United States, 94303

Similar Jobs

An Hour Ago
Easy Apply
Remote
United States
Easy Apply
105K-120K Annually
Senior level
105K-120K Annually
Senior level
Cloud • Information Technology • Security • Software
Own end-to-end complex Professional Services engagements: discovery, architecture, and advanced Risk Cloud configuration. Provide strategic GRC advisory, leverage AI-assisted workflows, manage project/account health, mentor junior consultants, and collaborate cross-functionally to deliver measurable customer value and ROI.
Top Skills: AIApi IntegrationsAuditboardDrataLogicgate Risk CloudMetricstreamOnetrustReporting/Analytics Tools
An Hour Ago
Remote or Hybrid
South Coast, CA, USA
15-22 Hourly
Junior
15-22 Hourly
Junior
eCommerce • Fashion • Retail • Sales • Wearables • Design
Provide friendly, efficient customer service at cash wrap and on the sales floor. Operate POS, process shipments, manage stock levels, execute visual merchandising, support sales activities, maintain housekeeping and loss-prevention standards, and handle physical tasks like lifting and stockroom organization.
Top Skills: Cash Register SystemsInternetIpadMobile PosPosWalkie Talkie
An Hour Ago
Remote or Hybrid
Palo Alto, CA, USA
100K-176K Annually
Mid level
100K-176K Annually
Mid level
Artificial Intelligence • Cloud • Machine Learning • Mobile • Software • Virtual Reality • App development
Design, implement, and operate critical, scalable backend services (identity, friend graph, storage). Collaborate across teams, evaluate trade-offs, test and debug, manage availability, scalability, operational excellence, cost, and participate in incident resolution.
Top Skills: AWSC++GCPJavaKotlinKubernetesMemcacheNoSQLPythonRedisSwift

What you need to know about the San Francisco Tech Scene

San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.

Key Facts About San Francisco Tech

  • Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Google, Apple, Salesforce, Meta
  • Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
  • Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
  • Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account