Develops automated data quality tests, validation processes, monitoring, anomaly detection, and alerting for cloud-based data platforms. Performs data reconciliation, migration parity testing, root cause analysis, and SLA compliance validation across enterprise datasets. Collaborates with data engineers, governance specialists, and data owners to establish quality rules and publication criteria. Maintains quality documentation, dashboards, and test repositories while supporting production monitoring and release readiness.
Trilogy Federal drives innovative solutions for complex business challenges across financial management, healthcare, and government industries. Our collaborative, client-first service approach, combined with our commitment to the rapid implementation of pragmatic solutions, has earned Trilogy an unparalleled reputation for delivering transformative results.
Trilogy Federal seeks an experienced Data Quality Engineer to support the Department of Veterans Affairs (VA) Summit Advanced Tooling, Lakehouse, and Artificial Intelligence Services (Summit ATLAS) program. The Data Quality Engineer will develop and implement automated data quality controls to ensure the accuracy, completeness, consistency, and reliability of enterprise data used for analytics, reporting, and artificial intelligence and machine learning (AI/ML) applications.
This position will support the Summit Data Platform by validating data ingestion and transformation processes, monitoring data quality, and ensuring datasets meet Government-approved standards before publication and customer use.
Please note, this position is contingent upon award (anticipated early 2027). This role will also require 1-2 domestic business trips per year.
Primary Responsibilities:
- Design, develop, and maintain automated data quality tests and validation processes for cloud-based data ingestion, transformation, and analytical workloads.
- Perform data reconciliation and equivalence testing between source systems, legacy platforms, and Summit datasets to verify data accuracy and migration parity.
- Implement data quality checks for completeness, consistency, validity, uniqueness, and timeliness in accordance with Government-approved standards.
- Develop and maintain automated monitoring, anomaly detection, and alerting capabilities to identify data quality issues and pipeline failures.
- Validate compliance with established data freshness and reliability Service Level Agreements (SLAs), documenting test results, exceptions, and residual risks before dataset publication.
- Collaborate with data engineers, data governance specialists, and data owners to implement approved quality rules, thresholds, and publication criteria.
- Investigate data discrepancies, perform root cause analysis, and coordinate corrective actions to prevent recurring quality issues.
- Maintain data quality rules, test cases, validation results, and supporting documentation in the Data Quality Rule Library and related repositories.
- Develop and maintain data quality metrics, dashboards, and reports, including contributions to the Summit Data Quality and Ingestion Dashboard.
- Support production monitoring and release readiness by validating corrective actions, retesting affected datasets, and confirming compliance with established quality standards.
Minimum Requirements:
- Bachelor's degree in Computer Science, Information Technology, Data Analytics, or a related technical discipline, or an equivalent combination of education and relevant professional experience.
- Five or more years of professional experience in data quality engineering, data validation, data testing, or a related discipline.
- Strong proficiency in Structured Query Language (SQL) for data profiling, reconciliation, validation, and analysis.
- Experience developing automated data quality tests and validation scripts using Python or comparable programming languages.
- Experience testing Extract, Transform, and Load (ETL) and Extract, Load, and Transform (ELT) processes in enterprise data environments.
- Experience validating data accuracy, completeness, consistency, and integrity across multiple source systems and data platforms.
- Experience with data reconciliation, regression testing, anomaly detection, and root cause analysis.
- Familiarity with cloud-based data platforms, data warehouses, and lakehouse architectures.
- Experience documenting data quality rules, test results, defects, and corrective actions.
- Strong analytical, troubleshooting, communication, and collaboration skills.
- Ability to meet VA personnel vetting, background investigation, and system access requirements.
- The ability to travel for 1-2 domestic business trips per year.
Preferred Qualifications:
- Experience supporting VA or other federal agency data modernization initiatives.
- Hands-on experience with Microsoft Azure data services, Azure Databricks, or Delta Lake.
- Experience implementing enterprise data quality frameworks or tools such as Great Expectations, Soda, or comparable technologies.
- Knowledge of Data Management Association (DAMA) data quality principles and enterprise data governance practices.
- Experience implementing data observability solutions and automated quality monitoring for large-scale data pipelines.
- Experience working with sensitive healthcare data and federal privacy and security requirements.
- Relevant certification in data management, data quality, cloud data engineering, or data analytics.
Benefits (including but not limited to):
- Health, dental, and vision plans
- Optional FSA
- Paid parental leave
- Safe Harbor 401(k) with employer contributions 100% vested from day 1
- Paid time off and 11 paid holidays
- No cost group term life/AD&D plan, and optional supplemental coverage
- Pet insurance
- Monthly phone and internet stipend
- Tuition and training reimbursement
To cut down on falsified applications and to avoid subjecting real candidates to screening by AI assistants, phone interviews at Trilogy require either a landline or a cellphone number backed by a physical SIM. We cannot conduct interviews with candidates who provide VOIP contact numbers (including Google Voice).
Trilogy Federal is an Equal Employment Opportunity employer. We do not discriminate based upon race, religion, color, national origin, gender (including pregnancy, childbirth, or related medical conditions), sexual orientation, gender identity, gender expression, age, status as a protected veteran, status as an individual with a disability, or other applicable legally protected characteristics.
Similar Jobs
Artificial Intelligence • Insurance • Machine Learning • Software • Analytics
Build and maintain automated data quality testing for customer data pipelines. Responsibilities include developing dbt, Soda, and SQL checks; validating schemas, loads, sequencing, and downstream reconciliations; detecting anomalies; managing severity levels and customer overrides; reporting quality metrics; and partnering with engineering teams to embed testing into new pipelines. The role requires strong backend testing, SQL, Python, Airflow, and Databricks experience, along with excellent debugging and communication skills.
Top Skills:
Apache AirflowCi/CdCypressDatabricksDbtDelta LakeGitPlaywrightPythonSodaSpark SqlSQL
Healthtech • Information Technology
Build and enhance enterprise data quality frameworks, automated validation rules, data contracts, governance checks, metadata capabilities, and certification workflows. The role monitors and scores data quality across a cloud data platform, integrates Collibra certification, supports data observability and lineage, coaches technical and business teams, and establishes organization-wide standards for trusted data.
Top Skills:
BigQueryCloud-Native Data PlatformsCollibraData CatalogsData LineageGreat ExpectationsMetadata ManagementMonte CarloSQL
Software
Designs and automates data validation, profiling, testing, monitoring, and quality frameworks for multi-source cloud data. The role uses Azure Synapse, Databricks, SQL, Python, Scala, Collibra, and Profisee to detect anomalies, enforce governance, and improve data reliability. Responsibilities include developing automated test plans, analyzing structured and unstructured datasets, supporting Azure data engineering workflows, and collaborating with engineers, analysts, data scientists, and product teams. A Public Trust or Suitability/Fitness determination may be required.
Top Skills:
Azure Data FactoryAzure Data Lake ServiceAzure MlAzure SynapseCollibra Data QualityConfluenceDatabricksDynatraceJIRAJira X-RayLog AnalyticsPower BIProfiseePyramid AnalyticsPythonScalaSplunkSQLStarburstSynapse Pipelines
What you need to know about the San Francisco Tech Scene
San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.
Key Facts About San Francisco Tech
- Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Google, Apple, Salesforce, Meta
- Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
- Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
- Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine


