Capital Technology Group Logo

Capital Technology Group

Quality Engineer (Data)

Posted Yesterday
Remote
Hiring Remotely in US
75K-110K Annually
Senior level
Remote
Hiring Remotely in US
75K-110K Annually
Senior level
Develop and implement quality strategies, automated testing frameworks, and validation practices for data pipelines and analytical datasets. Test accuracy, completeness, integrity, schema consistency, business rules, and freshness using Python, PySpark, SQL, Spark, Airflow, and AWS. Investigate data anomalies and pipeline failures, monitor quality metrics, support CI/CD and releases, and collaborate with engineers, analysts, data scientists, and stakeholders to ensure reliable financial and regulatory data.
The summary above was generated by AI

Capital Technology Group provides expert consulting services software development, digital transformation, human-centered design, data analytics and visualization, and cybersecurity. 

Our multidisciplinary teams use agile methodologies to rapidly and incrementally deliver value in close collaboration with our clients. For over a decade, we have been trusted by both federal and commercial clients to solve complex, mission-critical business challenges. The quality of our work has been recognized by our partners and peers through our inclusion in the Digital Services Coalition, a group of forward- thinking firms recognized for excellence in delivering IT services.

Client Requirements: applicants MUST BE US Citizens and be able to obtain Public Trust clearance

The CTG Experience

At Capital Technology Group (CTG), our teams are passionate about modernizing how the federal government delivers software. We partner with federal agencies to build secure, scalable, and mission-driven solutions that make a meaningful impact on millions of people. Recognized by The Washington Post as a Top Workplace in 2025 and 2026. CTG fosters a culture rooted in our core values. Our values guide how we work together and support one another, creating an environment where employees feel trusted, empowered, and encouraged to grow both personally and professionally.

About the Role

CTG is seeking a Quality Engineer to join a data engineering team, supporting a program that manages financial and regulatory data. This role develops and implements quality assurance strategies, testing methodologies, and automation practices that keep data accurate, complete, consistent, and reliable across modern data pipelines and analytics platforms, combining strong testing and automation skills with data engineering fundamentals and the rigor financial and regulatory data demands.

You Will Get To
  • Develop and implement data quality strategies, standards, testing practices, documentation, and maintenance processes for data pipelines and analytical datasets.
  • Design and execute automated and manual tests covering data accuracy, completeness, integrity, uniqueness, schema consistency, business rules, freshness, and statistical validity.
  • Build automated quality checks and integration/end-to-end tests using Python, PySpark/Spark, SQL, and Apache Airflow.
  • Validate data transformations and pipelines across Apache Spark, Python, AWS, Amazon S3, and related AWS data services.
  • Develop reusable testing frameworks and utilities for data pipelines and CI/CD, ensuring code and data are validated before production release.
  • Implement quality validation across raw, cleaned, curated, and analytics-ready data, establishing thresholds, rules, and acceptance criteria.
  • Investigate data anomalies, schema changes, missing data, pipeline failures, and other quality issues; identify root causes and partner with Data Engineers on resolution.
  • Conduct code and product reviews and ensure new pipelines and transformations include appropriate unit, integration, and data quality testing.
  • Monitor data quality metrics and dashboards and support automated regression testing to protect downstream data consumers.
  • Collaborate with Data Engineers, Data Scientists, Analysts, and stakeholders to translate business and regulatory requirements into data quality controls throughout the SDLC.
  • Support UAT, release validation, production deployments, and documentation of test strategies, requirements, defects, and validation procedures.
Who You Are
  • Passionate about building quality into data and software from the beginning
  • A detail-oriented problem solver who enjoys identifying risks and improving processes
  • Comfortable collaborating across data engineering, analytics, and stakeholder teams
  • Able to balance strategic quality initiatives with hands-on testing responsibilities
  • A strong communicator who can clearly document findings and advocate for quality improvements, translating technical data issues for non-technical stakeholders
  • Curious about emerging tools, technologies, and testing best practices
  • Motivated by mission-driven work and delivering datasets stakeholders can trust
Qualifications
  • Bachelor's degree in Computer Science, Information Systems, Engineering, or a related field  (or equivalent experience)
  • 7+ years of professional experience in software quality assurance, testing, or quality engineering roles
  • Strong programming experience with Python, and experience developing automated tests and test frameworks (e.g., Pytest or comparable)
  • Strong understanding of data quality principles and methodologies, including accuracy, completeness, consistency, uniqueness, validity, and timeliness
  • Experience working with relational databases and SQL
  • Experience testing data pipelines, ETL/ELT processes, or large-scale data transformations
  • Experience with distributed data processing technologies such as Apache Spark/PySpark
  • Familiarity with Apache Airflow or another workflow orchestration platform
  • Experience working with cloud-based data platforms, preferably AWS
  • Experience creating, executing, and maintaining automated and manual test plans and test cases, and identifying, documenting, prioritizing, and tracking software defects
  • Experience supporting Agile software development teams
  • Strong analytical, communication, and problem-solving skills, including the ability to investigate data discrepancies, identify root causes, and communicate technical data quality issues clearly to both technical and non-technical stakeholders
Nice to Have
  • Experience testing financial, securities, regulatory, or other highly governed data
  • Experience with AWS services such as Amazon S3, AWS Glue, Amazon Redshift, and/or Amazon Athena
  • Experience implementing data quality frameworks or automated data validation platforms
  • Experience with Pytest or similar Python testing frameworks
  • Experience with dbt and/or automated testing of SQL-based transformations
  • Experience with CI/CD pipelines and automated testing within software development workflows
  • Experience with data lineage, metadata management, and data observability
  • Experience testing data in data lakes, lakehouses, or data warehouses
  • Familiarity with schema evolution, schema validation, and detection of schema drift
  • Experience designing tests for high-volume datasets and distributed processing environments
  • Experience supporting federal government agencies
  • Certified Software Tester (CSTE), ISTQB, or similar certification
Salary

We are committed to offering a competitive salary for this position, with an estimated range of $75k–$110k annually. Please note that this range is intended to provide a general idea of what to expect. The final offer may vary based on experience, skills, and other factors.

Full Time Employee Benefits
  • Remote Work (Hybrid roles will be specified in the job post)
  • Competitive Compensation Package
  • Medical, Dental, and Vision
  • Life Insurance, Short/Long Term Disability
  • Employee Assistance Program
  • 401(k) with 4% matching
  • Liberal PTO vacation policy
  • Generous Annual Continuing Education
  • Annual Wellness Budget
  • Bonus Incentive Programs (Employee referrals and performance-based rewards)

Thanks for your interest in Capital Technology Group!

Capital Technology Group is an equal opportunity employer and all qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, disability status, protected veteran status, or any other characteristic protected by law.


Similar Jobs

17 Minutes Ago
Remote
US
115K-135K Annually
Senior level
115K-135K Annually
Senior level
Cloud • Information Technology • Cybersecurity
Validates complex enterprise data processing, transformations, migrations, reconciliations, reporting, business rules, APIs, and event-driven workflows. Develops data validation strategies, automated database validation scripts, migration tests, and reconciliation reports. Partners with data architects and engineers while mentoring junior testers. The role requires advanced SQL, automation, ETL validation, relational data modeling, large-scale migration testing, and Python programming.
Top Skills: APIsETLPythonRelational DatabasesSQL
Yesterday
In-Office or Remote
San Mateo, CA, USA
Mid level
Mid level
Big Data • Other • Analytics
Own data pipeline integrity, validation, monitoring, and reliability for climate-risk products. Design automated data quality frameworks, investigate infrastructure issues, coordinate with external data vendors, validate data for product and financial models, document post-launch processes, and communicate quality risks. Collaborate with Engineering, Product, Solutions, quantitative modeling, and architecture teams during product launches and iterations.
Top Skills: Amazon S3AWSDockerGitPandasPostgresPrefectPydanticPytestPythonSnowflakeSQLTemporal
5 Days Ago
In-Office or Remote
Mid level
Mid level
Software
Build automated validation, reconciliation, anomaly detection, and test automation for cloud billing data across AWS, Azure, and Google Cloud. Investigate and resolve data-quality issues, automate preventive checks, document provider billing models, support customer-facing data questions, and use AI tooling to accelerate investigation and anomaly triage.
Top Skills: AirflowArgoAWSCiDagsterDbtETLGCPGreat ExpectationsAzurePythonSodaSQL

What you need to know about the San Francisco Tech Scene

San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.

Key Facts About San Francisco Tech

  • Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Google, Apple, Salesforce, Meta
  • Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
  • Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
  • Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account