SDET focused on data reconciliation, complex SQL, and ETL testing. Build and automate test frameworks, validate ETL pipelines and data warehouses, write optimized SQL for data validation, perform root-cause analysis of discrepancies, and ensure data integrity between source and target systems.
Job Summary:
Nice to have:
We are seeking a highly skilled and detail-oriented Software Development Engineer in Test (SDET) to join our team with a focus on data reconciliation, complex SQL, and ETL testing. The ideal candidate will have a unique blend of skills in software development, quality assurance, and data engineering. You will be responsible for ensuring data accuracy, validating ETL processes, and building automation frameworks for data-related testing processes. This is a key role to ensure the integrity and quality of our data infrastructure and analytics platforms.
Key Responsibilities:- Complex SQL Queries:
- Write and optimize complex SQL queries to validate data pipelines, transformations, and reporting accuracy.
- Perform root cause analysis of data discrepancies and provide insights into data quality issues.
- Develop automated SQL scripts to streamline data validation and reconciliation processes.
- ETL Testing:
- Validate ETL processes by designing comprehensive test strategies to ensure data accuracy and completeness.
- Test and verify ETL pipelines from various data sources (structured and unstructured) into data warehouses, ensuring data conforms to business rules and logic.
- Implement automated ETL testing frameworks and continuously improve them to optimize the data validation process.
- Data Reconciliation:
- Develop, implement, and automate test scripts to validate data integrity between source and target systems.
- Identify and resolve data inconsistencies, mismatches, and errors in large datasets.
- Design and execute reconciliation processes to ensure accurate data migration and transformation.
Nice to have:
- Experience with HiveQL for Hive Database
- Experience with Python as a scripting language
Photon San Francisco, California, USA Office
San Francisco, United States
Similar Jobs
Cloud • Information Technology • Security • Software • Cybersecurity
Lead the enterprise data platform strategy and architecture, driving Snowflake/dbt-based platform evolution, self-service Data Mesh and medallion models. Build AI-ready pipelines, RAG systems, and observability/cost frameworks while managing a central data team, supporting federated BI, and executing hands-on technical work.
Top Skills:
AiopsAutomated TestingCi/CdCortexData MeshDbtGitGraph RagMatillion Data Productivity Cloud (Matillion Dpc)Medallion ArchitecturePythonRetrieval-Augmented Generation (Rag)SnowflakeSnowparkSQLStreamlit
Aerospace • Hardware • Information Technology • Security • Software • Cybersecurity • Defense
Design and develop FPGA systems using VHDL and vendor toolchains. Create testbenches and perform simulation with QuestaSim, perform lab verification and debugging, manage configurations with Git, provide architectural input, and mentor/lead a team of engineers on communications-related FPGA projects.
Top Skills:
GitIntel QuartusLinuxMentor Graphics QuestasimVhdlWindowsXilinx Vivado
Aerospace • Hardware • Information Technology • Security • Software • Cybersecurity • Defense
Lead and deliver enterprise-scale IT projects (infrastructure modernization, cloud migration, cybersecurity, compliance) across the project lifecycle. Manage schedules, EVM, budgets, vendors, resources, risks, stakeholder engagement, change management, and benefits realization. Drive agile execution and executive communications.
Top Skills:
AgileCloud MigrationEarned Value Management (Evm)ExcelMicrosoft ProjectPowerPointServicenow SpmWord
What you need to know about the San Francisco Tech Scene
San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.
Key Facts About San Francisco Tech
- Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Google, Apple, Salesforce, Meta
- Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
- Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
- Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine
