Data Engineer II

Based in St. Louis, Core & Main is a leader in advancing reliable infrastructure™ with local service, nationwide®. As a specialty distributor with a focus on water, wastewater, storm drainage and fire protection products and related services, Core & Main provides solutions to municipalities, private water companies and professional contractors across municipal, non-residential and residential end markets, nationwide. With over 370 locations across the U.S., the company provides its customers local expertise backed by a national supply chain. Core & Main’s 5,700 associates are committed to helping their communities thrive with safe and reliable infrastructure. Visit coreandmain.com to learn more.

Job Summary

Design, build, test, and maintain reliable data pipelines and data solutions that support analytics, reporting, and operational use cases. This role owns end‑to‑end data pipelines or data flows within defined domains and works independently on moderately complex data engineering tasks.

Partner closely with senior engineers, architects, and stakeholders to deliver high‑quality, secure, and well‑documented data solutions that meet business and technical requirements.

Major Tasks, Responsibilities and Key Accountabilities

• Design, develop, and maintain production‑ready data pipelines, data transformations, and data models.
• Collaborate with business and technical stakeholders to understand data requirements and translate them into scalable solutions.
• Implement and maintain data warehouse, data lake, or lakehouse solutions aligned with architectural standards.
• Perform unit testing and support QA, regression, and user acceptance testing for data solutions.
• Troubleshoot, debug, and resolve data pipeline failures, performance issues, and data quality defects.
• Contribute to technical documentation, including design artifacts, data mappings, and operational runbooks.
• Participate in peer code reviews and apply feedback to improve code quality and maintainability.
• Support enhancements, patches, and upgrades to existing data platforms and tooling.

Preferred Qualifications

• Bachelor’s degree in Computer Science, Information Technology, or related field.
• 4 years of hands-on development experience in SQL and/or Python for data warehouse management, data integration, and data lake management.
• Deep working knowledge in SQL development using T-SQL code to design, implement, and optimize complex database objects, such as tables, views, stored procedures, indexes, and functions.
• Experience working with Azure data architecture, including a solid understanding of tools for building data pipelines on cloud-based data platforms, such as Delta Lakehouse Medallion architecture and data warehousing solutions.
• Exposure to modern Spark-based data platforms like Databricks or Microsoft Fabric for data engineering tasks, including leveraging their capabilities for scalable data processing, analytics, and machine learning workflows in a cloud-based environment.
• Understanding of ELT vs ETL and how to build efficient data pipelines with modern Change Data Capture processes.
• Hands-on experience with CI/CD pipelines in Azure DevOps and understanding of Agile development methodologies.
• Familiarity with common data mapping and transformation techniques for Dynamics 365 Data Entities and Data Management Framework for the Finance and Operations modules.
• Familiarity with Power BI and its integration with Microsoft Fabric for end-to-end analytics.
• Strong communication skills with the ability to translate complex technical concepts into business-friendly language.

Career Level Dimensions

Typical Training/Experience

• Typically requires BS/BA in a related discipline. Generally, 3-5 years of experience in a related field; certification is required in some areas OR MS/MA and generally 2+ years of experience in a related field.

Problem Complexity

• Applies established problem‑solving skills to moderately complex situations. Identifies root causes for common and recurring data issues and escalates more complex or ambiguous problems appropriately. Troubleshoots and resolves issues within defined data pipelines, systems, or domains, using documented patterns and guidance from senior team members.

Autonomy

• Performs assignments with moderate independence, operating within established practices and architectural standards.
• Determines appropriate approaches to solutions for well‑defined problems.
• Receives regular technical guidance on complex problems, design decisions, or unfamiliar technologies.

Collaboration

• Works closely with other engineers, analysts, and business partners to deliver reliable, high‑quality data solutions.
• Actively participates in knowledge sharing, documentation, and peer reviews.
• May provide informal guidance to less experienced engineers but does not have formal leadership or people management responsibilities.

Core & Main is an Equal Employment Opportunity employer. Employment at Core & Main is based solely on a person’s merit and qualifications directly related to professional competence.  Core & Main does not discriminate against any employee or applicant on the basis of race, creed, color, religion, national origin, nationality, ancestry, age, disability, veteran status, pregnancy or related condition (including breastfeeding), affectional or sexual orientation, gender identity or expression, marital status, status with regard to public assistance, citizenship, or any other basis protected by law.

None of the questions in this application are intended to elicit information regarding any protected characteristics, nor imply any limitation, illegal preferences or discrimination based upon non-job-related information or protected characteristics.

For more information, please click here or visit https://www.eeoc.gov