Lead design and implementation of scalable Databricks Lakehouse solutions using Delta Lake, Unity Catalog, and MLflow. Advise stakeholders, drive cloud data platform modernization across Azure/AWS/GCP, ensure data governance and quality, optimize performance and cost, and mentor teams. Support presales, deliver billable consulting, and champion AI/ML-enabled data solutions to translate platform capabilities into business outcomes.
Description
The Principal Consulting Engineer - Databricks ensures scalable data architecture solutions are designed and implemented using the Databricks platform to the customer's satisfaction and approval. This position provides technical leadership across modern Lakehouse architectures, Delta Lake, Unity Catalog, MLflow, data governance, data quality, cloud-native design patterns, and AI/ML-enabled data solutions. The role serves as a trusted advisor to executives, technical stakeholders, and delivery teams by translating Databricks capabilities into measurable business outcomes, including scalability, cost efficiency, time-to-insight, and AI-driven innovation. This position will provide oversight and project guidance while taking a lead technical role in advancing CDW's Databricks, cloud data platform, and Digital Velocity solution offerings. What you will do
* Design, develop, and implement scalable Databricks architecture solutions using Delta Lake, Unity Catalog, MLflow, and related platform capabilities for enterprise customers.
* Collaborate with cloud solution architects, data engineers, data scientists, business analysts, and customer stakeholders to implement complex end-to-end enterprise data solutions using the Databricks platform.
* Partner with pre-sales teams on Databricks statements of work, including solution scope, estimates, assumptions, timelines, and implementation approach.
* Work directly with executive and technical stakeholders to articulate the business value of Databricks and AI/ML, translate capabilities into customer outcomes, and co-create innovation roadmaps.
* Provide billable consulting leadership through complex Databricks architecture, cloud-native pattern design, platform modernization, data governance, data quality, and cloud engineering solutions.
* Champion AI/ML as part of the delivery model by using automation, optimization, and machine learning frameworks to accelerate implementation, reduce cost, and increase customer impact.
* Assess customer data ecosystems, cloud data readiness, IT priorities, and business success measures to design implementation architectures and structured learning plans.
* Serve as a thought leader internally and externally by shaping Databricks and AI/ML strategy, mentoring peers, contributing to reusable delivery assets, and helping build CDW's reputation as a trusted advisor. What we expect of you
* Bachelor's degree and 10+ years of consulting experience, including hands-on experience designing and implementing Databricks platform solutions OR 14+ years of related IT, data platform, or cloud architecture experience.
* Deep expertise with Databricks platform capabilities, including Delta Lake, Unity Catalog, MLflow, data pipelines, ETL/ELT frameworks, batch and streaming solutions, PySpark, Scala, SQL, and Python scripting.
* Experience with data governance, data cataloging, master data management, data quality, RBAC, security, compliance, and data lineage using Unity Catalog and related modern data platform practices.
* Strong cloud data architecture experience across Azure, AWS, or Google Cloud, including data platform modernization, cloud-native design patterns, advanced analytics, and AI/ML solution enablement.
* Ability to optimize Databricks performance and cost through cluster configuration, job tuning, workload design, automation, and platform best practices.
* Proven ability to lead architecture decisions, own end-to-end technical accountability, mentor other resources, and guide platform-agnostic projects in agile, fast-paced environments.
* Excellent communication, stakeholder management, problem-solving, adaptability, and executive presentation skills, with the ability to manage ambiguity and deliver clear business and technical insights.
* Preferred certifications include Databricks Certified Data Engineer Professional and Databricks Certified AI/ML Engineer Associate or Professional.
* Willingness to travel to other CDW locations or client sites; a valid U.S. driver's license is required. Pay range: $156,000 - $240,800 depending on experience and skill set Annual bonus target of 10% subject to terms and conditions of plan Benefits overview: https://cdw.benefit-info.com/ Salary ranges may be subject to geographic differentials
* CDW is committed to being an AI-fluent organization
* We're looking for people who bring curiosity, a learner's mindset, and a willingness to engage with ever-evolving technology and tools. We value adopting AI as a partner, openness to experimentation, and a shared interest in learning together on AI. Our goal is to create a culture where AI enhances- not replaces- human creativity and decision-making. You don't need to be an expert today; what matters is your readiness to explore, adapt, and grow with us as we integrate AI responsibly and effectively into our work.Additionally, CDW is committed to fostering an equitable, transparent, and respectful hiring process for all applicants. During our application process, our goal is to understand your experience, strengths, skills, and qualifications. As an AI forward company, we see AI not just as a tool, but as a catalyst for new ways of thinking, creating, and communicating. We encourage candidates to embrace an AI mindset, one that's curious, adaptive, and ready to explore what's possible. We welcome thoughtful use of AI to expand your perspective and elevate how you share your story, while ensuring your application remains rooted in your own background, judgment, and voice.
* About Us
* CDW is a Fortune 500 technology solutions provider that helps businesses, government, education, and healthcare organizations achieve what's possible through technology. What makes CDW different isn't just what we do- it's how we do it. At CDW we act as one- building trust, speaking candidly, and working together to achieve more. We play to win- focusing on what matters most and delivering for our customers. And we think forward- staying curious, moving fast, and continuously learning. We believe meaningful work happens when people feel supported, heard, and empowered to contribute. That's why we think of ourselves as coworkers, not just employees- working together to solve complex challenges and deliver real impact for our customers and communities. As a full-stack, full-lifecycle technology partner, CDW brings deep expertise, strong relationships, and broad industry knowledge to help turn ideas into outcomes. When you join CDW, you become part of a collaborative environment where your work matters, your growth is supported, and your contributions help shape what's next. Together, we deliver the full promise of what technology can do.
* Together, we Make Amazing Happen.
* CDW is an equal opportunity employer. All qualified applicants will receive consideration for employment without regards to race, color, religion, sex, sexual orientation, gender identity, national origin, disability status, protected veteran status or any other basis prohibited by state and local law.
The Principal Consulting Engineer - Databricks ensures scalable data architecture solutions are designed and implemented using the Databricks platform to the customer's satisfaction and approval. This position provides technical leadership across modern Lakehouse architectures, Delta Lake, Unity Catalog, MLflow, data governance, data quality, cloud-native design patterns, and AI/ML-enabled data solutions. The role serves as a trusted advisor to executives, technical stakeholders, and delivery teams by translating Databricks capabilities into measurable business outcomes, including scalability, cost efficiency, time-to-insight, and AI-driven innovation. This position will provide oversight and project guidance while taking a lead technical role in advancing CDW's Databricks, cloud data platform, and Digital Velocity solution offerings. What you will do
* Design, develop, and implement scalable Databricks architecture solutions using Delta Lake, Unity Catalog, MLflow, and related platform capabilities for enterprise customers.
* Collaborate with cloud solution architects, data engineers, data scientists, business analysts, and customer stakeholders to implement complex end-to-end enterprise data solutions using the Databricks platform.
* Partner with pre-sales teams on Databricks statements of work, including solution scope, estimates, assumptions, timelines, and implementation approach.
* Work directly with executive and technical stakeholders to articulate the business value of Databricks and AI/ML, translate capabilities into customer outcomes, and co-create innovation roadmaps.
* Provide billable consulting leadership through complex Databricks architecture, cloud-native pattern design, platform modernization, data governance, data quality, and cloud engineering solutions.
* Champion AI/ML as part of the delivery model by using automation, optimization, and machine learning frameworks to accelerate implementation, reduce cost, and increase customer impact.
* Assess customer data ecosystems, cloud data readiness, IT priorities, and business success measures to design implementation architectures and structured learning plans.
* Serve as a thought leader internally and externally by shaping Databricks and AI/ML strategy, mentoring peers, contributing to reusable delivery assets, and helping build CDW's reputation as a trusted advisor. What we expect of you
* Bachelor's degree and 10+ years of consulting experience, including hands-on experience designing and implementing Databricks platform solutions OR 14+ years of related IT, data platform, or cloud architecture experience.
* Deep expertise with Databricks platform capabilities, including Delta Lake, Unity Catalog, MLflow, data pipelines, ETL/ELT frameworks, batch and streaming solutions, PySpark, Scala, SQL, and Python scripting.
* Experience with data governance, data cataloging, master data management, data quality, RBAC, security, compliance, and data lineage using Unity Catalog and related modern data platform practices.
* Strong cloud data architecture experience across Azure, AWS, or Google Cloud, including data platform modernization, cloud-native design patterns, advanced analytics, and AI/ML solution enablement.
* Ability to optimize Databricks performance and cost through cluster configuration, job tuning, workload design, automation, and platform best practices.
* Proven ability to lead architecture decisions, own end-to-end technical accountability, mentor other resources, and guide platform-agnostic projects in agile, fast-paced environments.
* Excellent communication, stakeholder management, problem-solving, adaptability, and executive presentation skills, with the ability to manage ambiguity and deliver clear business and technical insights.
* Preferred certifications include Databricks Certified Data Engineer Professional and Databricks Certified AI/ML Engineer Associate or Professional.
* Willingness to travel to other CDW locations or client sites; a valid U.S. driver's license is required. Pay range: $156,000 - $240,800 depending on experience and skill set Annual bonus target of 10% subject to terms and conditions of plan Benefits overview: https://cdw.benefit-info.com/ Salary ranges may be subject to geographic differentials
* CDW is committed to being an AI-fluent organization
* We're looking for people who bring curiosity, a learner's mindset, and a willingness to engage with ever-evolving technology and tools. We value adopting AI as a partner, openness to experimentation, and a shared interest in learning together on AI. Our goal is to create a culture where AI enhances- not replaces- human creativity and decision-making. You don't need to be an expert today; what matters is your readiness to explore, adapt, and grow with us as we integrate AI responsibly and effectively into our work.Additionally, CDW is committed to fostering an equitable, transparent, and respectful hiring process for all applicants. During our application process, our goal is to understand your experience, strengths, skills, and qualifications. As an AI forward company, we see AI not just as a tool, but as a catalyst for new ways of thinking, creating, and communicating. We encourage candidates to embrace an AI mindset, one that's curious, adaptive, and ready to explore what's possible. We welcome thoughtful use of AI to expand your perspective and elevate how you share your story, while ensuring your application remains rooted in your own background, judgment, and voice.
* About Us
* CDW is a Fortune 500 technology solutions provider that helps businesses, government, education, and healthcare organizations achieve what's possible through technology. What makes CDW different isn't just what we do- it's how we do it. At CDW we act as one- building trust, speaking candidly, and working together to achieve more. We play to win- focusing on what matters most and delivering for our customers. And we think forward- staying curious, moving fast, and continuously learning. We believe meaningful work happens when people feel supported, heard, and empowered to contribute. That's why we think of ourselves as coworkers, not just employees- working together to solve complex challenges and deliver real impact for our customers and communities. As a full-stack, full-lifecycle technology partner, CDW brings deep expertise, strong relationships, and broad industry knowledge to help turn ideas into outcomes. When you join CDW, you become part of a collaborative environment where your work matters, your growth is supported, and your contributions help shape what's next. Together, we deliver the full promise of what technology can do.
* Together, we Make Amazing Happen.
* CDW is an equal opportunity employer. All qualified applicants will receive consideration for employment without regards to race, color, religion, sex, sexual orientation, gender identity, national origin, disability status, protected veteran status or any other basis prohibited by state and local law.
Similar Jobs at CDW
Information Technology
Sell ServiceNow consulting, implementation, managed services, and platform modernization solutions. Drive full sales lifecycle: account planning, opportunity qualification, relationship building, partnering with delivery and ServiceNow stakeholders, forecasting, and closing. Grow market presence, mentor junior sellers, represent CDW at events, and support GenAI-enabled transformation initiatives across ServiceNow workflows (ITSM, ITOM, ITAM, CSM, HRSD, SecOps).
Top Skills:
Cloud PlatformsCsmGenaiHrsdItamItomItsmSaaSSecopsServicenowSpm
Information Technology
Work as an on-campus liaison between CDW sales, university departments, and vendor partners. Build relationships, research campus technology needs, educate stakeholders on CDW solutions, and support sales efforts while learning through training and mentorship. Flexible, part-time on-campus role for sophomores/juniors.
Top Skills:
AILivemeeting
Information Technology
Lead technical delivery and governance for enterprise ServiceNow implementations, providing architecture, standards, training, risk escalation, stakeholder communication, and client advisory. Drive solution design for CSM and ITSM, mentor engineers, and ensure successful implementation across large-scale engagements.
Top Skills:
CsmItsmServicenow Certified Technical Architect (Cta)Servicenow Platform
What you need to know about the San Francisco Tech Scene
San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.
Key Facts About San Francisco Tech
- Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Google, Apple, Salesforce, Meta
- Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
- Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
- Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine

