Prominence Advisors Logo

Prominence Advisors

Principal Data Platform Engineer (Databricks)

Posted 11 Days Ago
Remote
Hiring Remotely in United States
Senior level
Remote
Hiring Remotely in United States
Senior level
The Principal Data Platform Engineer leads the architecture and delivery of data platforms using Databricks, focusing on data pipeline design and client relationships.
The summary above was generated by AI

Prominence Advisors is actively seeking a Principal Data Platform Engineer (Databricks) to join our team.

Who We Are
Prominence is a healthcare and life sciences technology and consulting firm dedicated to helping leading organizations do more with their data. With deep expertise across the full ecosystem — spanning providers, payers, and life sciences — we turn complex data into actionable insight.

We deliver a full spectrum of services, including advisory, analytics, optimization, and IT staffing. Our work helps organizations operate more efficiently, improve patient outcomes, and deliver measurable financial impact through smarter use of data. Recognized as a 2x Best in KLAS organization, we partner with more than 120 health systems and 40 life sciences organizations, including 7 of the top 10 U.S. News & World Report-ranked institutions.

Through our life sciences brands, Tegra Analytics and WLH Consulting & Learning Solutions, we extend these capabilities to pharmaceutical and biotech organizations — combining data, consulting, and learning to advance commercial excellence.

By connecting strategy, data, and execution, we help organizations translate data into clarity, strategy into action, and vision into measurable results. At our core, we are a people-first, values-driven organization that believes strong teams and trusted partnerships are what ultimately make healthcare and life sciences smarter.

Job Summary

Prominence is looking for a Principal Data Platform Engineer to serve as a senior technical leader responsible for owning both the architecture and delivery of modern data platforms for our clients. This is a highly visible, client-facing role where you will shape data strategy, design scalable solutions, and lead implementation efforts end-to-end. You will partner directly with client stakeholders while mentoring internal team members, ensuring high-quality delivery aligned with Prominence’s standards of excellence. 

 
This role is ideal for someone who thrives at the intersection of strategy and execution—equally comfortable whiteboarding architecture with executives as they are building and optimizing pipelines alongside engineering teams. 


Requirements

Essential Functions and Responsibilities 

  • Own the end-to-end architecture and delivery of scalable data solutions, with a strong emphasis on Databricks-based platforms and modern cloud ecosystems 
  • Lead design and implementation of data pipelines, data models, and transformation frameworks that support analytics, reporting, and advanced use cases 
  • Serve as a primary client-facing technical leader, building trusted relationships and guiding stakeholders through complex data challenges and solution decisions 
  • Translate ambiguous business requirements into clear, actionable technical architectures and delivery plans 
  • Establish and enforce best practices across data engineering, including g data ingestion (pipeline orchestration, testing, and optimization) and DevOps. 
  • Drive platform strategy and architecture decisions, including lakehouse design, medallion architecture, and governance frameworks 
  • Lead and mentor delivery teams, providing technical guidance, code reviews, and hands-on support to ensure successful project outcomes 
  • Collaborate with cross-functional teams including data architects, analysts, and client stakeholders to ensure alignment and value delivery 
  • Identify risks, proactively address challenges, and ensure high-quality, timely delivery across engagements 
  • Contribute to internal capability building, including reusable frameworks, accelerators, and thought leadership 
  • Support business development efforts by shaping technical solutions, contributing to proposals, and participating in client discussions 
     

Minimum Qualifications 

  • 7+ years of experience in data engineering, with demonstrated progression into technical leadership and architecture ownership 
  • Deep expertise in Databricks and modern lakehouse architectures, including Delta Lake and Spark-based processing 
  • Advanced proficiency in SQL and Python, with strong experience building and optimizing large-scale data pipelines 
  • Hands-on experience with cloud platforms such as AWS, Azure, or GCP, including data services and infrastructure design 
  • Strong understanding of data modeling concepts, ETL/ELT patterns, and distributed data processing 
  • Experience with orchestration tools (e.g., Airflow) and transformation frameworks (e.g., dbt) 
  • Proven ability to lead technical delivery while remaining hands-on when needed 
  • Strong client-facing experience, including requirements gathering, solution design, and executive communication 
  • Ability to navigate ambiguity, prioritize effectively, and drive clarity in complex environments 
  • Healthcare data experience (e.g., Epic, HL7, FHIR, claims data) is strongly preferred 
  • Experience with CI/CD, DevOps practices, and infrastructure-as-code tools is a plus 

Skills, Knowledge, and Abilities 

  • Professional: Demonstrates a high degree of professionalism by treating others with respect, keeping commitments, building trust within the team, working with integrity, and upholding organizational values ("Do Great Work and Move Mountains”). 
  • Organized: Capable of managing multi-faceted work streams efficiently, ensuring smooth project flow. 
  • Self-Motivated: Adept at managing personal schedules, meeting deadlines, and monitoring work quality independently. 
  • Highly Adaptable: Quickly acclimates to new project assignments and diverse work environments. 
  • Creative: Approaches problems with a solution-oriented mindset, working collaboratively to find novel solutions. 
  • Communication: Effectively conveys clear and concise messages that resonate with the intended audience, both in written and verbal forms. 
  • Proactive: Anticipates potential issues, addresses concerns before they escalate, and effectively raises them when necessary. 
  • Team-Oriented: Passionate about mentoring and guiding others, thrives in a team-based environment. 


Physical and Medical Standards, Working Conditions and Environment 

  • Must be able to sit or stand at a computer and work remotely and independently from personal home office 
  • Willingness to travel for onsite meetings and business reviews as needed 
  • Flexibility to work across time zones to support client needs and engagements 

Hours Worked 

This is a Full Time, 40 hour per week position. 



Benefits

Prominence is dedicated to hiring the best and brightest minds in healthcare and maintaining a culture that rewards our employees for following their passion. We are excited to offer the following benefits for this position:

  • Competitive Salaried and Hybrid Compensation Plans
  • Health Care Plan (Medical, HSAs, Dental & Vision)
  • Retirement Plan (401k)
  • Life Insurance (Basic, Voluntary & AD&D)
  • Dependent & Health Savings Accounts
  • Short Term & Long Term Disability
  • Paid Time Off (Vacation/Sick & Public Holidays)
  • Training & Development Fund
  • Work From Home
  • Charitable Giving to Causes You Believe In
Employment Eligibility

Must be legally authorized to work in the United States without sponsorship.

Commitment to Equal Opportunity

The world’s most talented professionals come from every background. All applicants will be considered for employment without attention to age, race, color, religion, gender identity and/or expression, sexual orientation, national origin, marital status, veteran or disability status, or any other characteristic protected by law. In addition, Prominence will provide reasonable accommodations for qualified individuals with disabilities.

If you are smart and good at what you do, come as you are. All qualified candidates are encouraged to apply.

Partnership Eligibility

Our partnerships are extremely important to us. This online application is not intended for anyone who is currently under a non-compete agreement or has an arrangement that precludes employment at Prominence. We appreciate your help in respecting our partners.

Interested in learning more? Apply below to connect with our Talent team about immediate openings and future consulting projects.

Similar Jobs

2 Hours Ago
In-Office or Remote
Junior
Junior
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
Plan and execute high-intent events (roundtables, workshops, conference) to drive qualified pipeline. Manage venues, vendors, contracts, logistics, reporting, and sales alignment. Travel monthly, work closely with sales, customer, product, and marketing teams to deliver world-class attendee experiences.
Top Skills: ConfluenceJIRA
2 Hours Ago
Remote or Hybrid
63K-99K Annually
Junior
63K-99K Annually
Junior
Digital Media • Information Technology • News + Entertainment
Responsible for developing and maintaining client relationships in advertising sales to achieve annual sales goals, including market research, proposals, and revenue generation activities.
Top Skills: AdvertisingCustomer Relationship Management (Crm)Sales
2 Hours Ago
Remote or Hybrid
California, USA
84K-157K Annually
Senior level
84K-157K Annually
Senior level
Digital Media • Information Technology • News + Entertainment
Sell integrated networking, security, and communications solutions (SD-WAN, UCaaS, network security) to enterprise multi-site accounts. Prospect, develop territory relationships, deliver in-person presentations, meet revenue and quota targets, collaborate with internal teams, and manage complex sales cycles while supporting customers and partners.
Top Skills: EthernetNetwork SecuritySd-WanUcaasWireless

What you need to know about the San Francisco Tech Scene

San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.

Key Facts About San Francisco Tech

  • Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Google, Apple, Salesforce, Meta
  • Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
  • Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
  • Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account