Azure DBX

It's fun to work in a company where people truly BELIEVE in what they are doing!

We're committed to bringing passion and customer focus to the business.

Azure Databricks Engineer  

Fractal is a strategic AI partner to Fortune 500 companies with a vision to power every human decision in the enterprise. Fractal is building a world where individual choices, freedom, and diversity are the greatest assets; an ecosystem where human imagination is at the heart of every decision. Where no possibility is written off, only challenged to get better. We believe that a true Fractalite is the one who empowers imagination with intelligence. Fractal has been featured as a Great Place to Work by The Economic Times in partnership with the Great Place to Work® Institute and recognized as a ‘Cool Vendor’ and a ‘Vendor to Watch’ by Gartner.

Please visit Fractal | Intelligence for Imagination for more information about Fractal.

Please Note: We are not offering sponsorship at this time.
 

Role Overview

We are seeking a highly skilled Senior Azure Databricks Engineer to design, develop, and optimize enterprise-scale data platforms on Microsoft Azure. The ideal candidate will have strong hands-on experience with Azure Databricks, Data Engineering, Cloud Architecture, and Data Integration solutions. This role requires close collaboration with business stakeholders, architects, data scientists, and cross-functional teams to deliver scalable and high-performance data solutions.

Key Responsibilities

• Design, develop, and maintain scalable data pipelines using Azure Databricks.
• Build and optimize ETL/ELT workflows for processing large-volume structured and unstructured datasets.
• Develop data solutions using Spark (PySpark/Scala) within Azure Databricks.
• Implement Medallion Architecture (Bronze, Silver, Gold layers) for modern data platforms.
• Integrate data from multiple sources including APIs, databases, files, and streaming platforms.
• Collaborate with solution architects and business teams to understand data requirements.
• Design and implement data models supporting analytics, reporting, and AI/ML initiatives.
• Optimize Spark jobs and cluster configurations for performance and cost efficiency.
• Develop CI/CD pipelines for Databricks deployments using Azure DevOps.
• Implement data governance, security, monitoring, and compliance best practices.
• Troubleshoot production issues and support business-critical data operations.
• Mentor junior engineers and conduct technical reviews.

Required Skills

Azure Technologies

• Azure Databricks (DBX)
• Azure Data Factory (ADF)
• Azure Data Lake Storage Gen2 (ADLS)
• Azure Synapse Analytics
• Azure Key Vault
• Azure DevOps
• Azure Monitor and Log Analytics

Data Engineering

• PySpark
• Spark SQL
• Python
• SQL
• Delta Lake
• Data Modeling
• ETL/ELT Development
• Data Warehousing Concepts

DevOps & Automation

• Git
• CI/CD Pipelines
• Infrastructure as Code (Terraform preferred)
• Release Management

Database Technologies

• SQL Server
• Azure SQL Database
• PostgreSQL
• Snowflake (Preferred)

Preferred Qualifications

• Experience implementing Lakehouse architectures.
• Experience with Streaming solutions using Event Hub or Kafka.
• Knowledge of Machine Learning workflows in Databricks.
• Exposure to Healthcare, Life Sciences, Pharmaceutical, or Financial Services domains.
• Experience working directly with client stakeholders in onsite environments.
• Strong understanding of data security, governance, and data quality frameworks.

Education

• Bachelor's or Master's degree in Computer Science, Information Technology, Data Engineering, or a related field.

Note: The job description may be subject to modification based on business requirements and evolving project needs.

Pay:

The wage range for this role takes into account the wide range of factors that are considered in making compensation decisions including but not limited to skill sets; experience and training; licensure and certifications; and other business and organizational needs.  The disclosed range estimate has not been adjusted for the applicable geographic differential associated with the location at which the position may be filled.  At Fractal, it is not typical for an individual to be hired at or near the top of the range for their role and compensation decisions are dependent on the facts and circumstances of each case.  A reasonable estimate of the current range is: $120,000 - $140,000. In addition, you may be eligible for a discretionary bonus for the current performance period.

Benefits:

As a full-time employee of the company or as an hourly employee working more than 30 hours per week, you will be eligible to participate in the health, dental, vision, life insurance, and disability plans in accordance with the plan documents, which may be amended from time to time.  You will be eligible for benefits on the first day of employment with the Company.  In addition, you are eligible to participate in the Company 401(k) Plan after 30 days of employment, in accordance with the applicable plan terms.   The Company provides for 11 paid holidays and 12 weeks of Parental Leave. We also follow a “free time” PTO policy, allowing you the flexibility to take time needed for either sick time or vacation.

Fractal provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws.

If you like wild growth and working with happy, enthusiastic over-achievers, you'll enjoy your career with us!

Not the right fit?  Let us know you're interested in a future opportunity by clicking Introduce Yourself in the top-right corner of the page or create an account to set up email alerts as new job postings become available that meet your interest!