Onebridge Logo

Onebridge

Databricks Architect

Reposted 21 Days Ago
Be an Early Applicant
Remote
Hiring Remotely in United States
Expert/Leader
Remote
Hiring Remotely in United States
Expert/Leader
The Databricks Architect will design and implement scalable data and analytics platforms, optimize data pipelines, and mentor team members while ensuring alignment with business goals.
The summary above was generated by AI

Onebridge, a Marlabs Company, is a global AI and Data Analytics Consulting Firm that empowers organizations worldwide to drive better outcomes through data and technology. Since 2005, we have partnered with some of the largest healthcare, life sciences, financial services, and government entities across the globe. We have an exciting opportunity for a highly skilled Databricks Architect to join our innovative and dynamic team. 

Databricks Architect | About You 

As a Databricks Architect, you are responsible for designing, implementing, and governing scalable data and analytics platforms that support enterprise reporting, advanced analytics, and data‑driven decision making. You play a hands‑on role in shaping data architecture, setting technical standards, and ensuring Databricks solutions are built for performance, reliability, and long‑term scalability. You work closely with data engineers, analysts, and business stakeholders to guide solution design, review implementations, and ensure alignment with business objectives. You are actively involved in platform optimization, cost management, and the adoption of best practices across data ingestion, transformation, and analytics. As a technical leader, you mentor team members, influence architectural decisions, and help mature the organization’s overall data capabilities.

Databricks Architect | Day-to-Day 

  • Design and architect end‑to‑end data platforms using the Databricks Lakehouse architecture. 
  • Define and implement scalable batch and streaming data pipelines using Apache Spark and Delta Lake. 
  • Partner with engineering, analytics, and business teams to translate functional requirements into technical designs. 
  • Establish and enforce data modeling, performance optimization, and cost‑management best practices within Databricks. 
  • Lead cloud‑based implementations across AWS, Azure, or GCP, including networking, security, and access controls. 
  • Provide technical leadership through architecture reviews, code reviews, and design sessions. 
  • Support production environments by troubleshooting data quality, performance, and reliability issues. 

Databricks Architect | Skills & Experience 

  • 10+ years of overall experience in data engineering, data architecture, or enterprise analytics platforms. 
  • Hands‑on experience designing and implementing solutions on Databricks. 
  • Strong proficiency in Apache Spark, SQL, and Delta Lake for large‑scale data processing. 
  • Experience building and optimizing both batch and real‑time data pipelines. 
  • Proven experience working within at least one major cloud platform, including AWS, Azure, or GCP. 
  • Solid understanding of data governance concepts including security, lineage, access control, and compliance. 
  • Experience with data modeling techniques for analytical and reporting workloads. 
  • Familiarity with CI/CD practices, version control, and infrastructure‑as‑code approaches for data platforms. 
  • Demonstrated ability to mentor engineers and lead technical design discussions in cross‑functional teams. 

Similar Jobs

15 Days Ago
Remote
United States
102K-133K Annually
Senior level
102K-133K Annually
Senior level
Artificial Intelligence • Information Technology • Professional Services • Software • Analytics • Generative AI • Big Data Analytics
Lead design and implementation of an enterprise Databricks lakehouse, build scalable batch and streaming pipelines, enforce governance and CI/CD standards, optimize Spark workloads, operationalize ML with MLflow, manage cloud infrastructure and IaC, and mentor data engineering teams.
Top Skills: AdlsAWSAzureDatabricksDatabricks Asset BundlesDatabricks WorkflowsDbxDelta LakeDelta Live TablesFeature StoreGCPGcsGitMlflowPhotonPysparkPythonS3ScalaSpark SqlSQLStructured StreamingTerraformUnity Catalog
2 Days Ago
In-Office or Remote
185K-190K Annually
Expert/Leader
185K-190K Annually
Expert/Leader
Information Technology
Lead design and deployment of statistical and ML solutions for large-scale data, build and validate probabilistic graph and forecasting models, automate data pipelines (Python/PySpark/R), use ML frameworks (TensorFlow/PyTorch/scikit-learn), implement model monitoring, and mentor junior data scientists.
Top Skills: ArimaArimaxBentomlCntkDecision TreesEuclidean DistanceEvidently AiExponential SmoothingGreat ExpectationsHamming DistanceKerasKubeflowManhattan DistanceMxnetProbabilistic Graph ModelsPysparkPythonPyTorchRR StudioSASScikit-LearnSpssSvmTensorFlow
13 Days Ago
In-Office or Remote
Expert/Leader
Expert/Leader
Big Data • Analytics • Business Intelligence • Big Data Analytics
Lead design and implementation of a Databricks-driven data ecosystem, including lakehouse/EDW, IoT and streaming ingestion pipelines, ILM, global data governance, and dataset creation for advanced analytics.
Top Skills: Amazon KinesisAws Iot CoreAws Iot Device DefenderAws Iot Device ManagementAws LambdaAzure FunctionsAzure Iot HubAzure Stream AnalyticsBusiness Intelligence ToolsContainerizationCosmos DbData ModelingDatabricksDelta LakeDevice Provisioning Service (Dps)Device SdkDevice TwinsDynamoDBEmrEnterprise Data Warehouse (Edw)LakehouseServerlessSpark

What you need to know about the San Francisco Tech Scene

San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.

Key Facts About San Francisco Tech

  • Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Google, Apple, Salesforce, Meta
  • Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
  • Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
  • Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account