Solvd, Inc. Logo

Solvd, Inc.

Senior Data Engineer (Databricks)

Posted 24 Days Ago
Remote
Hiring Remotely in Georgia, USA
Senior level
Remote
Hiring Remotely in Georgia, USA
Senior level
Lead design and delivery of Databricks-based Lakehouse solutions and end-to-end data engineering projects. Build and optimize ETL, streaming and batch pipelines, integrate cloud and on-prem systems, mentor team members, support pre-sales, and ensure governance, security, and platform performance.
The summary above was generated by AI

Solvd Inc. is a rapidly growing AI-native consulting and technology services firm delivering enterprise transformation across cloud, data, software engineering, and artificial intelligence. We work with industry-leading organizations to design, build, and operationalize technology solutions that drive measurable business outcomes.

Following the acquisition of Tooploox, a premier AI and product development company, Solvd now offers true end-to-end delivery—from strategic advisory and solution design to custom AI development and enterprise-scale implementation. Our capability centers combine deep technical expertise, proven delivery methodologies, and sector-specific knowledge to address complex business challenges quickly and effectively.

We are seeking a highly skilled and consultative Senior Data Engineer with Databricks expertise to join our team.

What you'll do

As a Data Engineer, you will provide technical leadership and guide customers to successful implementations of big data projects, ranging from architecture and design to data engineering to model deployment. You will lead clients through migrations and architect solutions from concept to production. You will provide structured mentorship for other team members and technical support for pre-sales efforts.

What you bring

  • Experience leading design and end-to-end development of distributed Databricks-based solutions, including Lakehouse architectures, ETL pipelines, streaming and batch processing, and integration with client's cloud and on-premises enterprise systems.

  • Hands-on experience in building big data pipelines.

  • Hands-on programming experience in Python.

  • Expert knowledge of SQL, Spark (or PySpark), including data ingestion from a variety of sources such as APIs, relational databases, etc.

  • Hands-on experience using dbt within Databricks ecosystem.

  • Solid understanding of data governance, security, and compliance.

  • Hands-on experience with platform optimization: cluster configuration, partitioning strategies, caching, autoscaling, and job orchestration.

  • Ability to clearly articulate core Databricks concepts and explain their practical applications.

  • Bachelor's degree in computer science, Information Systems, Engineering, or equivalent work experience.

  • Databricks Certification (highly desirable)

Nice-to-have

  • Experience with DevOps using Terraform.

  • Experience with design and deployment of scalable machine learning pipelines on Databricks using MLflow and Delta Lake.

  • Experience with Azure, AWS or GCP Databricks deployment.

  • Experience with Databricks deployments for government clients.

  • Experience with development of interactive dashboards and reports using BI tools, such as Power BI.

  • Programming experience with Scala.

When you join Solvd, you'll…

  • Shape real-world AI-driven projects across key industries, working with clients from startup innovation to enterprise transformation.

  • Be part of a global team with equal opportunities for collaboration across continents and cultures.

  • Thrive in an inclusive environment that prioritizes continuous learning, innovation, and ethical AI standards.

Ready to make an impact?

If you're excited to build things that matter, champion responsible AI, and grow with some of the industry’s sharpest minds. Apply today and let’s innovate together.

Top Skills

Databricks,Python,Sql,Spark,Pyspark,Dbt,Mlflow,Delta Lake,Terraform,Azure,Aws,Gcp,Power Bi,Scala

Similar Jobs

12 Days Ago
Remote
Georgia, USA
Senior level
Senior level
Information Technology • Software • Consulting
Develop and manage scalable backend platform for analytical models using Python and MLFlow, ensuring data validation and model traceability while collaborating with teams.
Top Skills: Azure Blob StorageDatabricks JobsDatabricks-SdkGithub ActionsMlflowNestjs ApiNumpyPandasParquetPostgresPydanticPython 3.XTerraform
Senior level
Fintech • Professional Services • Consulting • Energy • Financial Services • Cybersecurity • Generative AI
Lead the end-to-end delivery of Corporate Banking initiatives, managing stakeholder alignment, project execution, and compliance within a regulated environment using Agile methodologies.
Top Skills: ConfluenceJIRA
Senior level
Fintech • Professional Services • Consulting • Energy • Financial Services • Cybersecurity • Generative AI
Lead the transformation of sanctions monitoring processes using AI and analytics to improve efficiency and regulatory compliance.
Top Skills: AIAmlKycMachine LearningSanctions Screening

What you need to know about the San Francisco Tech Scene

San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.

Key Facts About San Francisco Tech

  • Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Google, Apple, Salesforce, Meta
  • Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
  • Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
  • Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account