Design, build, and maintain scalable ETL/ELT data pipelines on Databricks and AWS S3; manage large geospatial and temporal datasets; productionize ML models; implement data validation, testing, and monitoring; optimize storage and processing; document workflows; collaborate cross-functionally.
About Urban SDK
Urban SDK is shaping the Future of Smart Cities. We are pioneers in geospatial AI technology, providing public leaders with insights and automation for mission-critical decisions. We equip critical public services with geospatial AI, enabling precise, data-driven decisions with efficiency and confidence.
Our Commitment to PeopleWe are committed to aligning business growth with professional outcomes for every employee. Our commitment has been recognized by Jacksonville Business Journal and Will Reed as a noted Best Places to Work.
About the role
We are looking for a skilled Data Engineer to design, build, and maintain scalable data pipelines and platforms that support our geospatial traffic analytics applications. The ideal candidate will have experience with Python, Databricks, S3, and modern data engineering practices, including automated testing, CI/CD, and data quality monitoring.
Responsibilities
- Design, implement, and maintain scalable data pipelines and ETL/ELT workflows on Databricks and cloud platforms.
- Manage large-scale geospatial and temporal datasets stored in AWS S3.
- Collaborate with data scientists to productionize machine learning models and ensure smooth data availability.
- Implement data validation, testing, and monitoring frameworks to ensure data accuracy, consistency, and reliability.
- Optimize data storage and processing strategies to handle high volumes of traffic and mobility data efficiently.
- Develop and maintain documentation for data workflows, architecture, and processes.
- Work closely with cross-functional teams to understand data requirements and ensure timely delivery.
- Stay up-to-date with the latest trends and best practices in data engineering, cloud technologies, and big data processing.
Qualifications
- Bachelor's or Master's degree in Computer Science, Data Engineering, or a related field.
- 3+ years of experience as a data engineer or in a similar role.
- Strong proficiency in Python and associated libraries for data engineering (pandas, PySpark, etc.).
- Hands-on experience with Databricks and Spark for large-scale data processing.
- Experience with AWS services, especially S3, and knowledge of cloud-based data architectures.
- Solid understanding of data pipeline testing, version control, and CI/CD practices.
- Experience with SQL and NoSQL databases.
- Strong problem-solving skills and attention to detail.
Preferred Skills
- Familiarity with geospatial data formats and processing (GeoJSON, Shapefiles, PostGIS).
- Experience with workflow orchestration tools (Databricks, Prefect, or similar).
- Knowledge of containerization (Docker/Kubernetes) and cloud-native data solutions.
- Experience supporting machine learning pipelines in production.
Compensation
- Location: Jacksonville, FL (Town Center Area) or Remote
- Type: Full-time
- Reports to: Director of Engineering
- Salary Based on Experience
- Annual Bonus
- Medical, Vision, Dental, 401(k)
- 21 Days Vacation
- Office Lunch provided Daily
Similar Jobs
Digital Media • Information Technology • News + Entertainment
Design, build, and maintain large-scale data pipelines and lake architectures on AWS using Spark/Databricks. Ensure data quality, lineage, observability, and TDD-based testing. Support self-service analytics, semantic layers, and cross-functional stakeholders while providing production support and documentation.
Top Skills:
Apache IcebergSparkAWSDatabricksDatabricks Delta Live Tables (Dlt)Delta LakeKubernetesLookerPysparkPythonSnowflakeSQLTabTeradata
Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
Architect, deploy, and operate core data platform services (Airflow, Superset, Terraform). Build CI/CD pipelines, automate with Python, manage cloud infrastructure, implement security and compliance, develop dbt data models, catalog assets in OpenMetadata, and mentor junior engineers.
Top Skills:
Apache AirflowApache SupersetAWSAzureCi/CdDbtDockerGCPIamKubernetesOciOpenmetadataPythonSQLTerraform
Artificial Intelligence • Healthtech • Machine Learning • Natural Language Processing • Biotech • Pharmaceutical
Design, build, and maintain scalable data architecture and pipelines to support medical analytics and predictive models. Partner with product and data leads, prepare datasets, automate data delivery, mentor colleagues on standards, and evaluate tools to improve analytics productivity and stability.
Top Skills:
Adobe AnalyticsAdobe LaunchApache AirflowBrighttagCharles ProxyCSSData WarehousingDatabricksDataiku (Dss Data Science Studio)DrupalDynamic Tag ManagerEnsightenGoogle AnalyticsGoogle Tag ManagerHTMLInfrastructure As CodeJavaScriptJqueryKafkaMatomo/PiwikOmniture SitecatalystPiwik ProSignalTealium Iq
What you need to know about the San Francisco Tech Scene
San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.
Key Facts About San Francisco Tech
- Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Google, Apple, Salesforce, Meta
- Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
- Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
- Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine
