Develop and maintain datasets for visualization and machine learning; automate data pipelines; partner with teams to build data products.
- Your team will develop datasets that enable data visualization, machine learning and data driven decision making across client product line
- Working with structured and unstructured datasets and automating data pipelines to ingest, analyze, validate, normalize and clean data in a hybrid multi-cloud environment
- Building data ingestion pipelines from multiple data sources using Data Bricks and Apache Spark
- Partnering with analysts, solution architects, modelers and developers to build data product and data pipelines.
- Providing technical and thought leadership
Requirements
- Strong T-SQL Skills with experience in Snowflake
- Familiarity with CI/CD methods
- Significant experience in Python development
- Highly proficient at PySpark development
- Solid grasp of database engineering and design principles
- Current Databricks Certification
- Experience in building business stakeholder relationships at all levels, leadership communications and managing project delivery from design to launch
Benefits
- Education Assistance/Student Loan Repayment - up to $2400 annually
- Remote work allowance
- Internet reimbursement
- Bench pay
- Profit share
- Healthcare reimbursement
- 401k - 4% match
- Short-Term disability
- Long-Term disability
- Life Insurance
Similar Jobs
Big Data • Cloud • Productivity • Software • Database • Analytics • Automation
The Staff Data Architect will enhance Jellyfish's data platform through architectural design, automation, advanced observability, and efficient data governance, while collaborating across teams.
Top Skills:
AirflowBigQueryDagsterDatabricksPrefectPythonSnowflakeSQLTerraform
Artificial Intelligence • Fintech • Healthtech • Software
Lead the design and execution of a new enterprise data platform, ensuring metrics reliability and supporting AI-driven products, while mentoring engineers and collaborating across teams.
Top Skills:
AirflowCdcDbtFivetranKafkaLiquibaseOpenmetadataPythonSnowflakeSQLStreaming/Event Driven Architectures
Automotive
Design and automate scalable ETL/ELT pipelines across relational, event, and unstructured sources; implement data governance, metadata and quality frameworks; architect cloud and distributed storage solutions; optimize physical data models and performance; integrate heterogeneous systems (Snowflake, Fabric, SAP, graph DBs); test, monitor, and modernize data infrastructure to support analytics.
Top Skills:
Azure Data FactoryCds ViewsCypherData LakeDelta LakeEltETLEvent HubHadoopHbaseHiveJavaKafkaKqlMap-ReduceMicrosoft FabricNeo4JNoSQLOdataOdpOnelakePower BISap S/4HanaScalaSdiSltSnowflakeSnowpipeSparkSQL
What you need to know about the San Francisco Tech Scene
San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.
Key Facts About San Francisco Tech
- Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Google, Apple, Salesforce, Meta
- Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
- Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
- Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine
