As a Senior Data Engineer, you'll build ETL pipelines, design data ingestion systems, and maintain a multi-cloud ecosystem while collaborating with Data Scientists to transform data into business insights.
About Chartmetric
Chartmetric, Inc. is a 10-year-old startup specializing in music data analytics. We are trusted by Universal MusicGroup, Sony, Warner, and Apple Music, as well as hundreds of other music companies and industry professionals. Our team has created a self-service data dashboard for the music industry to better understand the activity happening around artists. Together, we combine hundreds of thousands of real-time data points across iTunes, Spotify, YouTube, Google, Amazon, X, and others through our beautifully designed tool in order to make sense of the increasingly complex landscape of the music industry.
What you'll do
- Build and optimize ETL pipelines processing data for 10M+ artists, 100M+ tracks, 15M+ playlists, and comprehensive music industry metrics
- Design scalable data ingestion systems to integrate emerging streaming platforms and social media services into our analytics infrastructure
- Architect and maintain our multi-cloud data ecosystem spanning AWS RDS, Elasticsearch, Clickhouse, and Snowflake
- Develop production-ready Python applications and complex PostgreSQL queries deployed across distributed systems
- Collaborate with Data Scientists to transform raw music data into actionable insights that drive strategic decisions for artists, labels, and industry professionals
- This position is hybrid and will be in office 3/4 times a week in our San Mateo or New York office
Who You Are
- 6+ years of hands-on experience building production data systems, preferably in high-volume consumer or entertainment industries
- Expert-level proficiency in Python, PostgreSQL, Apache Airflow, Clickhouse, Snowflake, Elasticsearch, Apache Spark, and AWS ecosystem
- Proven track record of designing fault-tolerant, high-throughput data pipelines handling millions of records daily
- Strong communication skills with ability to translate complex technical concepts to cross-functional stakeholders
- Bachelor’s degree in Computer Science, Data Engineering, or equivalent practical experience
- Thrives in dynamic startup environments with rapidly evolving requirements and tight delivery timelines
- Bonus: Experience with sports, tv, film, music industry data, streaming APIs, or social media analytics platforms
What We Offer
- Competitive salary and equity package
- Comprehensive health, dental, and vision insurance
- Opportunity to shape developer experience across the organization
- Access to cutting-edge tools and technologies
Team Culture
- We believe that great developer experiences lead to better products and happier teams. Our DevOps/DX team operates as enablers and force multipliers, working collaboratively to remove friction from the development process. We value automation, measurement, and continuous improvement, always asking "how can we make this better for our developers?"
Chartmetric Sunnyvale, California, USA Office
Sunnyvale, CA, United States
Chartmetric San Mateo, California, USA Office
400 Concar Dr, San Mateo, CA , United States, 94402
Similar Jobs
Consumer Web • Healthtech • Professional Services • Social Impact • Software
Designs and maintains scalable data pipelines and infrastructure, establishes data governance and quality standards, and drives technical decisions across Headway’s data platform. Partners with Product, Engineering, Analytics, Data Science, Finance, and Infrastructure to evolve data architecture, optimize performance, implement infrastructure-as-code, and ensure reliable, traceable data for AI-powered tools.
Top Skills:
AirflowDbtFivetranJupyter NotebooksMetabasePythonSnowflakeSQLTerraform
Legal Tech • Software • Generative AI
Own Eve’s data platform end to end, including ingestion, orchestration, incremental dbt models, Snowflake administration, Terraform infrastructure, observability, access controls, and pipeline reliability. Build schema-change detection, freshness SLAs, CI environments, and incident processes while managing performance and compute costs. Partner with analytics engineers and stakeholders to maintain trusted data for reporting and AI systems, using AI-assisted development and documenting platform standards.
Top Skills:
AirflowClaude CodeDbtFivetranGithub ActionsIcebergMcp ServersParquetPythonSnowflakeSQLTerraform
Big Data • Cloud • Productivity • Software • Database • Analytics • Automation
Build and maintain Databricks-based data platforms, including ingestion, transformation, storage, governance, data modeling, and serving pipelines. Establish medallion architecture standards, canonical data models, quality controls, lineage, schema evolution, and reliable batch or incremental processing. Improve pipeline observability, scalability, idempotency, and recoverability while moving curated data to systems such as ClickHouse. Collaborate across application and analytics teams to create durable, governed production datasets.
Top Skills:
Amazon AuroraAmazon RdsApache AirflowSparkBigQueryCdcClickhouseCloud Object StorageDatabricksDelta LakeIamOpenmetadataPostgresSnowflakeUnity Catalog
What you need to know about the San Francisco Tech Scene
San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.
Key Facts About San Francisco Tech
- Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Google, Apple, Salesforce, Meta
- Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
- Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
- Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine
