As a Senior Data Engineer, you'll build and optimize ETL pipelines, design scalable data systems, and collaborate with Data Scientists on data transformation.
About Chartmetric
Chartmetric, Inc. is a 10-year-old startup specializing in music data analytics. We are trusted by Universal MusicGroup, Sony, Warner, and Apple Music, as well as hundreds of other music companies and industry professionals. Our team has created a self-service data dashboard for the music industry to better understand the activity happening around artists. Together, we combine hundreds of thousands of real-time data points across iTunes, Spotify, YouTube, Google, Amazon, X, and others through our beautifully designed tool in order to make sense of the increasingly complex landscape of the music industry.
What you'll do
- Build and optimize ETL pipelines processing data for 10M+ artists, 100M+ tracks, 15M+ playlists, and comprehensive music industry metrics
- Design scalable data ingestion systems to integrate emerging streaming platforms and social media services into our analytics infrastructure
- Architect and maintain our multi-cloud data ecosystem spanning AWS RDS, Elasticsearch, and Snowflake
- Develop production-ready Python applications and complex PostgreSQL queries deployed across distributed systems
- Collaborate with Data Scientists to transform raw music data into actionable insights that drive strategic decisions for artists, labels, and industry professionals
- This position is hybrid and will be in office 3/4 times a week in our San Mateo or New York office
Who You Are
- 6+ years of hands-on experience building production data systems, preferably in high-volume consumer or entertainment industries
- Expert-level proficiency in Python, PostgreSQL, Apache Airflow, Snowflake, Elasticsearch, Apache Spark, and AWS ecosystem
- Proven track record of designing fault-tolerant, high-throughput data pipelines handling millions of records daily
- Strong communication skills with ability to translate complex technical concepts to cross-functional stakeholders
- Bachelor’s degree in Computer Science, Data Engineering, or equivalent practical experience
- Thrives in dynamic startup environments with rapidly evolving requirements and tight delivery timelines
- Bonus: Experience with music industry data, streaming APIs, or social media analytics platforms
What We Offer
- Competitive salary and equity package
- Comprehensive health, dental, and vision insurance
- Opportunity to shape developer experience across the organization
- Access to cutting-edge tools and technologies
Team Culture
- We believe that great developer experiences lead to better products and happier teams. Our DevOps/DX team operates as enablers and force multipliers, working collaboratively to remove friction from the development process. We value automation, measurement, and continuous improvement, always asking "how can we make this better for our developers?"
Top Skills
Apache Airflow
Spark
AWS
Elasticsearch
Postgres
Python
Snowflake
Chartmetric San Mateo, California, USA Office
400 Concar Dr, San Mateo, CA , United States, 94402
Similar Jobs
Automotive • Cloud • Greentech • Information Technology • Other • Software • Cybersecurity
Seeking a Senior Data Engineer to design and optimize data pipelines, ensuring data quality and supporting advanced analytics. Responsibilities include building data architectures, developing automated testing, and collaborating with stakeholders.
Top Skills:
Apache AirflowAWSAzureAzure SynapseDbtHadoopJavaKafkaKinesisPytestPythonPyTorchRedshiftScalaScikit-LearnSeleniumSnowflakeSparkSQLTensorFlow
Automotive • Cloud • Greentech • Information Technology • Other • Software • Cybersecurity
Seeking a Senior Data Engineer to design and optimize data architecture and pipelines, ensuring data quality and enabling advanced analytics through AI and machine learning techniques.
Top Skills:
Apache AirflowAWSAws RedshiftAzureAzure SynapseDbtHadoopJavaKafkaKinesisPytestPythonPyTorchScalaScikit-LearnSeleniumSnowflakeSparkSQLTensorFlow
Agency • Information Technology • Internet of Things • Design • App development
The Senior Data Engineer will design and maintain data pipelines, ensuring scalability and reliability while integrating diverse data sources and optimizing workflows.
Top Skills:
AirflowAndroidAospClaudeDagsterElixir PhoenixFlutterGoogle Cloud PlatformGoogle GeminiJavaKotlinNode ExpressOpenaiPrefectPysparkPythonPython DjangoReact NativeRuby On Rails
What you need to know about the San Francisco Tech Scene
San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.
Key Facts About San Francisco Tech
- Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Google, Apple, Salesforce, Meta
- Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
- Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
- Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine
