Vagaro Logo

Vagaro

Data Engineer

Reposted 22 Hours Ago
In-Office
Pleasanton, CA, USA
135K-150K Annually
Mid level
In-Office
Pleasanton, CA, USA
135K-150K Annually
Mid level
Designs and maintains scalable enterprise data architectures and ETL/ELT pipelines on Microsoft Fabric and Azure. Responsibilities include developing Python-based data solutions, optimizing Fabric warehouses and lakehouses, implementing governance, security, lineage, monitoring, and CI/CD, and integrating diverse data sources. The role partners with data science, machine learning, business intelligence, engineering, and business teams to support analytics and model training while improving platform reliability, scalability, and cost efficiency.
The summary above was generated by AI

Why Vagaro? At Vagaro, we believe in fostering a collaborative and inclusive work environment where every team member can thrive. Our culture is built on innovation, continuous learning, and a passion for making a positive impact. We support our employees' growth and vision for themselves, offering opportunities for professional development and career advancement. Join us and be part of a team that values creativity, teamwork, and a commitment to excellence. Plus, we know how to have fun while getting the job done!

What you'll Be Doing: Vagaro is seeking a skilled Data Engineer to join our dynamic team and partner with our Data Science, Machine Learning, and Business Intelligence teams to build enterprise-grade data solutions. As a Data Engineer at Vagaro, you will play a critical role in designing and maintaining scalable data architectures on the Microsoft Fabric platform. You will lead the design and optimization of ETL/ELT pipelines, establish data governance standards, and ensure seamless data integration across multiple platforms and data sources. Your expertise will directly enable our teams to deliver reliable, high-performance data infrastructure that supports real-time analytics, machine learning model training, and business intelligence initiatives.

*This role is based onsite in Pleasanton, CA Monday through Friday*

Compensation

  • Base Annual Salary: $135,000 to $150,000
  • Annual Bonus: Up to 10%

Your Impact: 
Data Pipeline Development

  • Design, build, and maintain scalable ETL/ELT pipelines to ingest, transform, and store data from a variety of internal and external data sources.
  • Optimize data pipelines for performance, scalability, reliability, and cost efficiency.
  • Monitor, troubleshoot, and resolve data pipeline failures and performance issues.
  • Develop reusable Python libraries and frameworks to standardize data engineering solutions.
  • Build and maintain CI/CD pipelines to automate deployment, testing, and release processes.
  • Experience integrating with REST APIs to ingest, transform, and process data from external systems.

Microsoft Fabric Platform

  • Design, implement, and maintain enterprise data solutions using the Microsoft Fabric platform.
  • Build and optimize Fabric Warehouses, Lakehouses, Semantic Models, and Data Pipelines.
  • Define enterprise Fabric architecture, workspace strategy, security model, and governance standards.
  • Manage Fabric capacities, optimize compute utilization, and monitor platform health and performance.
  • Lead capacity planning, workload isolation, reservation management, and cost optimization across Business Intelligence, Data Engineering, and Machine Learning workloads.
  • Implement monitoring, alerting, logging, and operational best practices for Fabric environments.

Data Architecture & Management

  • Design and maintain scalable data models and enterprise data architectures.
  • Implement data governance, security, lineage, and metadata management best practices.
  • Ensure data quality, integrity, availability, and compliance across all data platforms.
  • Maintain comprehensive documentation for data pipelines, architectures, standards, and operational procedures.

Collaboration

  • Partner with Data Scientists and Machine Learning engineers to provide reliable data infrastructure for model training and deployment.
  • Collaborate with Business Intelligence teams to ensure timely and reliable data availability for reporting, dashboards, and analytics.
  • Work closely with business stakeholders, analysts, and software engineers to understand requirements and deliver scalable data solutions.

Continuous Improvement

  • Evaluate emerging technologies and recommend improvements to the data platform.
  • Continuously improve data engineering processes, automation, and operational efficiency.
  • Participate in architecture reviews, code reviews, and mentoring to promote engineering best practices.

What you Bring: 
Education

  • Bachelor's or Master's degree in Computer Science, Information Systems, Engineering, or a related technical field.

Experience

  • 3-5 years of experience as a Data Engineer or similar role.
  • Experience designing and maintaining enterprise-scale ETL/ELT solutions.
  • Hands-on experience with Microsoft Fabric, including data migration projects.
  • Strong experience with relational and NoSQL databases.
  • Experience building modern cloud-based data platforms in Azure (AWS or GCP experience is also beneficial).
  • Experience with DevOps practices, CI/CD pipelines, and Infrastructure as Code.

Technical Skills

  • Expert-level SQL.
  • Strong Python development skills.
  • Experience with:
    • PySpark
    • Pandas
    • Spark
  • Strong understanding of data modeling, dimensional modeling, and schema design.
  • Experience working with:
    • SQL Server
    • NoSQL (MongoDB, Elasticsearch, etc.)
    • Azure Data Lake Storage
    • Delta Lake
    • Parquet
  • Familiarity with REST APIs and data integration patterns.
  • Experience working with large-scale structured and semi-structured datasets.

Soft Skills

  • Excellent analytical and problem-solving abilities.
  • Strong communication and collaboration skills.
  • Ability to work independently while collaborating across multiple teams.
  • Strong attention to detail and commitment to data quality.

Preferred Qualifications

  • Experience with Azure DevOps or GitHub Actions.
  • Experience with Docker and Kubernetes.
  • Experience implementing monitoring, observability, and alerting for enterprise data platforms.

 Why You’ll Love Working Here: 💖

  • Attractive Compensation & Performance Bonuses: Enjoy a competitive salary paired with performance-based bonuses
  • Generous PTO: 15 accrued days, plus 10 company holidays annually.
  • Health & Wellness: Comprehensive healthcare, dental, and vision plans for you and your family. 🏥
  • Exclusive Perks: Discounts on attractions, theme parks, shows, sports events, movies, hotels, and more through TicketsAtWork. 🎟️
  • Beauty Perks: $30/month reimbursement for any Vagaro service, including health, beauty, or wellness treatments. 💅
  • Food Perks: $50 monthly stipend for our onsite microkitchen and a complimentary DoorDash DashPass subscription. 🍽️
  • Growth Opportunities: College Assistance Reimbursement, access to EAP & Work/Life Programs, and a LinkedIn Learning account. 📚
  • Financial Security: 401k program with 4% matching and optional life/supplemental insurance. 💰
  • Stay Active: Access to our on-site gym, flavored water dispenser, and basketball court to keep you fit and energized! 🏀

Equal Opportunity Employer:
Vagaro is proud to be an Equal Employment Opportunity and affirmative action employer. We foster an inclusive environment where individuals are evaluated without discrimination based on gender, race, ethnicity, age, disability, religion, sexual orientation, gender identity, veteran status, or any other characteristics protected by law.

Privacy Policy:
Your privacy matters! At Vagaro, we are committed to protecting your personal information. Before proceeding with your application, please review our Employee and Applicant Privacy Notice here. By submitting your application, you acknowledge that you have read and understood our Privacy Notice, which outlines how we collect, use, disclose, and protect your information during the recruitment and employment process.

Vagaro is an E-Verify employer. Learn more at www.e-verify.gov

Learn More About Vagaro:
Visit us at vagaro.com/pro and vagaro.com to learn more.]

HQ

Vagaro Pleasanton, California, USA Office

4430 Rosewood Dr, 5th floor, Pleasanton, CA, United States, 94588

Similar Jobs

2 Hours Ago
Hybrid
San Francisco, CA, USA
157K-245K Annually
Mid level
157K-245K Annually
Mid level
Artificial Intelligence • Information Technology • Machine Learning • Natural Language Processing • Productivity • Software • Generative AI
Build and own scalable finance and revenue data pipelines, models, and datasets supporting ARR, NRR, bookings, billing, and revenue attribution. Ensure data quality, reliability, monitoring, reconciliation, and self-service access while partnering with Finance, Revenue Operations, Analytics, Product, and Engineering.
Top Skills: Apache AirflowSparkCi/CdClaude CodeCodexDatabricksDatabricks WorkflowsDbtDelta LakeGitSnowflakeSQL
3 Hours Ago
Remote or Hybrid
USA
140K-215K Annually
Senior level
140K-215K Annually
Senior level
Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
Architects, deploys, and operates scalable data platform infrastructure supporting analytics. Responsibilities include administering Airflow and Superset, managing Terraform infrastructure, building CI/CD pipelines, enforcing security and compliance, developing DBT data models, cataloging assets in OpenMetadata, writing Python automation, and mentoring engineers. The role requires extensive infrastructure and data engineering experience across cloud platforms, containers, data security, and workflow orchestration.
Top Skills: Apache AirflowApache SupersetAWSAzureCi/CdData ModelingDbtDockerGCPIamKubernetesMachine Learning PipelinesOciOpenmetadataPythonSQLTerraform
Yesterday
Hybrid
San Francisco, CA, USA
209K-286K Annually
Senior level
209K-286K Annually
Senior level
Fintech • Machine Learning • Payments • Software • Financial Services
Design, build, and lead scalable cloud data platforms, pipelines, and applications. The role architects data engineering patterns, evaluates platforms such as Snowflake and Databricks, delivers distributed and streaming workloads, and ensures operational resilience. Responsibilities include collaborating with product and engineering teams, influencing technical decisions, mentoring engineers, communicating data concepts, and leading large-scale initiatives independently.
Top Skills: AgileAirflowAWSCassandraDagsterDatabricksDynamoDBEmrGlueGCPJavaAzureMongoDBMonte CarloNosql DatabasesPythonRedshiftRelational DatabasesScalaSnowflakeSparkSplunkSQL

What you need to know about the San Francisco Tech Scene

San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.

Key Facts About San Francisco Tech

  • Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Google, Apple, Salesforce, Meta
  • Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
  • Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
  • Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account