Arcadia (DC) Logo

Arcadia (DC)

Senior Data Engineer

Sorry, this job was removed at 11:16 a.m. (PST) on Monday, Apr 27, 2026
Remote
Hiring Remotely in United States
Remote
Hiring Remotely in United States

Similar Jobs

Yesterday
Easy Apply
Remote or Hybrid
United States
Easy Apply
185K-245K Annually
Senior level
185K-245K Annually
Senior level
Legal Tech • Software • Generative AI
Own Eve’s data platform end to end, including ingestion, orchestration, incremental dbt models, Snowflake administration, Terraform infrastructure, observability, access controls, and pipeline reliability. Build schema-change detection, freshness SLAs, CI environments, and incident processes while managing performance and compute costs. Partner with analytics engineers and stakeholders to maintain trusted data for reporting and AI systems, using AI-assisted development and documenting platform standards.
Top Skills: AirflowClaude CodeDbtFivetranGithub ActionsIcebergMcp ServersParquetPythonSnowflakeSQLTerraform
Yesterday
Remote or Hybrid
United States
165K-235K Annually
Senior level
165K-235K Annually
Senior level
Big Data • Cloud • Productivity • Software • Database • Analytics • Automation
Build and maintain Databricks-based data platforms, including ingestion, transformation, storage, governance, data modeling, and serving pipelines. Establish medallion architecture standards, canonical data models, quality controls, lineage, schema evolution, and reliable batch or incremental processing. Improve pipeline observability, scalability, idempotency, and recoverability while moving curated data to systems such as ClickHouse. Collaborate across application and analytics teams to create durable, governed production datasets.
Top Skills: Amazon AuroraAmazon RdsApache AirflowSparkBigQueryCdcClickhouseCloud Object StorageDatabricksDelta LakeIamOpenmetadataPostgresSnowflakeUnity Catalog
5 Days Ago
Remote or Hybrid
United States
Senior level
Senior level
AdTech • Consumer Web • Digital Media • eCommerce • Marketing Tech • SEO
Build and support scalable data platforms and pipelines, leading migrations such as Snowflake to BigQuery and transitioning reporting to Looker. Responsibilities include data architecture, ETL/ELT, API and marketing integrations, data quality, production troubleshooting, warehousing, performance optimization, and platform modernization. The role partners with analytics and business teams, owns projects through production, documents solutions, and provides technical guidance.
Top Skills: AWSAzureBigQueryConfluenceDraw.IoGCPGitJIRAKafkaLookerLucidchartMiroModeNotionPower BIPythonSnowflakeSparkSQLTableauTalend

Who we are: 

Arcadia is the global utility data and energy solutions platform. With our leading data platform, AI-powered analytics, industry expertise, and expansive partner network, we deliver solutions for every stage of the enterprise energy management lifecycle across carbon, cost, and reliability. 

Arcadia’s Enterprise Energy Management Solutions are built on a foundational data platform that has been developed for over a decade and scaled across millions of customer facilities.  We transform fragmented data and siloed processes into coordinated, enterprise-wide action with comprehensive solutions, including:

  • Utility Bill Management:  Lower utility costs and streamline bill management with automated bill payment, proactive error identification, optimized tariff structures, and budgeting & forecasting.
  • Energy Procurement Advisory: Source clean energy through a comprehensive evaluation of supply options - including traditional retail options and onsite and offsite resources — to effectively manage risks, reduce costs, and achieve corporate sustainability goals.
  • Sustainability Reporting:  Achieve compliance goals and track carbon emissions with standardized energy data and seamless integration with leading sustainability platforms.

Tackling an enterprise client’s most critical energy challenges requires out-of-the-box thinking & diverse perspectives. We’re building a team of individuals from different backgrounds, industries, & educational experiences. If you share our passion for ushering in the era of the clean, cost-effective electrons, we look forward to learning what you would uniquely bring to Arcadia!

What we’re looking for:

We are seeking a Senior Data Engineer to create clean, curated, and organized data sets used across Arcadia. The role will be hands-on and collaborative, building data assets that enable analysis and drive daily business decisions. You’ll bring an engineer’s rigor and a seasoned data modeler’s expertise to our thorniest data modeling problems, helping to lead our efforts to organize, rationalize, and produce enriched data products on our data. Your expertise will also be essential in optimizing data workflows, ensuring data integrity, and scaling our data infrastructure to support our company's growth.

Our core data stack makes heavy use of Snowflake, dbt, and Fivetran for ingestion, all orchestrated within our broader AWS-based ecosystem. You’ll work primarily with SQL in dbt to build our curated data layer–we call it the Unified Data Model–and produce analytics pipelines for our derived data products–our Solutions business. We use dbt Core, orchestrated in Argo or Prefect.


What you’ll do
  • Design, build and maintain the tooling that the wider Data team (and Arcadia as a whole) uses to interact with our data platform, including CI/CD pipelines for our data lakehouse, and unit/integration/validation testing frameworks for our data pipelines.

Optimize and tune data pipelines for improved performance, scalability, and reliability, and proactively monitor pipelines to address any issues or bottlenecks.

  • Collaborate with subject matter experts, engineers, and product managers to identify the most elegant and effective data structures to understand our constantly growing and evolving business
  • Transform, test, deploy, and document data to deliver clean and trustworthy data for analysis to end-users
  • Help bring engineering best practices (reliability, modularity, test coverage, documentation) to our DAG and to our Data team generally
  • Collaborate with data engineers to build robust, tested, scalable and observable ELT pipelines.
  • Identify and implement best practices for data ingestion, transformation, and storage to ensure data integrity and accuracy.
  • On a daily basis, this role will perform:
    • Data modeling: model raw data into clean, tested, and reusable datasets to represent our key business data concepts. Define the rules and requirements for the formats and attributes of data
    • Data transformation: build our data lakehouse by transforming raw data into meaningful, useful data elements through joining, filtering, and aggregating source data
    • Data documentation: create and maintain data documentation including data definitions and understandable data descriptions to enable broad-scale understanding of the use of data
    • Employ software engineering best practices to write code and coach analysts and data scientists to do the same
Must-haves
  • 4+ years as a Senior Data Engineer or Software Engineer building production data infrastructure. dbt experience is highly desirable
  • 6+ years, cumulatively, in the data space (data engineering, data science, analytics, or similar)
  • Expert-level understanding of conceptual data modeling and data mart design
  • Proficiency in SQL and strong Python skills, especially in the context of data orchestration.
  • Deep experience building data pipelines and database management including Snowflake or similar, along with familiarity with data integration patterns and ELT/ETL processes.
  • Experience with orchestration tools like Prefect, Airflow, or Argo.
  • Proven ability to establish and enforce AI-related engineering best practices (e.g., security, responsible code review, and prompt discipline) within data pipelines and codebase contributions, ensuring data integrity, architectural stability, and the safe use of AI-assisted tools.
  • Ability to bring a customer-oriented and empathetic approach to understanding how data is used to drive the business
  • Experience in technical leadership or mentorship
  • Strong communication and collaboration skills
  • The ability to work East Coast business hours to maximize overlap with team members in India
  • Proven ability to solve complex problems in a dynamic and evolving environment
Nice-to-haves
  • Graduate degree in math, statistics, engineering, computer science, or related technical field
  • Experience in predictive modeling and statistical analysis
  • Experience with BI platforms
  • Experience working in global, distributed teams
  • Experience in the energy sector

Benefits:

  • "Remote first" culture - work anywhere in the US as long as you have a reliable internet connection
  • Flexible PTO - no accrued hours and no limit on the number of vacation days exempt employees can take each year
  • 12 annual company-wide holidays
  • 10 days sick leave
  • Up to 4 weeks bereavement leave
  • 2 volunteer days off
  • 2 professional development days off
  • 12 weeks paid parental leave for all parents
  • 75-95% employer cost coverage for medical, dental, and vision benefits for employees and dependents

Eliminating carbon footprints, eliminating carbon copies.


Here at Arcadia, we cultivate diversity, celebrate individuality, and believe unique perspectives are key to our collective success in creating a clean energy future. Arcadia is committed to equal employment opportunities regardless of race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, disability, genetic information, protected veteran status, or any status protected by applicable federal, state, or local law. 


We will ensure that individuals with disabilities are provided reasonable accommodation to participate in the job application or interview process, to perform essential job functions, and to receive other benefits and privileges of employment. Please contact us to request accommodation by emailing [email protected] prior to completing your application.

Target Annual Compensation Range for this role will be $131,250 to $235,000. There will also be a competitive benefits component to the package. The exact compensation at which this job is filled will be determined by the skills, experience, and location of the qualified candidate. Please note that we are unable to offer visa sponsorship for this position at this time.

Automated Screening Technology: To ensure a fair and timely review of the high volume of applications we receive, Arcadia may utilize AI-assisted technologies to help our team identify candidates who best meet the qualification criteria for this role (based on skills, experience, and education).

Please Note: Automated tools provide recommendations based on your resume content and application questions. While we may use automated screening for basic eligibility (e.g., visa status, location), employment decisions regarding qualifications are not made solely by AI without human oversight.

Data Privacy & California Residents: You voluntarily provide personal information (such as your resume, contact details, and assessment responses) when submitting an application. We may use this to evaluate your candidacy and derive inferences from this data to match your profile with open roles. For California Residents: This collection is consistent with the CCPA. You have the right to request access to or deletion of your data by contacting [email protected]

Thank you

What you need to know about the San Francisco Tech Scene

San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.

Key Facts About San Francisco Tech

  • Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Google, Apple, Salesforce, Meta
  • Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
  • Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
  • Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account