Staff Data Engineer

Crusoe is building the World’s Favorite AI-first Cloud infrastructure company. We’re pioneering vertically integrated,  purpose-built AI infrastructure solutions trusted by Fortune 500 companies to power their most advanced AI applications. Crusoe is redefining AI cloud infrastructure, with a mission to align the future of computing with the future of the climate. Our AI platform is recognized as the "gold standard" for reliability and performance. Our data centers are optimized for AI workloads and are powered by clean, renewable energy.

Be part of the AI revolution with sustainable technology at Crusoe. Here, you'll drive meaningful innovation, make a tangible impact, and join a team that’s setting the pace for responsible, transformative cloud infrastructure.

About the Role

As a Staff Data Engineer at Crusoe.ai, you will lead the development and management of our data analytics infrastructure, data lake, and data warehouse. You will be responsible for making crucial decisions regarding database technologies, data pipeline architecture, and ensuring the availability and accuracy of data for analytics purposes.

What You’ll Be Working On

• Serve as an expert consultant within the engineering organization, advising on the design of optimal database schemas to support organizational growth and scalability.

• Collaborate extensively with the finance and accounting departments to enhance business strategies and decisions through data enrichment and analysis.

• Provide assistance across the organization in extracting vital information from various data stores, employing complex SQL queries and data extraction techniques.

• Play a key role in defining and structuring the organization's data pipelines, ensuring efficient data flow and accessibility.

• Take charge of integrating new data sources, constantly expanding the data warehouse's capabilities to support the development of intricate and insightful reports.

• Foster a culture of data-driven decision-making, working cross-functionally to empower teams with actionable insights derived from robust data analysis.

• Define the next generation of our data analysis. From data center to software, develop and empower an understanding of our systems, shortcomings and areas to capture more revenue.

Key Responsibilities

• Database architecture: Evaluate, select, and implement the most suitable database technologies for our data storage, processing, and analytics needs, including but not limited to Postgres, InfluxDB, VictoriaMetrics, Prometheus, and BigQuery.

• Data pipeline development: Lead the design and development of efficient and robust data pipelines using tools such as dbt and Apache Airflow. Ensure data flows smoothly from source systems to the data lake and data warehouse.

• Data lake and data warehouse: Oversee the development and maintenance of our data lake and data warehouse, ensuring scalability, security, and performance. Implement best practices for data modeling.

• Metrics definition: Collaborate with business stakeholders to define and document key business metrics and KPIs that will drive decision-making across the organization. Build and maintain complex dashboards within Grafana (or similar software) to measure and report on performance.

• Data quality assurance: Implement data quality checks and reconciliation/validation processes to ensure the accuracy and reliability of data stored in the data lake and data warehouse.

• Performance optimization: Continuously monitor and optimize the performance of data pipelines and databases to meet business requirements and maintain high availability.

• Team collaboration: Work closely with cross-functional teams, including data analysts, data scientists, and software engineers, to understand their data requirements and ensure data is readily accessible

• Documentation: Maintain comprehensive documentation of data architecture, data pipelines, and best practices to ensure knowledge sharing within the organization.

What You’ll Bring to the Team

• 5-8+ years relevant work experience in data engineering, data warehouse development, or a similar role.

• Familiarity with a variety of database technologies and expert level proficiency in one or more of: Postgres, VictoriaMetrics, InfluxDB, Prometheus, BigQuery.

• Proficiency in common data analytics and visualization tools such as Grafana or Looker.

• Proficiency in data pipeline orchestration tools such as dbt or Apache Airflow.

• Strong understanding of ELT/ETL processes and data integration techniques.

• Strong understanding of data infrastructure design, including the performance and financial trade-offs of various designs.

• Excellent communication skills and ability to work independently and lead a small team.

• Embody the Company values.

Benefits

• Hybrid work schedule

• Industry competitive pay

• Restricted Stock Units in a fast growing, well-funded technology company

• Health insurance package options that include HDHP and PPO, vision, and dental for you and your dependents

• Paid Parental Leave

• Paid life insurance, short-term and long-term disability

• Teladoc

• Pet-friendly offices

• 401(k) with a 100% match up to 4% of salary

• Generous paid time off and holiday schedule

• Cell phone reimbursement

• Tuition reimbursement

• Subscription to the Calm app

• Company paid commuter benefit; $100 per month

Compensation Range

•  Salary range is between $250,000 - $290,000. Restricted Stock Units are included in all offers. Salary to be determined by the applicant’s education, experience, knowledge, skills, and abilities, as well as internal equity and alignment with market data.

Crusoe is an Equal Opportunity Employer. Employment decisions are made without regard to race, color, religion, disability, genetic information, pregnancy, citizenship, marital status, sex/gender, sexual preference/ orientation, gender identity, age, veteran status, national origin, or any other status protected by law or regulation.