Horizon3.ai Logo

Horizon3.ai

Senior Data Engineer

Posted 22 Days Ago
Remote
Hiring Remotely in US
202K-238K Annually
Senior level
Remote
Hiring Remotely in US
202K-238K Annually
Senior level
Design, build, and own business-critical data infrastructure, including AWS Glue and Spark pipelines, cloud warehouse or lakehouse systems, orchestration, and Tableau BI platforms. Define event-driven contracts, data models, schemas, observability, and batch or streaming architectures across multi-tenant, multi-region environments. Collaborate across producer and consumer teams while owning production data infrastructure and outcomes end to end.
The summary above was generated by AI

Get to Know Us

Horizon3 is a fast-growing, remote cybersecurity company dedicated to the mission of enabling organizations to proactively find and fix and verify exploitable attack vectors before criminals exploit them. Our flagship product, the NodeZeroTM platform, delivers production-safe autonomous pentests and other key assessment operations that scale across the largest internal, external, cloud, and hybrid cloud environments. NodeZero has been adopted by organizations of all sizes, from small educational institutions to government agencies and Global 100 enterprises. It is used by ITOps/SecOps teams, consulting pentesters, and MSSPs and MSPs. 

We are a fusion of former U.S. Special Operations cyber operators, startup engineers, and formerly frustrated cybersecurity practitioners. We're committed to helping solve our common security problems: ineffective security tools, false positives resulting in alert fatigue, blind spots, "checkbox” security culture, cybersecurity skills shortage, and the long lead time and expense of hiring outside consultants. Collectively, we are a team of learn it alls, committed to a culture of respect, collaboration, ownership, and results.

We are seeking a Senior Data Engineer to design, build, and own the data platform underneath our business-critical pipelines. Today the team supports account provisioning, product analytics, and the pipelines feeding our warehouse and Tableau reporting. You will help expand this into a globally deployed data platform spanning the warehouse, orchestration, and BI across multiple regions

You will:

  • Design, build, and maintain business-critical data pipelines, including data ingestion and AWS Glue/Spark jobs feeding the warehouse and Tableau.

  • Build and operate core data infrastructure: the data warehouse, orchestration, and BI/reporting platform, deployed across multiple regions.

  • Help evaluate and shape our warehouse strategy, including lakehouse platforms such as Databricks.

  • Define and evolve batch or event-driven contracts between producer and consumer teams, reasoning through batch vs. streaming, CDC, reprocessing, and multi-tenant/multi-region trade-offs.

  • Design and evolve warehouse schemas and data models.

  • Build observability into pipelines and platform components.

  • Drive work across producer and consumer teams, communicate clearly, and own outcomes end to end.

What You’ll Bring

  • Strong software engineering craft: clean, correct, maintainable code with solid data-structure and problem-solving fundamentals.

  • Deep understanding of distributed systems and data architecture: pipeline and platform design, batch vs. streaming, CDC, event contracts, multi-tenant and multi-region trade-offs, reprocessing, and observability.

  • Fluent SQL and strong data-modeling skills, including designing schemas for a warehouse your team owns.

  • Experience owning production data infrastructure end to end.

  • Strong collaboration and ownership across dependent teams.

  • 7+ years of professional experience in data engineering, infrastructure engineering, or backend software engineering.

  • Bachelor’s degree in Computer Science or a related field, or equivalent practical experience.

Required Tech Stack Experience

  • Experience with cloud-based data platforms and distributed data processing (e.g., AWS Glue, Databricks, Snowflake, or Spark-based pipelines)

  • Tableau or a comparable BI platform.

  • SQL and Python.

  • Workflow orchestration tooling such as Apache Airflow, Dagster or similar

 

Perks of Horizon3

  • Inclusive Team: We value diversity and promote an inclusive culture where everyone can thrive.

  • Growth Opportunities: Be part of a dynamic and growing team with numerous career development opportunities.

  • Innovative Culture: Work in a collaborative environment that encourages creativity and out-of-the-box thinking.

  • Hybrid & Remote Work: We embrace a mix of remote and hybrid work models depending on role and location, including our Chicago office, where some roles require regular in-office presence.

  • Competitive Compensation: We offer competitive salary, equity and benefits. Our benefits include health, vision & dental insurance for you and your family, a flexible vacation policy, and generous parental leave.

Compensation and Values

At Horizon3, we believe that our people are our greatest asset, and our compensation philosophy reflects this core value. We are committed to fostering an environment where all employees feel valued, respected, and rewarded for their contributions. Our compensation structure is designed to be fair, competitive, and transparent, ensuring that every team member is recognized and compensated equitably across roles, levels, and locations.

In accordance with various State’s transparency regulations, we provide the following salary range information for this position:

  • Base salary range: $202,190 - $237,870 annually. The exact salary will be determined based on the selected candidate’s location, qualifications, experience, and relevant skills.

  • Additional compensation: All full-time roles are eligible for an equity package in the form of stock options.

You Belong Here

Horizon3 is not just an equal opportunity employer - we are a community that values diversity, equity, and inclusion as fundamental principles of our culture and success. We are dedicated to fostering a workplace where everyone feels welcome and respected, regardless of race, color, religion, sex, national origin, age, disability, veteran status, sexual orientation, gender identity or expression, genetic information, marital status, or any other legally protected status by law.

Our commitment to diversity and inclusion means we strive to attract, develop, and retain a workforce that reflects the varied communities we serve. We believe that diverse perspectives drive innovation and strengthen our ability to create cutting-edge cybersecurity solutions. At Horizon3, every team member is valued and supported in an environment that encourages personal and professional growth.

We welcome candidates from all backgrounds and experiences, and we encourage all qualified individuals to apply. Come be a part of Horizon3, where your unique contributions are recognized, and your potential is limitless.

Other Duties

Please note this job description is not designed to cover or contain a comprehensive listing of activities, duties or responsibilities that are required of the employee. Duties, responsibilities, and activities may change at any time with or without notice. 

HQ

Horizon3.ai San Francisco, California, USA Office

San Francisco, CA, United States, 94118

Similar Jobs

4 Days Ago
Remote or Hybrid
United States
165K-235K Annually
Senior level
165K-235K Annually
Senior level
Big Data • Cloud • Productivity • Software • Database • Analytics • Automation
Build and maintain Databricks-based data platforms, including ingestion, transformation, storage, governance, data modeling, and serving pipelines. Establish medallion architecture standards, canonical data models, quality controls, lineage, schema evolution, and reliable batch or incremental processing. Improve pipeline observability, scalability, idempotency, and recoverability while moving curated data to systems such as ClickHouse. Collaborate across application and analytics teams to create durable, governed production datasets.
Top Skills: Amazon AuroraAmazon RdsApache AirflowSparkBigQueryCdcClickhouseCloud Object StorageDatabricksDelta LakeIamOpenmetadataPostgresSnowflakeUnity Catalog
8 Days Ago
Remote or Hybrid
United States
Senior level
Senior level
AdTech • Consumer Web • Digital Media • eCommerce • Marketing Tech • SEO
Build and support scalable data platforms and pipelines, leading migrations such as Snowflake to BigQuery and transitioning reporting to Looker. Responsibilities include data architecture, ETL/ELT, API and marketing integrations, data quality, production troubleshooting, warehousing, performance optimization, and platform modernization. The role partners with analytics and business teams, owns projects through production, documents solutions, and provides technical guidance.
Top Skills: AWSAzureBigQueryConfluenceDraw.IoGCPGitJIRAKafkaLookerLucidchartMiroModeNotionPower BIPythonSnowflakeSparkSQLTableauTalend
10 Days Ago
Remote or Hybrid
16 Locations
110K-200K Annually
Senior level
110K-200K Annually
Senior level
Information Technology • Productivity • Software • Infrastructure as a Service (IaaS)
Design and scale lakehouse architecture, streaming and batch pipelines, and reliable data platforms using Kafka, Spark, Airflow, Iceberg, Databricks, and related technologies. Build Medallion-layer data systems, manage open table formats, optimize distributed queries, monitor platform reliability, resolve data quality issues, and collaborate with analysts, data scientists, and product teams.
Top Skills: Apache AirflowApache HudiApache IcebergApache KafkaSparkDatabricksDelta LakePythonSQLStarburstTrino

What you need to know about the San Francisco Tech Scene

San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.

Key Facts About San Francisco Tech

  • Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Google, Apple, Salesforce, Meta
  • Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
  • Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
  • Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account