Neon Redwood Logo

Neon Redwood

Sr. Data Engineer

Reposted 21 Days Ago
In-Office
San Francisco, CA, USA
Senior level
In-Office
San Francisco, CA, USA
Senior level
Design, develop, and maintain large-scale data pipelines and ETL processes. Implement and optimize data storage and processing on BigQuery/GCP, ensure data quality and monitoring, participate in code reviews, mentor junior engineers, and help launch data-driven tools.
The summary above was generated by AI
About Neon Redwood

Neon Redwood is a data services consulting company, working on cutting-edge AI and data-driven solutions. We are a team of passionate engineers and data experts, and we are currently looking for a Senior Data Engineer to join our team and help us develop and expand our data infrastructure and analytics capabilities.


The Role

We are seeking an experienced Senior Data Engineer with a strong background in data engineering and a passion for working with large-scale data sets. Help us develop and expand our data infrastructure and analytics capabilities.
The ideal candidate will have at least 5 years of professional experience and a solid understanding of Python, BigQuery, and Google Cloud Platform (GCP) or similar technologies. This full-time role will involve working closely with our CTO and other team members to design, develop, and maintain data pipelines, ETL processes, and data warehousing solutions.


Responsibilities
  • Collaborate with the CTO and other team members to design, develop, and maintain data pipelines and ETL processes.

  • Write clean, efficient, and maintainable code in Python and other relevant technologies.

  • Implement and optimize data storage and processing solutions using BigQuery and Google Cloud Platform (GCP).

  • Ensure data quality and integrity through proper data validation and monitoring techniques.

  • Participate in code reviews and provide constructive feedback to improve overall code quality.

  • Stay up-to-date with the latest industry trends and technologies to ensure our data infrastructure remains competitive.

  • Assist in the development and launch of new data-driven tools and products.

  • Mentor and guide junior engineers, fostering a culture of continuous learning and improvement.

Requirements
  • Bachelor's degree in Computer Science, Engineering, or a related field, or equivalent work experience.

  • 5+ years of professional data engineering experience.

  • Strong proficiency in Python, BigQuery, and Google Cloud Platform (GCP) or equivalent technologies.

  • Experience with data pipeline and ETL process design and development.

  • Excellent problem-solving skills and the ability to work independently or as part of a team.

  • Strong communication, collaboration, and leadership skills.

  • Passion for working with large-scale data sets and staying current with industry trends.

Additional Skills (Nice to Have)
  • Experience with other data processing technologies and platforms (e.g., Apache Beam, Dataflow, Hadoop, Spark).

  • Experience with data visualization tools and libraries (e.g., Tableau, Looker, D3.js).

  • Knowledge of machine learning and AI concepts.

  • Experience with real-time data processing and streaming technologies (e.g., Kafka, Pub/Sub).

Benefits
  • Fully covered Health Insurance for employees and their eligible dependents

  • Fully covered Vision & Dental for employees and their eligible dependents

  • Unlimited Time Off

  • Company 401k plan with employer contributions

  • Commuter Benefits Program

Similar Jobs

5 Days Ago
Hybrid
124K-280K Annually
Senior level
124K-280K Annually
Senior level
Artificial Intelligence • Professional Services • Business Intelligence • Consulting • Cybersecurity • Generative AI
Lead development and delivery of data engineering solutions for clients: design data architectures, build and maintain ETL pipelines, apply advanced analytics, implement BI visualizations, coach teams, manage managed-services SLAs, and engage stakeholders to validate and refine outcomes.
Top Skills: AWSDatastageDb2ETLJavaOracle BiPythonQlikviewRedshiftSQL Server
5 Days Ago
Hybrid
99K-232K Annually
Senior level
99K-232K Annually
Senior level
Artificial Intelligence • Professional Services • Business Intelligence • Consulting • Cybersecurity • Generative AI
Lead data engineering engagements delivering ETL/ELT solutions, pipelines, and cloud analytics. Build and maintain architectures (DataStage, AWS/Redshift, DB2/SQL Server, GoldenGate/CDC, S3/Glue), oversee BI and visualization, manage client accounts and teams, mentor junior staff, ensure project delivery and quality, and drive process and technology adoption.
Top Skills: AWSBirtCdcDatastageDb2Etl/EltGlueGoldengateJavaPerformance TuningPipeline ArchitecturePythonQlikviewRedshiftS3SpotfireSQL Server
7 Days Ago
Easy Apply
Remote or Hybrid
United States
Easy Apply
134K-203K Annually
Senior level
134K-203K Annually
Senior level
Artificial Intelligence • Cloud • Computer Vision • Hardware • Internet of Things • Software
Lead design and operation of large-scale data pipelines and data APIs. Build Spark/PySpark workflows on Databricks, optimize job performance, manage data quality and observability, and develop MCP servers and AI-agent integrations. Mentor engineers, define standards, support production incidents and on-call rotations, and collaborate with stakeholders to deliver scalable data platform products.
Top Skills: Apache IcebergApi GatewayAWSAws LambdaAws Rds/AuroraAzureDatabricksDatadogDbtFastapiFivetranGCPGoogle BigqueryLlms/Ai AgentsMcp ServersMs Sql ServerMySQLOraclePostgresPysparkPythonS3SecretsmanagerSnowflakeSnsSparkSplunkSQLSqs

What you need to know about the San Francisco Tech Scene

San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.

Key Facts About San Francisco Tech

  • Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Google, Apple, Salesforce, Meta
  • Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
  • Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
  • Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account