Designs and leads scalable data solutions on GCP, including data architectures, ETL/ELT pipelines, data lakes, lakehouses, warehouses, and batch or real-time processing. Develops data models, orchestration, monitoring, governance, and production deployments while collaborating with architects, engineers, analysts, DevOps teams, and customers. Requires strong Python and SQL skills, GCP expertise, cloud data warehouse experience, and familiarity with visualization, transformation, CI/CD, and infrastructure practices.
Description
We are looking for an experienced Senior Data Engineer to join a growing Data Engineering and Analytics department. In this role, you will design and develop advanced data solutions for complex customer environments, with a strong focus on Google Cloud Platform and modern GCP data technologies. You will work across the full data lifecycle- from architecture and data modeling to pipeline development, data platforms, analytics, and production deployment.
Key Responsibilities:
- Design and develop scalable data solutions on GCP.
- Lead the technical design and implementation of customer data projects.
- Understand business and technical requirements and translate them into effective data architectures.
- Build and maintain ETL/ELT pipelines, Data Lakes, Lakehouses, and cloud-based Data Warehouses.
- Design data models and integration processes for Batch and real-time workloads.
- Work with structured, semi-structured, and unstructured data.
- Select the appropriate technologies based on performance, scalability, security, and cost requirements.
- Implement data quality, monitoring, governance, and orchestration processes.
- Work closely with Data Architects, Data Engineers, DevOps teams, analysts, and customer stakeholders.
- Participate in the development of analytics, AI, and ML solutions where relevant.
Requirements:
- At least 5 years of professional experience as a Data Engineer – mandatory.
- Proven hands-on experience developing data solutions on GCP – mandatory.
- Experience with data visualization tools such as Looker, Power BI, Tableau, or QuickSight.
- Experience with data modeling, orchestration, performance optimization, and large-scale data processing.
- Strong Python development skills, including building data pipelines and ETL/ELT processes.
- High proficiency in SQL – mandatory.
- Experience designing and developing cloud-based Data Warehouses and Lakehouse solutions.
- Experience with ETL/ELT and transformation tools such as dbt, Dataform, Rivery, or similar platforms.
- Familiarity with CI/CD, Git, Infrastructure as Code, and production deployment practices.
- Strong analytical and problem-solving skills with excellent attention to detail.
- Ability to learn new technologies independently and work across multiple projects.
- Strong experience with several of the following GCP services: BigQuery, Cloud Storage, Dataflow, Dataproc, Cloud Composer, Cloud Run or Cloud Functions
- Fluent English.
Advantages
- Hands-on experience with AWS or Microsoft Azure data services.
- Experience with services such as AWS Glue, Redshift, EMR, Kinesis, Azure Data Factory, Synapse, or Databricks.
- Experience with real-time data processing and streaming architectures.
- Experience with Kafka or other event-driven platforms.
- Knowledge of AI and ML services such as Vertex AI, Gemini, BigQuery ML, SageMaker, Bedrock, or Azure Machine Learning.
- Relevant GCP professional certifications.
- Previous experience working in consulting or customer-facing technology projects.
Similar Jobs
Blockchain • Software • Analytics • Financial Services • Cryptocurrency
Leads the API and frontend engineering teams building Keet, a peer-to-peer messaging and video-calling app. Owns technical design, API architecture, performance, reliability, engineering standards, team delivery, and leadership development. Partners with product managers to scope and prioritize features, challenge assumptions, and translate product vision into buildable work. Requires strong product judgment, JavaScript and React expertise, and familiarity with distributed or local-first systems.
Top Skills:
BlockchainCrdtsEventual ConsistencyJavaScriptLocal-First SystemsOffline-First SystemsPeer-To-Peer (P2P) TechnologyReactSync Engines
eCommerce • Fintech • Payments • Software • Financial Services
The Senior Database Administrator will design, maintain, secure, and optimize large PostgreSQL databases. Responsibilities include backups and recovery, disaster recovery, replication, clustering, failover, performance monitoring, query optimization, patching, upgrades, and collaboration with development teams. The role also supports cloud database services, database migrations, DevOps tooling, and real-time data streaming systems while improving reliability and scalability across Tabby’s infrastructure.
Top Skills:
AWSBashClickhouseDebeziumFlinkGCPGoHelmKubernetesPgbouncerPostgresPythonSQLTerraform
Information Technology • Consulting
Optimize LLM inference performance on modern GPUs by analyzing GPU execution, memory access, kernels, and bottlenecks. Develop, debug, reverse-engineer, and benchmark CUDA kernels and low-level GPU operations for improved latency, throughput, and utilization. Work with inference frameworks including vLLM, SGLang, TensorRT-LLM, Triton, and FlashAttention, while investigating advanced optimization techniques for matrix multiplication, attention, and neural network layers.
Top Skills:
CudaDistributed InferenceFlashattentionGpu ProgrammingHigh-Performance ComputingKv Cache OptimizationLlm InferencePyTorchQuantizationSglangTensorrt-LlmTritonVllm
What you need to know about the San Francisco Tech Scene
San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.
Key Facts About San Francisco Tech
- Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Google, Apple, Salesforce, Meta
- Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
- Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
- Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine
