TP-Link USA Corporation Logo

TP-Link USA Corporation

Big Data Engineer

Posted 7 Days Ago
In-Office
Irvine, CA
100K-120K Annually
Junior
In-Office
Irvine, CA
100K-120K Annually
Junior
Owns production data-platform components end to end, including ETL pipelines, data modeling, quality checks, monitoring, recovery, and cost optimization. Builds Spark on EMR and Airflow workflows, CDC ingestion, dimensional warehouse layers, and OLAP datasets. Partners with analysts and stakeholders to deliver reliable analytical data while tuning performance and automating reusable platform components.
The summary above was generated by AI

ABOUT US:

Headquartered in the United States, TP-Link Systems Inc. is a global provider of reliable networking devices and smart home products, consistently ranked as the world’s top provider of Wi-Fi devices. The company is committed to delivering innovative products that enhance people’s lives through faster, more reliable connectivity. With a commitment to excellence, TP-Link serves customers in over 170 countries and continues to grow its global footprint.

We believe technology changes the world for the better! At TP-Link Systems Inc, we are committed to crafting dependable, high-performance products to connect users worldwide with the wonders of technology. 

Embracing professionalism, innovation, excellence, and simplicity, we aim to assist our clients in achieving remarkable global performance and enable consumers to enjoy a seamless, effortless lifestyle. 

KEY RESPONSIBILITIES

  • Build, run, and own ETL pipelines on EMR (Spark) orchestrated in Airflow — including their monitoring, alerting, and recovery.
  • Write SQL and Python for data ingestion, transformation, and the datasets that analysts and dashboards depend on.
  • Own data quality for what you build — run the checks before you ship and add new ones where they're missing; confirm the results are correct, not only that the job completed.
  • Build and extend the data models for your area: fact and dimension tables following the team's layering conventions.
  • Keep your jobs efficient — watch runtime and cost, and raise slow or expensive jobs rather than living with them.
  • Use and extend the team's shared patterns and templates, and turn work you find yourself repeating into something automated or reusable.
  • Work with analysts and business stakeholders to turn requests into datasets that actually get used.

Requirements

REQUIRED QUALIFICATIONS

  • 2–4 years of hands-on data development in a production environment — pipelines that run on a schedule with real downstream consumers, that you were responsible for including when they broke.
  • Strong SQL: window functions, complex multi-table joins, incremental loads, and the ability to work out why a query is slow.
  • Python for production ETL and tooling (PySpark, pandas, boto3) — code that runs on a schedule, not only notebooks.
  • Hands-on experience with Spark on a cloud platform: AWS EMR, Databricks, Glue, or equivalent.
  • Production experience with a scheduler, Airflow preferred: DAG design, dependencies, retries, and reruns that are safe to repeat.
  • Working understanding of dimensional modeling: fact and dimension tables, star schema, and warehouse layering.
  • Comfortable working on AWS (S3 with Parquet / ORC), Linux, and Git — and comfortable picking up new tools as the platform evolves.
  • Effective use of AI to solve data problems — using it to move faster on SQL, debugging, and unfamiliar schemas, with the judgment to catch output that looks right but isn't.
  • Bachelor's degree in Computer Science, Information Systems, or a related field, or equivalent practical experience.

PREFERRED QUALIFICATIONS

  • Data ingestion or CDC tooling: DataX, Sqoop, Debezium, Fivetran, or similar.
  • An OLAP / MPP engine: StarRocks, Doris, ClickHouse, Redshift, or similar.
  • Spark performance work: partitioning, shuffle, skew, and memory tuning.
  • AWS cost optimization: EMR instance sizing and Spot strategy, S3 lifecycle policies.
  • Lakehouse formats (Iceberg, Hudi, Delta), streaming (Kafka, Flink), dbt, or a data quality framework.
  • QuickSight or another BI tool: dataset and permission design.
  • Self-directed learning: a project, an open-source contribution, or a tool you picked up on your own and put to real use

Benefits

Base Salary Range: $100 - 120K

  • Free snacks and drinks
  • Fully paid medical, dental, and vision insurance (partial coverage for dependents)
  • Contributions to 401K funds
  • Bi-annual reviews, and annual pay increases
  • Health and wellness benefits, including free gym membership
  • Quarterly team-building events

At TP-Link Systems Inc., we are continually searching for ambitious individuals who are passionate about their work. We believe that diversity fuels innovation, collaboration, and drives our entrepreneurial spirit. As a global company, we highly value diverse perspectives and are committed to cultivating an environment where all voices are heard, respected, and valued. We are dedicated to providing equal employment opportunities to all employees and applicants, and we prohibit discrimination and harassment of any kind based on race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state, or local laws. Beyond compliance, we strive to create a supportive and growth-oriented workplace for everyone. If you share our passion and connection to this mission, we welcome you to apply and join us in building a vibrant and inclusive team at TP-Link Systems Inc.

Please, no third-party agency inquiries, and we are unable to offer visa sponsorships at this time.

Similar Jobs

15 Days Ago
Easy Apply
Remote or Hybrid
14 Locations
Easy Apply
120K-150K Annually
Mid level
120K-150K Annually
Mid level
Automotive • Big Data • Insurance • Software • Transportation
Designs, builds, and maintains scalable ETL/ELT pipelines and finance data models using Snowflake, AWS, dbt Core, Python, and SQL. Develops Medallion architecture data marts, integrates ERP systems, and partners with stakeholders on financial workflows. Implements data governance, RBAC, automated quality testing, observability, documentation, CI/CD, and secure deployments. Monitors Snowflake costs and optimizes queries while supporting Oracle EBS integrations and the migration to Workday.
Top Skills: AWSCi/CdDbt CoreGitOracle EbsPythonSnowflakeSQLWorkday
8 Days Ago
In-Office
Foster City, CA, USA
90K-110K Annually
Senior level
90K-110K Annually
Senior level
Artificial Intelligence • Information Technology • Software • Consulting
Designs, builds, and operates large-scale Hadoop-based data pipelines and analytics platforms. Responsibilities include ingesting, transforming, and analyzing structured and unstructured data; developing Spark-based processing solutions; supporting streaming workloads; managing workflow orchestration; and ensuring reliable, performant, cost-effective production data platforms. The role also involves troubleshooting, debugging, documentation, and collaboration on cloud, lakehouse, governance, Kubernetes, CI/CD, and infrastructure-as-code technologies.
Top Skills: Apache AirflowApache AtlasApache FlinkApache HadoopApache HudiApache IcebergSparkAws EmrAzure HdinsightCi/CdCollibraDatabricksDelta LakeHbaseHdfsHiveInfrastructure As CodeJavaKafkaKubernetesNosql DatabasesOoziePythonRelational DatabasesScalaShellSpark StreamingSQLSqoopTrino
14 Days Ago
In-Office or Remote
San Francisco, CA, USA
243K-500K Annually
Expert/Leader
243K-500K Annually
Expert/Leader
Social Media
Lead Pinterest’s technical strategy and roadmap for scalable big data and AI infrastructure. Build frameworks for compute, job, resource, scheduling, and shuffle management across petabyte-scale datasets. Partner with internal customers, provide company-wide technical leadership, and improve data processing reliability, speed, and efficiency.
Top Skills: AWSFlinkGoJavaKubernetesPythonPyTorchRayScalaSparkTensorFlow

What you need to know about the San Francisco Tech Scene

San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.

Key Facts About San Francisco Tech

  • Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Google, Apple, Salesforce, Meta
  • Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
  • Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
  • Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account