WEX Inc. Logo

WEX Inc.

Sr Staff - Data Platform Engineer

Posted Yesterday
Remote
Hiring Remotely in US
220K-256K Annually
Senior level
Remote
Hiring Remotely in US
220K-256K Annually
Senior level
Lead architecture and roadmap for a company-wide data lakehouse platform. Build platform-as-product components (SDKs, CLIs, control planes), optimize distributed compute/storage, prototype performance R&D, ensure compliance-by-design (lineage, PII masking, access control), enable real-time AI data ingestion, drive engineering standards, and mentor cross-functional teams.
The summary above was generated by AI

About Us

As a Sr. Staff Data Platform Engineer, you will be the primary architect and visionary for the core data infrastructure that powers the entire enterprise. This is a "platform-as-a-product" role; your mission is to build the internal foundation—creating the high-performance engines, abstraction layers, and self-service frameworks that enable hundreds of other engineers to move faster.

You will operate at the intersection of Systems Programming and Data Engineering, solving "hard-tech" problems like automated schema evolution, multi-engine compute optimization, and global data discovery. As a top-level technical individual contributor, you will bridge the gap between long-term business strategy and deep-kernel technical execution, ensuring WEX’s data platform remains a competitive advantage.

Is this role for you?

  • YES, if: You are a Backend/Software Engineer who loves solving "Big Data" problems, building APIs for data discovery, and optimizing distributed systems.

  • NO, if: Your primary expertise is writing SQL queries, building Tableau dashboards, or managing ETL workflows without deep experience in Java or Python system architecture.

Responsibilities
  • Architectural Sovereignty: Define the 3-5 year technical roadmap for the Data Lakehouse. You aren't just using tools; you are deciding how storage, compute, and metadata layers (e.g., Apache Iceberg, Snowflake Horizon or Databricks Unity Catalog) interact at an elemental level.

  • Platform-as-a-Product: Build internal SDKs, CLI tools, and automated orchestration frameworks. Your goal is to abstract away cloud complexity via Control Planes and Custom Operators, allowing Data Engineers to focus on business logic rather than infrastructure boilerplate.

  • Internal R&D: Prototype and benchmark emerging technologies (e.g., specialized Spark extensions) to keep the platform at the bleeding edge of performance and cost-efficiency.

  • Global Governance & Security: Architect "compliance-by-design" systems. Automate data lineage, PII masking, and fine-grained access control across petabyte-scale environments without sacrificing developer velocity.

  • AI Governance Lake: Facilitate real-time data ingestion by implementing streaming support for Open Telemetry data from AI Agents into the Data Lake, drive the development of advanced AI evaluation metrics and reporting.

  • Engineering Excellence & Influence: Set the gold standard for code quality and system design across the company. You will lead Cross-Functional Architecture Reviews and serve as the final escalation point for the most complex system outages or performance bottlenecks.

  • Organizational Mentorship: Beyond individual mentoring, you will foster an "Engineering Community," influencing the hiring bar and professional development paths for the entire data engineering organization.

Qualifications & Experience
  • Experience: 15+ years in software engineering and distributed systems, with at least 4 years in a principal or staff-level capacity leading platform-scale initiatives.

Core Technical Competencies (Software Engineering Focus):

  • Strong Software Foundations: Strong fundamentals on software engineering, system architecture, and scalable production applications (Algorithms, Data Structures, and System Design).

  • Experience in the Java/J2EE ecosystem (Spring Boot, Microservices) and python. We are looking for a developer who writes clean, testable, and high-performance code, not just scripts.

  • Data as a Product: Experience building the platforms / framework engines and APIs that power data movement, rather than just building the ETL/ELT pipelines themselves.

Data Lakehouse Mastery:

  • Deep internal knowledge of Apache Iceberg, Hudi, or Delta Lake (metadata management, manifest files, and compaction strategies).

  • Experience contributing to or deeply customizing open-source data projects (e.g., Spark, dbt).

  • Extensive experience designing and building high-throughput, fault-tolerant data pipelines and orchestration frameworks that ensure robust data transformations and high data quality.

Cloud & Infrastructure:

  • Extensive experience with cloud architecture and services, including AWS (S3, EMR, Kubernetes, Lambda) and Azure.

  • Deep understanding of CI/CD automation, modern development tools, Git Actions, Terraform and frameworks.

AI-Driven Development & Productivity:

  • AI Native Development: Experience leveraging AI Code Gen platforms into software development lifecycle (SDLC) to automate code generation, reviews, generate unit tests, and perform root-cause analysis of system failures.

  • LLM-Ops for Platform: Ability to architect the infrastructure required to support AI Agent development by enabling vector database integration.

Leadership & Vision:

  • Proven track record of "leading by influence"—driving adoption of new technologies across multiple autonomous teams.

  • Ability to communicate complex architectural trade-offs (e.g., "Latency vs. Consistency" or "Build vs. Buy") to C-suite executives and junior engineers alike.

Education: 

  • Bachelor’s or Master’s degree in Computer Science (Distributed Systems focus) preferred, or equivalent deep industry experience.

The base pay range represents the anticipated low and high end of the pay range for this position. Actual pay rates will vary and will be based on various factors, such as your qualifications, skills, competencies, and proficiency for the role. Base pay is one component of WEX's total compensation package. Most sales positions are eligible for commission under the terms of an applicable plan. Non-sales roles are typically eligible for a quarterly or annual bonus based on their role and applicable plan. WEX's comprehensive and market competitive benefits are designed to support your personal and professional well-being. Benefits include health, dental and vision insurances, retirement savings plan, paid time off, health savings account, flexible spending accounts, life insurance, disability insurance, tuition reimbursement, and more. For more information, check out the "About Us" section.Pay Range: $220,000.00 - $255,800.00

Similar Jobs

16 Days Ago
In-Office or Remote
San Francisco, CA, USA
209K-429K Annually
Senior level
209K-429K Annually
Senior level
Social Media
Lead architecture and strategic direction for Pinterest's data warehouse, analytics tools, and data governance. Drive cross-functional initiatives to build scalable data platforms, AI-assisted pipeline tooling, and analytics capabilities. Mentor engineers, define policies and tooling, and deliver measurable adoption and business impact across the company.
Top Skills: AirflowClaude CodeCodexCursorDatahubExadataFlinkQuerybookSparkSupersetTrino
7 Hours Ago
Remote
USA
201K-275K Annually
Senior level
201K-275K Annually
Senior level
Fintech • Payments • Security • Software • Financial Services
The role involves building and operating data platforms, ensuring reliability and performance, and guiding technical direction while fostering collaboration with teams across the organization.
Top Skills: AWSDeltaGlueGoIcebergJavaKafkaPythonS3Spark
16 Days Ago
Easy Apply
Remote
USA
Easy Apply
254K-299K Annually
Senior level
254K-299K Annually
Senior level
Artificial Intelligence • Blockchain • Fintech • Financial Services • Cryptocurrency • NFT • Web3
Lead the technical strategy for Coinbase's Data Platform, architecting data systems for AI/ML workloads and ensuring data reliability, performance, and cross-functional alignment.
Top Skills: AIData EngineeringData LakesDatabricksDistributed SystemsKafkaMlSnowflake

What you need to know about the San Francisco Tech Scene

San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.

Key Facts About San Francisco Tech

  • Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Google, Apple, Salesforce, Meta
  • Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
  • Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
  • Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account