Cardlytics Logo

Cardlytics

Principal Software Engineer, Tech Lead - Platform

Posted 2 Days Ago
Remote or Hybrid
Hiring Remotely in US
Senior level
Remote or Hybrid
Hiring Remotely in US
Senior level
Lead architecture and evolution of Cardlytics' AWS-based data compute platform and lakehouse. Define standards for batch, streaming, ML, and AI workloads; build semantic layer, feature store, and governance. Partner with analysts and engineers, drive CI/CD (Terraform, GitHub Actions), monitoring, security, cost governance, and incident response while mentoring teams and shaping platform strategy.
The summary above was generated by AI

About Cardlytics
Founded in 2008, Cardlytics (NASDAQ: CDLX) is the industry-leading purchase intelligence and incentives platform. We make commerce smarter and more rewarding for everyone by helping businesses attract, understand, and incentivize consumers through our partners' digital reward programs. Join us on our mission to make commerce smarter and more rewarding for everyone!

About the Team

At Cardlytics, our goal is to streamline data consumption across the entire organization. We understand that accessible, reliable data underpins informed decision-making and innovative problem-solving. By partnering closely with product and engineering teams, we tailor our solutions to fit their specific workflow needs and make strategic investments in our platform to ensure swift access to data. Our approach is designed to simplify the way teams interact with data, to accelerate time-to-insight to enable Cardlytics teams to harness the full potential of their data for impactful outcomes, and to make deliberate technology choices that keep our data infrastructure cost-effective.

About the Position

Cardlytics is seeking a Principal Software Engineer, Tech Lead - Platform to join the team, reporting to the VP of Engineering, Cloud & Data Infrastructure.

We are looking for an experienced technical leader to own and evolve our data compute environment end-to-end on AWS, including defining the next-generation platform direction. In this role, you will make architectural, design, and operational decisions that shape how analysts, engineers, and business stakeholders interact with data at Cardlytics. As data consumption increasingly shifts toward AI and agentic applications, you will also shape the platform's evolution into an AI-ready foundation — spanning the semantic layer, feature store, and data ontology that these systems depend on. You will combine deep expertise in industry-leading data platforms with the ability to provide technical leadership, define platform standards, and act as the primary technical partner for diverse user groups across the organization.

You will:

  • Architecture and design: Design and evolve the Cardlytics next-generation architecture; establish reference architectures and standards for batch, streaming, ML, and AI/agentic workloads.

  • AI-ready data platform: Build out the semantic layer, feature store, and data ontology that make Cardlytics data consumable by AI/agentic applications; enable governed, self-service access for both human and machine (LLM/agent) consumers.

  • User enablement: Serve as the primary technical partner for analysts, engineers, and business users; develop self-service guides, onboarding materials, and best-practice documentation to reduce friction across all user groups.

  • Technical leadership: Set technical direction for the platform and mentor engineers across the data and platform teams; drive engineering excellence and best practices, and manage the vendor relationship.

  • Performance and reliability: Define monitoring standards and SLAs, lead performance tuning for Spark jobs, open table formats (e.g. Delta, Hudi), and SQL query engines; own incident response and root-cause analysis.

  • Governance and security: Drive adoption of a unified governance layer (e.g., Databricks Unity Catalog) for centralized RBAC, column-level security, data lineage, and metadata management; implement and maintain security best practices including encryption and audit logging.

  • Platform standards and governance: Define the operating model and guardrails for the managed lakehouse platforms (including Databricks on AWS) — compute policies, access model, catalog structure, and cost governance — with day-to-day administration executed by the platform and domain teams working within those standards.

  • Infrastructure as code: Own the CI/CD strategy for lakehouse and data platform deployments (Terraform, GitHub Actions, and platform-native packaging such as Asset Bundles); enforce DevOps practices across engineering teams.

You have:
  • 7+ years of experience in data engineering or data platform roles, with at least 2 years in a technical lead or architecture capacity.

  • Deep, hands-on expertise with the leading industry platforms, frameworks, and tools: Databricks, AWS EMR or similar, Delta Lake, Unity Catalog, Spark (PySpark), and SQL; with a solid understanding of compute/cluster management on AWS.

  • Proven experience designing and delivering Lakehouse architectures and large-scale ELT/ETL pipelines in production environments.

  • Proficiency in Infrastructure as Code tools, such as Terraform.

  • Demonstrated experience supporting diverse stakeholder groups including analysts, engineers (including ML engineers), and non-technical business users.

  • Strong understanding of data governance, data modeling, and cloud security best practices.

  • Excellent communication and collaboration skills, with the ability to translate technical concepts for non-technical audiences.

Nice to have:
  • Experience designing or operating a semantic layer, feature store, or data ontology / knowledge graph in a production environment.

  • Familiarity with managing data for ML systems and AI/agentic applications, such as training pipelines or inference for LLM-powered and agentic tools.

Technical Environment

We primarily use macOS and Google Workspace (Docs, Sheets, Slides). While our preferred platform is macOS, we support both macOS and Windows. Familiarity with or willingness to work within this environment is required.

Core Values

Our shared values are the driving force behind everything we do. Across all roles, we are looking for teammates who embody these values:

  • Customer and partner first

  • Act with urgency and focus

  • Integrity with our partners and data

  • Accountability even when challenged

  • Empowerment over hierarchy

  • Growth over comfort

Benefits and Perks

  • Flexible paid time off plus company holidays

  • Medical, dental, and vision insurance begins on your first day

  • 401(k) retirement plan with company match, plan also includes a student loan debt repayment option

  • Employee Stock Purchase Plan

  • Educational assistance for continuing education

  • Lifestyle Spending Account for physical, emotional, and financial wellness (like gym memberships, home down payments, art classes, park passes, and more!)

  • Complimentary Calm app subscriptions to support employee mental health and wellbeing

As an equal opportunity employer, Cardlytics is committed to diversity, equity, and inclusion. Our people bring our products and organization to life, and every unique perspective makes us better. If you can do the job and you’re excited about growing with us as we scale our best-in-class advertising platform, we’d love to hear from you. If you need accommodation in the recruiting process due to a disability, please email [email protected] or inform your recruiter.

Cardlytics Menlo Park, California, USA Office

333 Middlefield Road, Menlo Park, CA, United States, 94306

Similar Jobs

48 Minutes Ago
Remote or Hybrid
Pennsylvania, USA
99K-231K Annually
Senior level
99K-231K Annually
Senior level
Digital Media • Information Technology • News + Entertainment
Own technical success for assigned enterprise accounts: design and implement data architectures, onboard data, build dashboards and integrations, troubleshoot, optimize post-deployment, and engage CISO-level stakeholders. Partner with Sales Engineering, Product, and Engineering to drive deployments, influence roadmap, present practitioner experience externally, mentor teams, and travel to customer sites or Comcast offices as needed.
Top Skills: Aws S3Azure BlobDatabeeDatabricksETLIcebergMicrosoft SentinelOcsfSIEMSnowflakeSplunkSQL
57 Minutes Ago
Remote
USA
226K-282K Annually
Expert/Leader
226K-282K Annually
Expert/Leader
Consumer Web • Healthtech • Professional Services • Social Impact • Software
Lead and build Headway's payer marketing function: set strategy, craft positioning and narratives, commercialize payer solutions, translate clinical data into commercial proof, enable sales and field teams, run events and competitive intelligence, and measure relationship and commercial impact.
75K-157K Annually
Senior level
Artificial Intelligence • Fintech • Insurance • Marketing Tech • Software • Analytics
Manage investigation, evaluation, and resolution of high-exposure, complex auto and homeowners casualty claims. Assess coverage, liability, and damages; develop settlement strategy; coordinate with trial counsel; attend mediations/trials; prepare litigation reports; supervise reserves and counsel billing; identify subrogation and suspicious activity; mentor colleagues and support regulatory matters. Remote or hybrid role supporting Eastern, Central, and Mountain regions with occasional travel for hearings and mediations.

What you need to know about the San Francisco Tech Scene

San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.

Key Facts About San Francisco Tech

  • Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Google, Apple, Salesforce, Meta
  • Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
  • Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
  • Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account