Alpaca Logo

Alpaca

Senior Data Platform Engineer

Reposted 2 Days Ago
Remote
Hiring Remotely in USA
Senior level
Remote
Hiring Remotely in USA
Senior level
Design and operate Alpaca’s scalable data platform on GCP, including lakehouse infrastructure, Kubernetes-based deployments, streaming and CDC pipelines, batch ingestion, BI access, cataloging, monitoring, and governance. Build infrastructure as code with Terraform and Ansible, operate distributed query engines and Apache Iceberg, maintain reliability practices, and collaborate with DevOps and analytics teams to support rapidly evolving data requirements.
The summary above was generated by AI

Who We Are:

Alpaca is a US-headquartered, global leader in agent-first brokerage infrastructure for stocks, ETFs, options, crypto, fixed income, 24/5 trading, and more.
Amongst our subsidiaries, Alpaca is a licensed financial services company, serving hundreds of financial institutions across 40 countries with our institutional-grade APIs. This includes broker-dealers, investment advisors, wealth managers, hedge funds, and crypto exchanges, totalling over 10 million brokerage accounts.
Our global team is a diverse group of experienced engineers, traders, and brokerage professionals who are working to achieve our mission of opening financial services to everyone on the planet. We're deeply committed to open-source contributions and fostering a vibrant community, continuously enhancing our award-winning, developer-friendly API and the robust infrastructure behind it.
Alpaca is proudly backed by $400 million in funding from top-tier global investors including Portage Ventures, Spark Capital, Tribe Capital, Social Leverage, Horizons Ventures, Opera Tech Ventures, SBI Group, Derayah Financial, Unbound, Peak XV, Elefund, and Y Combinator.
Our Team Members:

We're a dynamic team of 400+ globally distributed members who thrive working from our favorite places around the world, with teammates spanning the USA, Canada, Japan, Hungary, Nigeria, Brazil, the UK, and beyond!
We're searching for passionate individuals eager to contribute to Alpaca's rapid growth. If you align with our core values—Stay Curious, Have Empathy, and Be Accountable—and are ready to make a significant impact, we encourage you to apply.

About the team & role

The Data Platform team builds and operates the shared infrastructure that powers how data is stored, moved, and consumed across Alpaca. Our platform supports financial transactions, customer data, API and system events, enriched datasets, and third-party sources that power critical decisions and products for internal teams and external stakeholders. We process hundreds of millions of events each day and that scale continues to grow as Alpaca serves more customers and launches new products.

As a Senior Data Platform Engineer, you'll design, build, and operate reliable systems across Alpaca's data platform, from distributed query engines and lakehouse storage to streaming infrastructure, governance, and data serving. You'll also work closely with our AI and Data Science teams to enable agentic workflows and machine learning capabilities. As part of a small team, you'll contribute across multiple initiatives, own projects from design through production, and help shape the future of our platform.

Our team is 100% distributed and remote.

What you’ll do

  • Design, build, and operate core data platform infrastructure, including distributed query engines, lakehouse storage, orchestration, and streaming pipelines.
  • Contribute to regional platform deployments, building scalable and repeatable infrastructure using Kubernetes and infrastructure-as-code.
  • Develop real-time data processing, analytics, and alerting capabilities for operational and product use cases.
  • Partner with AI and Data Science teams on the platform foundations for agentic workflows, evaluations, and ML lifecycle tooling.
  • Evolve our data catalog, governance, and access controls so data is discoverable and properly governed.
  • Own platform reliability through observability, on-call participation, and operational improvements while collaborating with cross-functional teams.

Must-haves

  • 5+ years of experience in data infrastructure, platform engineering, or software engineering, with demonstrated end-to-end ownership of production systems.
  • Strong Python and SQL skills, with experience building reliable pipelines, services, or platform tooling.
  • Experience building or operating distributed data systems, such as query engines, lakehouses, or streaming platforms.
  • Experience operating cloud infrastructure using Kubernetes, infrastructure-as-code, and deployment automation.
  • Sound operational judgment, clear technical communication, and the ability to collaborate across engineering teams.

 Nice to Haves:

  • Experience with distributed query engines such as Trino, Presto, or Spark, and open table formats such as Apache Iceberg.
  • Experience with streaming and real-time data infrastructure such as Kafka, Redpanda, Flink, or Debezium.
  • Experience with AI and agent infrastructure, including MCP servers, retrieval systems, agent observability, or LLM evaluation.
  • Experience supporting ML infrastructure using technologies such as MLflow, Vertex AI, or similar platforms.
  • Experience with real-time analytics engines such as ClickHouse, Pinot, or Druid.
  • Experience designing and operating infrastructure across multiple cloud regions, including workload isolation and cost-performance trade-offs.
How We Take Care of You:
  • Competitive Salary & Stock Options
  • Health Benefits
  • New Hire Home-Office Setup: One-time USD $500
  • Monthly Stipend: USD $150 per month via a Brex Card

Alpaca is proud to be an equal opportunity workplace dedicated to pursuing and hiring a diverse workforce.

Recruitment Privacy Policy

HQ

Alpaca San Mateo, California, USA Office

20 N San Mateo Dr, San Mateo, CA, United States, 94401

Similar Jobs

Senior level
Financial Services
Drive new business sales for J.P. Morgan’s Payments and Treasury Services across Chilean financial institutions, with a focus on non-bank financial institutions. Build senior client relationships, originate and close opportunities, manage sales pipelines, develop account strategies, cross-sell integrated solutions, and coordinate onboarding, implementation, compliance, and ongoing delivery across internal teams.
Top Skills: AmlCash ManagementClearingForeign ExchangeKycLiquidityMerchant ServicesPayments And Treasury ServicesSanctions ComplianceTrade And Working Capital
5 Days Ago
In-Office or Remote
2 Locations
111K-173K Annually
Mid level
111K-173K Annually
Mid level
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
Own readiness and enablement programs for SDR teams, including onboarding, sales training, prospecting, qualification, product knowledge, tool adoption, AI workflows, and manager coaching. Facilitate workshops and role-plays, develop learning content and playbooks, partner with sales, marketing, operations, and systems teams, and measure impact through ramp time, conversion, pipeline, proficiency, and adoption metrics.
Top Skills: Artificial IntelligenceConversation Intelligence ToolsCRMGongLinkedin Sales NavigatorOutreachSales Engagement ToolsSalesforceSalesloftZoominfo
5 Days Ago
Remote
2 Locations
Senior level
Senior level
Artificial Intelligence • Consumer Web • Digital Media • Information Technology • Social Impact • Software
Lead a small, hands-on engineering team responsible for analytics infrastructure and member growth. Own technical strategy for ClickHouse-powered analytics, data visualizations, and LLM-enabled data experiences, while guiding onboarding and activation roadmaps. Write and review code, design experiments, partner with product and design, make architectural decisions, and hire, mentor, and develop engineers. The role requires strong web application experience, product judgment, communication skills, and expertise across Ruby on Rails, databases, ReactJS, and TypeScript.
Top Skills: A/B TestingClickhouseLlmsMySQLPostgresReactRuby On RailsStripeTypescript

What you need to know about the San Francisco Tech Scene

San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.

Key Facts About San Francisco Tech

  • Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Google, Apple, Salesforce, Meta
  • Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
  • Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
  • Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account