Alpaca Logo

Alpaca

Staff Software Engineer - Platform

Posted 11 Days Ago
Remote
Hiring Remotely in USA
Senior level
Remote
Hiring Remotely in USA
Senior level
Own the architecture and long-term direction of Alpaca’s Redpanda-based event streaming platform. Lead migration to event-driven systems, design scalable real-time client streaming, establish schema and library standards, shape authentication for streaming, partner on resilience and testing, mentor engineers, influence cross-team technical decisions, and participate in platform on-call. The role primarily uses Go and involves Kubernetes, Helm, PostgreSQL, observability, and distributed systems.
The summary above was generated by AI

Who We Are:

Alpaca is a US-headquartered, global leader in agent-first brokerage infrastructure for stocks, ETFs, options, crypto, fixed income, 24/5 trading, and more.
Amongst our subsidiaries, Alpaca is a licensed financial services company, serving hundreds of financial institutions across 40 countries with our institutional-grade APIs. This includes broker-dealers, investment advisors, wealth managers, hedge funds, and crypto exchanges, totalling over 10 million brokerage accounts.
Our global team is a diverse group of experienced engineers, traders, and brokerage professionals who are working to achieve our mission of opening financial services to everyone on the planet. We're deeply committed to open-source contributions and fostering a vibrant community, continuously enhancing our award-winning, developer-friendly API and the robust infrastructure behind it.
Alpaca is proudly backed by $400 million in funding from top-tier global investors including Portage Ventures, Spark Capital, Tribe Capital, Social Leverage, Horizons Ventures, Opera Tech Ventures, SBI Group, Derayah Financial, Unbound, Peak XV, Elefund, and Y Combinator.
Our Team Members:

We're a dynamic team of 400+ globally distributed members who thrive working from our favorite places around the world, with teammates spanning the USA, Canada, Japan, Hungary, Nigeria, Brazil, the UK, and beyond!
We're searching for passionate individuals eager to contribute to Alpaca's rapid growth. If you align with our core values—Stay Curious, Have Empathy, and Be Accountable—and are ready to make a significant impact, we encourage you to apply.

About the Role

As a Staff Software Engineer on the Platform team, you will own the technical direction of Alpaca's streaming platform - our Redpanda-based event backbone and the user-facing streaming infrastructure. Platform also owns Authentication, Developer Experience and QA, and AI-Native Engineering. Streaming is roughly two-thirds of the job and where we expect you to become the deepest engineer in the company; across the other three you review the designs, hold an informed opinion, and lead the work where they meet streaming.

This is a Staff role, so we are hiring for direction as much as delivery - the engineer who decides what the streaming platform looks like in two years, writes the RFC that gets three teams to agree, and then builds the hard part. We own client-facing and internal services, maintain shared libraries nearly every team depends on, and manage our own deployments. Most of our time goes into Go, but we also write Helm charts, dig through logs and metrics, and get pulled into a wide variety of problems.

Things You Get To Do
  • Own the architecture of our event streaming platform end to end - Redpanda, the UTS ecosystem, client libraries and user-facing streaming - and set its two-to-three-year direction
  • Lead the shift from batch to event-driven across Alpaca's systems, working with the teams who own them rather than around them
  • Design user-facing streaming at scale: connection fan-out, slow consumers, backpressure, ordering and delivery guarantees, and the failure modes that only show up on a volatile market day
  • Set the standards for event-driven design - schema evolution, topic ownership, replay, idempotency - and own the shared libraries other teams build against, including the cost of versioning and deprecation
  • Shape AuthN/AuthZ direction across Alpaca and lead the work where identity meets streaming: authorizing real-time subscriptions, token lifecycle on long-lived connections, multi-tenant isolation
  • Help shape how Alpaca builds with AI - the schemas, contracts and event streams you own are the substrate our agentic development platform runs on
  • Partner with SRE on chaos testing and game days for the event backbone, and with our QA stream on test tooling and pre-production gates, so resilience is verified rather than assumed
  • Lead through influence rather than authority, and multiply the engineers around you through mentoring, design review, and handing off the work that grows people
  • Join the Platform on-call rotation and act as technical lead during incidents affecting shared infrastructure
Who You Are (must-haves)
  • 8+ years of professional engineering experience, including several years running systems at real scale. You write Go, or have deep experience in another strongly-typed language and will pick it up quickly.
  • You have architected event streaming systems, not just used them - real production depth in Kafka or Redpanda across partitioning, consumer groups, rebalancing, retention and delivery guarantees, and how each breaks under load.
  • You have delivered realtime data to clients at scale (WebSockets, SSE or gRPC streaming) and handled fan-out, slow consumers and backpressure in production.
  • You have driven technical direction across team boundaries without formal authority. You can point to the decisions you owned, the RFCs you wrote, and what happened next.
  • You have built or maintained libraries many teams depend on, and know what backward compatibility and deprecation actually cost.
  • You have mentored senior engineers and left the teams around you better than you found them.
  • You have real depth in at least one adjacent area - identity and access, developer tooling and CI, or testing and resilience - and genuine curiosity about the others.
  • You know Kubernetes beyond the basics: you can write a Helm chart with relative ease, you understand security best practices, and you have job experience or certifications to prove it.
  • You have worked with relational databases - we use PostgreSQL, but we are not picky as long as the fundamentals are solid.
  • You have worked at a startup before - you thrive in ambiguous environments, embrace changing priorities, know when to balance technical debt with speed, and proactively tackle whatever needs to get done without relying on pre-existing processes or documentation.
Who You Might Be (nice-to-haves)
  • You’ve worked with an IDL or binary serialization format (Protobuf, Avro; we use FlatBuffers) and handled schema evolution across many consumers.
  • You have experience with change data capture (Debezium, PeerDB or similar) and understand how Postgres logical replication works.
  • You’ve worked on auth systems - OAuth 2.0, OIDC, JWT lifecycle, Keycloak or Cognito - especially around long-lived connections or machine-to-machine access.
  • You’ve built agentic or AI-native developer tooling, or designed systems meant to be operated by agents rather than only by people.
  • You’ve run chaos engineering or game days, or built the load and fault-injection testing that makes them worth running.
  • You’ve done IaC with Argo CD or Terraform.
  • You have experience with Grafana’s observability stack - Prometheus, Tempo and all the rest. You might have even written a PromQL query for a new alert once or twice.
  • You’ve worked in fintech or another regulated domain and understand how compliance constraints shape architecture.
How We Take Care of You:
  • Competitive Salary & Stock Options
  • Health Benefits
  • New Hire Home-Office Setup: One-time USD $500
  • Monthly Stipend: USD $150 per month via a Brex Card

Alpaca is proud to be an equal opportunity workplace dedicated to pursuing and hiring a diverse workforce.

Recruitment Privacy Policy

HQ

Alpaca San Mateo, California, USA Office

20 N San Mateo Dr, San Mateo, CA, United States, 94401

Similar Jobs

Yesterday
Remote or Hybrid
75K-95K Annually
Senior level
75K-95K Annually
Senior level
Information Technology • Productivity • Professional Services • Software
Build and architect scalable cloud and on-premises monitoring solutions across infrastructure, APM, and logs. Develop custom automation scripts, create testable configuration patterns, and advise clients on observability, SRE, and DevOps best practices. The role involves working across diverse client environments, managing multiple projects, exploring AI applications in observability, and accommodating US working hours and customer onsite engagements as needed.
Top Skills: AIApplication Performance MonitoringCloud ComputingDatadogDevOpsGoInfrastructure MonitoringLinuxLog ManagementObservabilityOn-Premises InfrastructurePowershellPythonServicenowShell ScriptingSreUnix
2 Days Ago
Remote or Hybrid
31K-31K Annually
Mid level
31K-31K Annually
Mid level
Artificial Intelligence • Healthtech • Machine Learning • Natural Language Processing • Biotech • Pharmaceutical
Designs and evaluates AI agents for infrastructure operations, including workflows, prompts, retrieval, tool selection, guardrails, and regression testing. Builds ground-truth datasets and metrics to measure accuracy, precision, recall, hallucinations, and production quality. Partners with SRE and domain experts to convert operational knowledge into retrievable context, transform workflows, and reduce toil and MTTR. Requires production LLM or agent application experience, strong Python, AI evaluation expertise, and familiarity with agent frameworks and RAG.
Top Skills: Amazon Bedrock AgentcoreDynatraceLanggraphLarge Language Models (Llms)PythonRetrieval-Augmented Generation (Rag)Servicenow
2 Days Ago
Remote or Hybrid
Senior level
Senior level
Artificial Intelligence • Healthtech • Machine Learning • Natural Language Processing • Biotech • Pharmaceutical
Leads development and production deployment of AI/ML, optimization, generative AI, NLP, intelligent agents, and RPA solutions for supply chain master data. Builds predictive models, autonomous data pipelines, and automation bots; manages model monitoring, retraining, and self-healing capabilities. Partners globally with supply chain, data, and IT stakeholders to deliver phased AI enablement, translate business constraints into scalable solutions, and drive adoption and measurable impact.
Top Skills: AgileAzure Ai FoundryCplexGenerative AiGurobiKinaxisLarge Language ModelsAzureNlpPandasPower AutomatePythonPyTorchRpaScikit-LearnSQLTensorFlowUipath

What you need to know about the San Francisco Tech Scene

San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.

Key Facts About San Francisco Tech

  • Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Google, Apple, Salesforce, Meta
  • Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
  • Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
  • Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account