Formal Logo

Formal

Software Engineer | Infra

Posted 5 Days Ago
In-Office
San Francisco, CA, USA
Entry level
In-Office
San Francisco, CA, USA
Entry level
Build and operate scalable cloud and on-prem infrastructure, lead Kubernetes migration, improve Kafka-to-Quickwit ingestion and search performance, automate provisioning with Terraform and Helm, establish observability and reliability targets, and manage incidents, upgrades, backups, and recovery.
The summary above was generated by AI
About Formal

Formal is building a network security platform for the AI era. As agents gain access to sensitive data and production systems, organizations need control over the actions they take and the data they receive. We enforce those controls directly in the network path, with a shared policy layer for humans and agents across databases, infrastructure, APIs, and AI tools.

We are trusted by leading companies such as Cursor, Decagon, Notion, and more to solve problems across data security and compliance, data quality management, and infrastructure access.

Formal is backed by top-tiers VCs including Thrive Capital and Y Combinator with angel investors that include executives and founders from Datadog, Clickhouse, Plaid, and Vanta.

About the role

Formal secures billions of requests daily. Join a small team tackling the infrastructure behind that scale: Kafka-to-Quickwit log ingestion, fast search and APIs, and reliable cloud and on-prem deployments. You'll help lead our move to Kubernetes and make the platform easier to deploy, operate, and upgrade in our cloud and customer environments.

What you'll do
  • Lead our migration to Kubernetes and operate reliable clusters, networking, access controls, and data services.

  • Scale Kafka-to-Quickwit ingestion and search; improve throughput, indexing lag, API latency, and storage costs.

  • Build repeatable on-prem installations and upgrades, including configuration, data migrations, and rollback.

  • Establish useful alerts and reliability targets; lead incident response and eliminate recurring failures.

  • Automate provisioning with Terraform and Helm; improve CI/CD, capacity planning, backups, and recovery.

What you need
  • Experience building and operating production cloud infrastructure on AWS or Google Cloud using Terraform.

  • Experience operating production Kubernetes clusters, including deployments, ingress, autoscaling, and upgrades.

  • Strong Linux and networking fundamentals, including DNS, TLS, and load balancing.

  • Experience with Go, Python, Rust, or another relevant programming language.

  • Experience with CI/CD, observability, and operating data pipelines or distributed APIs in production.

  • A track record of automating operational work and owning services through incidents and upgrades.

Nice-to-haves
  • Experience deploying and supporting on-prem software across customer networks and infrastructure.

  • Experience with Quickwit or similar search systems, Kafka, PostgreSQL, or Temporal.

  • Experience with Helm, Bazel, self-hosted CI runners, or environments for AI coding agents.

Compensation
  • This role offers cash compensation and a stock options grant.

  • The positioning of offers within a certain range depends on various factors, including: candidate experience, qualifications, skills, business requirements and geographical location.

Benefits (for U.S.-based full-time employees)
  • 100% medical, dental & vision insurance coverage for you

    • Partially covered for your dependents

  • Flexible PTO

HQ

Formal San Francisco, California, USA Office

374 Brannan St, San Francisco, California, United States, 94107

Similar Jobs

12 Days Ago
In-Office
Sunnyvale, CA, USA
232K-258K Annually
Senior level
232K-258K Annually
Senior level
Logistics • Transportation • 3PL: Third Party Logistics
Develop scalable ML infrastructure for autonomous vehicle use cases within Uber AV Labs. Responsibilities include designing multi-region, multi-cloud platforms; customizing Uber’s ML platform; aligning infrastructure and AV teams; executing technical projects from conception through production; and optimizing GPU efficiency. The role requires expertise in CUDA, TensorRT, Kubernetes, Flyte or Airflow, and Ray, along with at least six years of experience and a computer science degree.
Top Skills: AirflowCloud InfrastructureCudaDistributed Batch ProcessingFlyteGpu OptimizationKubernetesMl PlatformsRayTensorrt
12 Days Ago
In-Office
2 Locations
202K-224K Annually
Senior level
202K-224K Annually
Senior level
Logistics • Transportation • 3PL: Third Party Logistics
Design and build scalable ML infrastructure and backend systems for high-impact marketplace applications. Lead architecture, solve low-latency and high-correctness problems, develop and adopt engineering frameworks, and create production-ready technical roadmaps. Partner with Product, Science, and Operations while mentoring engineers and improving engineering standards. The role requires experience with ML models, foundational models or LLMs, MLOps, Kubernetes, data pipelines, distributed workflows, and large-scale scheduling.
Top Skills: Data PipelinesDistributed Workflow SystemsKubernetesLarge-Scale Job SchedulingLlmsMl InfrastructureMlopsPyTorchTensorFlow
28 Days Ago
In-Office
Santa Clara, CA, USA
180K-326K Annually
Entry level
180K-326K Annually
Entry level
Software
Build and scale an enterprise Retrieval-Augmented Generation platform using Go and Python. Develop full-stack features, backend microservices, frontend interfaces, and AI/ML integrations in partnership with NVIDIA engineering teams. Own features from concept through production, while improving system performance, testing, security, availability, and reliability. Apply hands-on expertise in RAG, LLM pipelines, and AI-driven data retrieval architectures to deliver low-latency enterprise capabilities.
Top Skills: GoLarge Language Models (Llms)MicroservicesModel Acceleration LibrariesNvidia Ai ToolingPythonRetrieval-Augmented Generation (Rag)

What you need to know about the San Francisco Tech Scene

San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.

Key Facts About San Francisco Tech

  • Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Google, Apple, Salesforce, Meta
  • Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
  • Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
  • Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account