Judgment Labs Logo

Judgment Labs

Senior Backend Engineer

Posted 6 Days Ago
Be an Early Applicant
In-Office
San Francisco, CA, USA
Senior level
In-Office
San Francisco, CA, USA
Senior level
Design and build high-throughput backend services and APIs to ingest, evaluate, and serve agent telemetry at scale. Own API contracts and versioning, optimize ClickHouse OLAP schemas and queries for petabyte-scale reads, collaborate with platform/infra on reliability and scalability, and uphold high engineering quality.
The summary above was generated by AI
The Role

We're looking for a Senior Backend Engineer to own the services and APIs that power the data layer. You'll design the systems that ingest, evaluate, and serve agent telemetry at scale.

What You'll Do
  • Design and build high-throughput backend services that ingest and process hundreds of thousands of agent traces per second.

  • Own the API surface our SDKs and dashboards depend on: define contracts, manage versioning, and keep latency low under real customer load.

  • Tune our OLAP layer (ClickHouse) through schema design, query optimization, and access-pattern analysis so reads stay fast as data grows to petabyte scale.

  • Partner with the platform and infra teams on scalability, reliability, and the systems that back our evaluation and monitoring pipelines.

  • Advocate for a high bar on backend and engineering quality: reliable, efficient, well-documented, testable, and maintainable.

What We're Looking For
  • 6+ years of relevant industry experience building and operating high-throughput backend systems and services.

  • Strong fundamentals in API design, data modeling, and the trade-offs of distributed systems under real production load.

  • Hands-on experience with OLAP / columnar databases (ClickHouse, Presto) and a feel for how query patterns map to storage internals.

  • Experience designing high-performance distributed systems.

  • Comfort across the stack, with the breadth to reason about platform and infra decisions.

  • Strong communication skills. You write clearly, review well, and make the people around you better.

Nice to Have
  • Experience scaling pipelines that fan out to LLM APIs and managing the rate-limit, retry, and cost dynamics that come with them.

  • Familiarity with streaming systems (Kafka, Spark, Flink, Ray) and ML orchestration tools (Airflow, Dagster, Prefect).

  • Background in embedding / vector search infrastructure or data quality monitoring.

  • Prior work on observability or developer-facing platform products.

HQ

Judgment Labs San Francisco, California, USA Office

425 Bush St, San Francisco, California, United States, 94108 3708

Similar Jobs

4 Days Ago
Hybrid
San Francisco, CA, USA
150K-245K Annually
Senior level
150K-245K Annually
Senior level
Artificial Intelligence • Fintech • Payments • Business Intelligence • Financial Services • Generative AI
Design and operate scalable, event-driven backend systems in Python to power agentic AI workflows and real-time financial infrastructure. Own APIs, data architecture, reliability primitives, and platform foundations while partnering with ML and product teams to productionize AI-native financial systems.
Top Skills: BigQueryCloud SqlFastapiGCPGoogle Cloud Pub/SubGoogle Cloud RunGoogle KmsNoSQLPydanticPythonSQL
10 Days Ago
Easy Apply
Remote or Hybrid
San Francisco, CA, USA
Easy Apply
188K-206K Annually
Senior level
188K-206K Annually
Senior level
Fintech • Mobile • Software • Financial Services
Lead development, testing, and migration of core banking systems. Shape technical architecture, translate product requirements into technical solutions, deliver scalable high-availability services, support integrations, and mentor the engineering team while owning project delivery.
Top Skills: Fis ProfileGt.MLinuxMumpsPslService-Oriented ArchitectureUnix
19 Days Ago
Hybrid
142K-189K Annually
Senior level
142K-189K Annually
Senior level
Digital Media • Information Technology • News + Entertainment
Lead the design and development of backend systems for a video streaming platform, including API design, database management, and system integration.
Top Skills: AWSAzureDockerGCPJavaKubernetesLinuxMongoDBMySQLOraclePostgresRestSoap

What you need to know about the San Francisco Tech Scene

San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.

Key Facts About San Francisco Tech

  • Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Google, Apple, Salesforce, Meta
  • Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
  • Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
  • Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account