Harvey Logo

Harvey

Senior Software Engineer, Backend Platform

Posted 5 Days Ago
Be an Early Applicant
In-Office
San Francisco, CA
200K-260K Annually
Senior level
In-Office
San Francisco, CA
200K-260K Annually
Senior level
As a Backend Platform Engineer, you will build and operate the backend platform, improve developer experience, create APIs, and enhance system reliability and performance.
The summary above was generated by AI
Why Harvey

At Harvey, we’re transforming how legal and professional services operate — not incrementally, but end-to-end. By combining frontier agentic AI, an enterprise-grade platform, and deep domain expertise, we’re reshaping how critical knowledge work gets done for decades to come.

This is a rare chance to help build a generational company at a true inflection point. With 700+ customers in 58+ countries, strong product-market fit, and world-class investor support, we’re scaling fast and defining a new category in real time. The work is ambitious, the bar is high, and the opportunity for growth — personal, professional, and financial — is unmatched.

Our team is sharp, motivated, and deeply committed to the mission. We move fast, operate with intensity, and take real ownership of the problems we tackle — from early thinking to long-term outcomes. We stay close to our customers — from leadership to engineers — and work together to solve real problems with urgency and care. If you thrive in ambiguity, push for excellence, and want to help shape the future of work alongside others who raise the bar, we invite you to build with us.

At Harvey, the future of professional services is being written today — and we’re just getting started.

Role Overview

As a Backend Platform Engineer at Harvey, you will help build and operate the cohesive backend platform that all our services run on. In this mid-to-senior level role, you’ll design and implement shared frameworks and libraries that abstract common concerns, improve developer experience, and raise the baseline for reliability and performance across all teams. Your mission aligns with our platform charter: create “a shared foundation that enables product teams to ship reliable, observable, and performant experiences quickly and safely.” By centralizing common work, you’ll let product engineers focus on shipping features rather than re-inventing the wheel. This is a high-impact role where the code you write and the systems you build will amplify the productivity and quality of engineering across the entire company.

If you’re excited about building foundational systems, solving cross-cutting technical challenges, and enabling others to move faster with confidence, we’d love to hear from you.

This role is based in San Francisco, CA. We use an in-person work model (3 days a week) and offer relocation assistance to new employees.

What You’ll Do
  • Develop and maintain Harvey’s internal backend frameworks and libraries that provide common capabilities (API routing, service lifecycle management, caching and messaging primitives, error handling interfaces, etc.), so product teams don’t have to reinvent them

  • Create and improve APIs, service templates, and versioned interfaces that establish consistent patterns for building new services and features

  • Introduce and champion modern backend architecture patterns like asynchronous I/O (asyncio) and streaming data processing, continually evolving our platform for better performance and scalability

  • Design Harvey-specific abstractions and domain-specific frameworks—covering cross-cutting concerns (e.g., authorization, streaming) and areas like data governance and event processing—to provide product engineers with these capabilities out of the box.

  • Embed reliability and observability into the platform by building in tracing, metrics, and automated tests (shift-left), ensuring services built on our foundation are robust and easy to monitor

  • Collaborate with Model Infrastructure team to tackle challenges unique to GenAI-native applications — such as supporting high-throughput model inference, managing streaming and long-running API interactions, and designing abstractions for retrieval, context handling, and prompt lifecycle

  • Collaborate with the Developer Experience and Infrastructure teams (who own CI/CD pipelines, build tools, and release infrastructure) to integrate our platform components seamlessly into the deployment and monitoring ecosystem

  • Work closely with product engineering teams to gather feedback, evangelize best practices, and make the “paved road” approach a reality — providing strong defaults and clear documentation so teams can move fast with confidence

What You Have
  • 7+ years of software engineering experience (post-BS/MS), including building scalable backend systems or internal developer platforms

  • Proficiency in Python (or similar languages) and deep knowledge of backend development fundamentals (APIs, data stores, concurrency, distributed systems)

  • Hands-on experience with web frameworks and service architectures (e.g. Flask/FastAPI, Bounded context services, microservices) and an understanding of designing clean, versioned APIs

  • Familiarity with caching, messaging, and database technologies (Redis, Kafka, SQL/NoSQL databases, Vector databases, etc.) and how to use them effectively for high performance and reliability

  • A track record of writing high-quality, well-tested code and using tools (unit/integration testing, static typing, CI) to catch issues early and ensure reliability

  • Strong problem-solving skills and a passion for improving developer experience — you enjoy creating tools or frameworks that make other engineers more productive

  • Excellent collaboration and communication skills, with the ability to work across teams and incorporate feedback.

  • Experience contributing to or maintaining internal libraries/frameworks is a plus.

Compensation Range

$175,000 - $250,000 USD

Please find our CA applicant privacy notice here.

Harvey is an equal opportunity employer and does not discriminate on the basis of race, gender, sexual orientation, gender identity/expression, national origin, disability, age, genetic information, veteran status, marital status, pregnancy or related condition, or any other basis protected by law.

We are committed to providing reasonable accommodations to applicants with disabilities, and requests can be made by emailing [email protected]

Top Skills

Fastapi
Flask
Kafka
NoSQL
Python
Redis
SQL
Vector Databases
HQ

Harvey San Francisco, California, USA Office

San Francisco, California, United States

Similar Jobs

3 Days Ago
In-Office
Redwood City, CA, USA
145K-187K Annually
Senior level
145K-187K Annually
Senior level
Artificial Intelligence • Big Data • Machine Learning • Software
Design and develop distributed system components and data infrastructures for AI/ML applications, ensuring scalability and performance while collaborating across teams.
Top Skills: SparkAWSAzureC#C++CassandraHdfsJavaKoalasPandasPostgresPythonRaySnowflake
17 Days Ago
In-Office
Costa Mesa, CA, USA
191K-253K Annually
Mid level
191K-253K Annually
Mid level
Aerospace • Artificial Intelligence • Hardware • Robotics • Security • Software • Defense
As a Software Engineer on the Maritime Digital Production team, you'll develop backend services and data pipelines for a digital shipbuilding ecosystem, ensuring scalability and reliability while collaborating with various teams.
Top Skills: AWSAzureDockerGCPGoJavaKubernetesMongoDBMySQLPostgresPython
3 Days Ago
In-Office
2 Locations
255K-405K Annually
Mid level
255K-405K Annually
Mid level
Artificial Intelligence • Machine Learning • Generative AI
As a Backend Software Engineer, you will design, build, and maintain backend services and APIs for automated knowledge systems, collaborating with cross-functional teams.
Top Skills: FastapiPostgresPython

What you need to know about the San Francisco Tech Scene

San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.

Key Facts About San Francisco Tech

  • Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Google, Apple, Salesforce, Meta
  • Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
  • Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
  • Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account