Fluency (usefluency.com) Logo

Fluency (usefluency.com)

Software Engineer, AI Platform

Reposted 9 Days Ago
In-Office
San Francisco, CA, USA
150K-250K Annually
Mid level
In-Office
San Francisco, CA, USA
150K-250K Annually
Mid level
The Software Engineer will maintain and evolve the data platform, run LLM ETL pipelines, transform agent outputs, improve system reliability, and support incident response.
The summary above was generated by AI

We're hiring a full-time Software Engineer, AI Platform to own the data platform, ETL pipelines, and agent infrastructure that everything else at the company runs on.

 

This is the platform layer that makes Fluency's AI work reliable, observable, and usable in production. It moves data through LLMs, transforms agent outputs into structured downstream data, runs jobs reliably, and keeps the system fast, cheap, and observable as we scale.

 

Because we're an early-stage company moving fast, we're looking for an engineer who can build the platform, keep it running, and make tradeoffs while priorities shift. This is an in-person role, 5 days a week in our office. The ability to balance reliability with iteration speed is essential.

 
Key Responsibilities
  • Own the data platform: Maintain and evolve the platform that powers every job across the company.

  • Run the LLM ETL pipeline: Ingestion, transformation, enrichment, and storage of LLM-driven data.

  • Build agent transformation infrastructure: The systems that take agent outputs and turn them into structured, queryable data downstream.

  • Improve reliability, throughput, and cost of LLM-driven jobs in production.

  • Build observability and tooling so the team can debug and iterate quickly.

  • Partner with AI Engineers: Expose new capabilities through the platform and shape the interfaces they build on.

  • Operate the system: Participate in on-call rotation and incident response.

 
What We Are Looking For
  • Strong Python engineering experience supporting production systems (FastAPI or similar)

  • Experience building or maintaining production pipelines that handle non-trivial volume, retries, backfills, and failure recovery

  • Hands-on experience with a data orchestrator (Dagster, Airflow, Prefect, or Temporal) and dbt or similar transformation tooling

  • Comfort with PostgreSQL at scale: schema design, multi-schema setups, and migrations

  • Comfort with AWS infrastructure (ECS, Lambda, SQS, Step Functions, RDS, S3) and IaC (Terraform / Terragrunt)

  • Familiarity with LLM APIs and the operational realities of LLM-based systems (latency, cost, retries, structured output, failure modes)

 
Nice to Have
  • Experience with distributed compute for Python workloads: Anyscale Ray, Dask, or Spark

  • Experience with Polars and Pandas for data processing

  • Familiarity with Datadog for observability, metrics, and tracing

  • Cost optimization experience for LLM workloads

  • Familiarity with pgvector or other vector stores

  • Multi-region AWS deployment experience

  • Some TypeScript/Node experience, since parts of the platform live there

 
About Fluency

Fluency builds a platform that captures how work actually happens inside large organizations, measures productivity and process conformance, and analyzes where AI can do the work.

 

We capture observable work data across tools and systems, structure it into a model of how work runs, and use it to measure productivity, check process conformance, and analyze where AI changes the work.

 

Fluency is looking for a Software Engineer, AI Platform to build the data platform, LLM pipelines, and agent infrastructure that every AI feature at the company runs on, deployed across Fortune 500 organizations.

 
Our Customers

Customers include CVS Health, Aon, and PVH.

 
Location
  • Full-time, in-person role based in San Francisco, CA.

  • We offer E-3 sponsorship for Australians to relocate with stipend.

 
This role is not a fit if
  • You want hybrid or remote

  • You're not comfortable with rapid iteration

  • You haven't owned production systems

  • You've never operated production pipelines

  • You don't want to be on-call

  • You dislike constraints (we have them: cost, latency, reliability tradeoffs are real)

  • Requirements need to be locked down before you can move

 
Hiring Process
  • Resume screen

  • 1:1 with founder

  • Technical deep-dive on past data platform or backend engineering work

  • Work through a real problem with the team

  • Offer

 

We strongly encourage applicants from underrepresented backgrounds to apply. Diverse teams build better products.

 
Compensation & Benefits
  • Base salary: US$180,000 to US$250,000

  • ESOP: Available

  • US$1,000 per month food and commuting allowance

  • Laptop of choice

HQ

Fluency (usefluency.com) San Francisco, California, USA Office

San Francisco, CA, United States

Similar Jobs

3 Days Ago
Hybrid
San Francisco, CA, USA
158K-260K Annually
Senior level
158K-260K Annually
Senior level
Artificial Intelligence • Fintech • Payments • Business Intelligence • Financial Services • Generative AI
Lead architecture and build of a global, high‑performance data and AI platform. Own design, performance tuning, and SDLC for distributed systems (streaming, storage, indexing) powering real‑time analytics, vector search, and AI-driven products. Mentor engineers and drive engineering rigor and shared tooling.
Top Skills: AirflowBigQueryDatabricksDataflowDataprocFlinkGCPGoGoogle Cloud StorageJavaKafkaKotlinKubernetesMcpOlap EnginesRagSparkVector Indexing
4 Days Ago
Hybrid
San Francisco, CA, USA
202K-255K Annually
Senior level
202K-255K Annually
Senior level
Enterprise Web • Greentech • Software
Design and build agent infrastructure and orchestration for AI-driven products; implement observability, tracing, evals, guardrails, and tooling to deploy, monitor, and improve LLM-based systems in production.
Top Skills: Agent InfrastructureAgent ObservabilityDistributed TracingEmbeddingsEvalsGuardrailsHarnessesLlmsMachine LearningModel EvaluationTypescript
4 Days Ago
In-Office
Pleasanton, CA, USA
148K-264K Annually
Senior level
148K-264K Annually
Senior level
Cloud • Fintech • HR Tech
Lead design and delivery of high-throughput, low-latency APIs and backend services. Define API standards (REST, GraphQL, OpenAPI), drive performance, observability, scalability, and resiliency. Coach engineers, participate in design reviews and incident response, and build frameworks to simplify API development for product teams.
Top Skills: Claude CodeCursorGitGithub CopilotGraphQLJacocoJunitMcpMockitoOpenapiPostmanPythonRestScalatestScoverageSoapSwaggerTypescript

What you need to know about the San Francisco Tech Scene

San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.

Key Facts About San Francisco Tech

  • Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Google, Apple, Salesforce, Meta
  • Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
  • Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
  • Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account