CHAI AI Logo

CHAI AI

Staff Software Engineer

Reposted 13 Hours Ago
Be an Early Applicant
In-Office
Palo Alto, CA, United States
609K-1M Annually
Junior
In-Office
Palo Alto, CA, United States
609K-1M Annually
Junior
Own AI model-serving infrastructure for a platform with 10 million users. Optimize model fit within fixed GPU budgets, improve serving speed and latency, manage cost per token, determine when to optimize or rebuild systems, and plan capacity expansion. The role requires high ownership, comfort with ambiguity, and in-person work at the Palo Alto office.
The summary above was generated by AI

**About CHAI AI**

CHAI is a social AI platform where millions of people create, share, and talk to AI characters. As of Sep 2026, it has 10 million active users and $100 million ARR. After receiving over $55M in funding from investors such as AMD and CoreWeave, CHAI AI is actively hiring engineers to expand its team.

**About the team**

Engineering is 15–20 people with a flat structure. High impact on the product, fast iteration, and clear metrics to measure against.

**What you will work on**

Fit a fleet of models into a fixed GPU budget and keep them fast for 10M users. You'll own serving infrastructure, latency, and cost per token — deciding what to optimize, what to rebuild, and when to add capacity.

**You might thrive in this role if you…**

- 2+ years of software engineering experience
- High motivation and talented.
- High ownership: comfortable with ambiguity, able to define the problem and the plan rather than execute a predefined spec.
- Able to work in person at our Palo Alto Office.

**Compensation and benefits**

Top pay AI startup in Bay Area. $609,000 – $1,050,000, paid 100% in cash.

We benchmark against total comp at Meta, Google, and OpenAI — and pay that number in cash, not equity, with the option to trade a portion of cash for stock options.

Health, 401k, unlimited PTO.

**Our interview process**

We run a fast process - an offer can be given within 7 days of first contact.

1. 20 minute phone screen with our founder or engineer
2. 20 minute personality assessment
3. Take home assessment. 60-90 minutes to complete.
4. One day onsite interview.

CHAI AI Palo Alto, California, USA Office

555 Hamilton Ave, Suite 300, Palo Alto, California, United States, 94301 2015

Similar Jobs

7 Hours Ago
Hybrid
Mountain View, CA, USA
201K-352K Annually
Senior level
201K-352K Annually
Senior level
Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
Build and own distributed runtime infrastructure for Moveworks AI agents, including orchestration state machines, session management, event-driven pipelines, asynchronous concurrency, observability, caching, and state layers. Design systems supporting multi-step workflows, tool calls, human interaction, crash recovery, real-time streaming, and low-latency operation at enterprise scale.
Top Skills: Amazon SqsApache KafkaAsyncioDynamoDBGoGrpcOpentelemetryPrometheusProtocol BuffersPythonRedisSocket.Io
Yesterday
Remote or Hybrid
7 Locations
264K-395K Annually
Expert/Leader
264K-395K Annually
Expert/Leader
eCommerce • Fintech • Hardware • Payments • Software • Financial Services
Lead technical strategy for Cash App Banking’s server engineering team, drive architecture and infrastructure improvements, contribute hands-on code, make cross-functional technical decisions, and mentor engineers. Build robust, scalable financial systems using modern backend technologies and event-driven microservices. Apply an AI-first mindset while delivering large-scale banking features and maintaining high engineering standards.
Top Skills: AuroraAWSBuildkiteDatadogDynamoDBEvent-Driven ArchitectureGradleGrpcGuiceHibernateHTTPJavaJettyJSONJunitKafkaKotlinMicroservicesMySQLOkhttpProtocol BuffersRedis
Yesterday
Remote or Hybrid
Sunnyvale, CA, USA
189K-280K Annually
Senior level
189K-280K Annually
Senior level
Automotive • Big Data • Information Technology • Robotics • Software • Transportation • Manufacturing
Architect and build production-quality machine learning software for imitation-learning-based autonomous driving behavior. Develop scalable data preparation, training, evaluation, simulation, and deployment workflows; optimize CPU/GPU and distributed performance; integrate reinforcement learning and model interfaces; and improve reproducibility, testing, and reliability. Lead cross-team technical initiatives and mentor engineers while ensuring consistency across training, simulation, and on-vehicle inference.
Top Skills: C++Closed-Loop SimulationDistributed TrainingGpuGpu ProfilingMl Runtime OptimizationModel CompilationModel DeploymentPythonPyTorchReinforcement Learning

What you need to know about the San Francisco Tech Scene

San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.

Key Facts About San Francisco Tech

  • Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Google, Apple, Salesforce, Meta
  • Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
  • Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
  • Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account