Build and operate the core platform for Boson AI's model APIs and agentic products: API serving, state management, distributed services, data pipelines, SDKs, retrieval and caching, observability, and integrations with ML and product teams. Grow ownership under senior mentorship while shipping production features.
About Boson AI: At Boson AI, we are not just building AI solutions; we are pioneering the future of enterprise AI. Driven by a passion for cutting-edge AI research, particularly in the transformative areas of large language models and agentic systems, our mission is to tackle the most complex real-world problems for businesses and unlock significant value. We are a dynamic and collaborative team of researchers and engineers who thrive on pushing the boundaries of what's possible, dedicated to delivering high-quality, reliable products that seamlessly integrate into the fabric of enterprise workflows and set new industry standards.
About the Role: Help build and operate the core platform behind Boson's model APIs and agentic products. You'll work alongside senior engineers on the infrastructure that every Boson agent runs on — API serving, state management, data pipelines, context retrieval, and execution runtime — shipping real features while growing into deeper ownership over time. This is a role for someone early in their career who wants to learn distributed systems by building them, with strong mentorship and meaningful production responsibility from day one.
Responsibilities
- Contribute to the core platform infrastructure: the API serving layer, state management, policy enforcement, and execution runtime for agentic workflows — starting with well-scoped components and taking on broader ownership as you grow.
- Help build and maintain distributed services that back our model API products, including request routing, rate limiting, and multi-tenant isolation, under the guidance of senior engineers.
- Build and maintain pieces of our data pipelines (ETL/ELT) for API logs, usage analytics, and billing, with a focus on data correctness and freshness.
- Develop and improve internal SDKs and libraries — writing clean, well-tested code with clear contracts that product teams can rely on.
- Support our context and memory systems for conversational workloads: retrieval, caching, and integration with vector stores and retrieval pipelines.
- Add observability across the platform — structured logging, tracing, and metrics — and help investigate and resolve reliability issues.
- Collaborate with ML and product teams to integrate model serving, voice runtime, and tooling infrastructure, learning how the full stack fits together.
Qualifications
- 0–2 years of professional software engineering experience (internships, co-ops, and strong personal or open-source projects count), or a recent CS degree with equivalent hands-on work.
- Solid programming fundamentals and a genuine interest in backend and distributed systems — you understand concepts like concurrency and fault tolerance and are eager to apply them in production.
- Some exposure to building backend services, APIs, or data processing — through work, coursework, or projects.
- Proficiency in at least one language such as Python, Go, Java, Rust, or C++, and a willingness to pick up new ones.
- Familiarity with the basics of cloud infrastructure (AWS/GCP), containers (Docker/K8s), version control, and CI/CD — or clear enthusiasm to learn them quickly.
- Curiosity, strong communication, and a collaborative mindset — you ask good questions, welcome feedback, and want to grow.
Bonus points
- Coursework, projects, or internship experience touching LLM serving, retrieval, or agentic systems.
- Exposure to data pipeline tools (Kafka/Kinesis, Spark/Flink, Airflow) or agent frameworks.
- Experience with real-time media (audio/video streaming) or any latency-sensitive system.
- A track record of shipping something end-to-end — a side project, a hackathon build, or an open-source contribution you're proud of.
Boson AI Santa Clara, California, USA Office
Santa Clara, CA , United States, 95054
Similar Jobs
Cloud • Information Technology • Insurance • Software • Analytics
Design, develop, and maintain Guidewire’s application platform, primarily focusing on backend services, APIs, microservices, and distributed systems. Ensure platform quality, scalability, availability, and security while using AI coding and automation tools. Collaborate across teams, support cloud and data platform adoption, contribute to infrastructure and frontend work as needed, and mentor junior engineers.
Top Skills:
Ai Coding ToolsAPIsAutomation ToolsDistributed SystemsInfrastructure As CodeJavaJavaScriptKubernetesMicroservicesPythonTypescript
News + Entertainment
Build and operate Netflix Cloud developer platforms, infrastructure-as-code systems, Tier-0 control planes, and AI-agent sandboxing primitives. Own the developer experience across the software delivery lifecycle, make product and platform design decisions, and ensure reliability, scalability, security, and cost efficiency. The role requires production ownership of developer platforms, strong distributed-systems expertise, comfort with ambiguity, and proficiency across multi-language, multi-service codebases.
Top Skills:
Distributed SystemsGoInfrastructure As CodeJavaKotlinSpinnaker
Productivity • Professional Services • Software • Design
Build and evolve shared Ruby frameworks and backend systems powering Figmas REST APIs, async jobs, and workflow orchestration. Improve availability, scalability, performance, developer tooling, CI, and observability while modernizing a large Ruby codebase and partnering with product engineers to create reusable platform capabilities. Mentor teammates and establish shared libraries, APIs, documentation, and best practices.
Top Skills:
Aws EksAws SqsKubernetesRuby on RailsRubySinatraTemporalTerraform
What you need to know about the San Francisco Tech Scene
San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.
Key Facts About San Francisco Tech
- Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Google, Apple, Salesforce, Meta
- Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
- Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
- Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine
