Top Tech Jobs & Startup Jobs in San Francisco Bay Area, CA

This role involves optimizing model serving layers for voice AI applications, working with inference engines, and improving performance for STT and TTS systems.

Design and implement a scalable observability platform (metrics, logs, traces) using Prometheus, Grafana, ClickHouse/ClickStack, and OpenTelemetry. Build telemetry pipelines, automated monitoring, SLIs/SLOs, alerting, anomaly detection, and runbooks. Develop IaC and custom tools with Go, Python, Terraform, Ansible, and Helm. Collaborate on distributed tracing, lead incident response, and define observability best practices.

Design, deploy, and maintain large-scale hybrid data center networks; troubleshoot and analyze network issues; develop automation and tooling; evaluate and recommend hardware/software; manage vendor relationships; ensure reliability, scalability, and compliance; lead complex network projects and contribute to architecture and roadmaps.

The Manager will analyze and benchmark compute infrastructure sourcing and operations, driving strategic decisions and optimizing resource allocation across sites and vendors.

Develop and maintain a platform for customizing open-source models, integrating Model Shaping with Inference, adding inference engine features and RL optimizations, ensuring production stability and 24/7 availability, and collaborating with product, research, and engineering teams to support fine-tuning, RL, and evaluation workflows.

As an AI Infrastructure Engineer, you will manage user-facing services, ensure system reliability, and improve infrastructure using automation tools such as Ansible and Terraform while collaborating with various stakeholders.