Jobs at Together AI

As a Senior Developer Productivity Engineer, you will enhance CI/CD processes, optimize workflows, and build tools for efficient software delivery.

Provide legal support for infrastructure procurement and enterprise commercial deals. Lead negotiations for GPU/cloud capacity, data center, networking, and vendor agreements; align vendor terms with customer contracts; manage export controls and data/privacy compliance; build templates, playbooks, and scalable procurement and sales workflows; support partnerships, reseller and go-to-market deals; and run procurement processes and vendor template libraries.

This role involves optimizing model serving layers for voice AI applications, working with inference engines, and improving performance for STT and TTS systems.

The Staff Machine Learning Engineer will optimize the inference layer for voice applications, focusing on model serving and real-time audio processing. Responsibilities include driving performance architecture, collaborating with model partners, and developing evaluation frameworks for STT and TTS models.

Provide hands-on IT support for in-office and remote employees across identity, devices, SaaS, and procurement. Administer Okta and MDM (macOS/Linux), manage asset lifecycle, create documentation and automations, support onboarding/offboarding, basic network/A/V troubleshooting, and contribute to security hygiene and IT projects.

Design and implement a scalable observability platform (metrics, logs, traces) using Prometheus, Grafana, ClickHouse/ClickStack, and OpenTelemetry. Build telemetry pipelines, automated monitoring, SLIs/SLOs, alerting, anomaly detection, and runbooks. Develop IaC and custom tools with Go, Python, Terraform, Ansible, and Helm. Collaborate on distributed tracing, lead incident response, and define observability best practices.

Design, deploy, and maintain large-scale hybrid data center networks; troubleshoot and analyze network issues; develop automation and tooling; evaluate and recommend hardware/software; manage vendor relationships; ensure reliability, scalability, and compliance; lead complex network projects and contribute to architecture and roadmaps.

Research intern contributing to agentic AI: develop and implement novel training methods, design experiments and datasets, evaluate agent behavior and safety, document findings, and communicate results to the team.

The Manager will analyze and benchmark compute infrastructure sourcing and operations, driving strategic decisions and optimizing resource allocation across sites and vendors.

Work on developing and optimizing GPU-accelerated kernels and algorithms for ML/AI. Collaborate with modeling, hardware, and software teams to co-design GPU kernels and architectures, integrate GPU solutions, and profile and optimize performance using GPU profiling tools.

Develop and maintain a platform for customizing open-source models, integrating Model Shaping with Inference, adding inference engine features and RL optimizations, ensuring production stability and 24/7 availability, and collaborating with product, research, and engineering teams to support fine-tuning, RL, and evaluation workflows.

As an AI Infrastructure Engineer, you will manage user-facing services, ensure system reliability, and improve infrastructure using automation tools such as Ansible and Terraform while collaborating with various stakeholders.

Build and ship customer-facing visibility features (events, audit logs, timelines, notifications, analytics) for Together's Cloud. Partner with Data Platform and Observability teams to implement data collection and processing, own scoped backend work end-to-end, write well-tested backend and product code, and maintain data freshness, completeness, and correctness for trustworthy customer insights.

Build, profile, and optimize Together AI's large-scale training infrastructure. Integrate and validate new model architectures, eliminate performance bottlenecks across compute/memory/communication, and productionize research methods. Enable reliable, scalable fine-tuning for customers and maintain experimental infrastructure to accelerate research-to-production workflows.

The Solutions Architect will act as a technical advisor, collaborate on AI solutions, run demonstrations, and ensure customer success by integrating technical solutions with business needs.

Lead the design of AI developer tools: own end-to-end product UX, evolve and maintain a production design system, conduct user research, prototype and ship features, and partner with engineering and product to ensure high implementation quality and cross-product consistency.

The Infrastructure Design Engineer will design and execute whitespace environments for AI data centers, ensuring optimal power, cooling, and networking support. Responsibilities include collaborating with engineers and contractors, creating CAD/BIM models, and overseeing project compliance with engineering standards.

Serve as the named technical owner for a strategic customer, managing end-to-end GPU infrastructure (compute, networking, storage, facilities). Lead incident lifecycle, RCAs, RMA coordination, observability, capacity expansions, and cross-functional escalation while driving technical roadmaps and executive communications.

Build and ship full-stack features across Together AI's product surfaces (Playground, Model Garden, Fine-Tuning, File Management, Batch Processing, Model Evals). Own projects end-to-end from data model and API design to UI, instrument product analytics, monitor system health, and collaborate with design and product to deliver user value while improving frontend and full-stack quality.

Own and ship Commerce frontend features end-to-end: build typed React/Next.js UIs, consume APIs, ensure accessibility and observability, handle billing/payment edge cases, and iterate on product UX with product, design, and backend partners.