Julius AI Logo

Julius AI

Software Engineer - Infrastructure (Mid - Senior)

Reposted 2 Days Ago
In-Office
San Francisco, CA, USA
150K-200K Annually
Mid level
In-Office
San Francisco, CA, USA
150K-200K Annually
Mid level
You will design and manage secure multi-tenant container infrastructure for scaling code execution sandboxes across cloud environments, ensuring performance and reliability.
The summary above was generated by AI

Compensation: Competitive base salary and meaningful equity

Benefits: Health & dental insurance, gym reimbursement, daily team meals, commuter benefits

We’re an applied AI lab building coding agents. Julius executes ~1M lines of code every 36 hours for 1M+ users and has generated 3M+ visualizations. All code runs in code sandboxes (isolated remote containers) that we manage. We’re revenue‑generating and backed by AI Grant, YCombinator, Bessemer Venture Partners and the founders from Vercel, Notion, Perplexity, Palantir, Replit, Zapier, Intercom, and Dropbox.

The Role

Build and scale the code‑execution sandboxes that power Julius across cloud environments (AWS and GCP). We orchestrate 500k+ containers/month and growing. You’ll own reliability, performance, and security for multi‑tenant compute.

What You’ll Do

  • Design and operate secure, multi‑tenant container infrastructure with fast startup and smart autoscaling.

  • Ship cloud deployments (Helm/Terraform) with SSO, network controls, and audit logging.

  • Drive observability (metrics, traces, logs) with clear SLOs; lead incident response.

  • Optimize images, scheduling, networking, and cost ; build fair‑use and rate‑limiting controls.

What You Bring

  • Production Kubernetes and container internals (Docker/containerd); strong networking fundamentals.

  • Cloud (AWS/GCP/Azure) and IaC (Terraform/Helm).

  • Monitoring/Logging (Prometheus, Grafana, OpenTelemetry, ELK/Vector).

  • Security best practices for containerized, multi‑tenant systems.

Nice to Have

  • gVisor/Kata/Firecracker; Cilium/eBPF; GPU scheduling; serverless autoscaling (KEDA/Knative/Karpenter).

  • You’ve built an AI side project and enjoy tinkering with LLMs.

Why Julius

Small, senior team; massive impact surface; hard infra problems at meaningful scale.

HQ

Julius AI San Francisco, California, USA Office

San Francisco, CA, United States

Similar Jobs

8 Days Ago
In-Office or Remote
2 Locations
240K-500K Annually
Senior level
240K-500K Annually
Senior level
Software
Lead the Core Infrastructure team, focusing on Kubernetes platform ownership, multi-region expansion, AI infrastructure development, and enhancing security and performance.
Top Skills: Ai InfrastructureEksKubernetesNetworkingObservability
An Hour Ago
Hybrid
309K-418K Annually
Expert/Leader
309K-418K Annually
Expert/Leader
Artificial Intelligence • Internet of Things • Semiconductor
Architect and design high-volume SoC platforms using Arm IP across mobile, automotive, datacenter, networking and IoT. Lead cross-functional teams to define platform architecture, optimize performance and power, coordinate IP delivery, drive partner engagements, and influence roadmap and feature development. Guide specification maturity and ensure on-time delivery while driving innovation and continuous improvement.
Top Skills: 2.5D Packaging3D PackagingArm IpClockingCoherent InterconnectCxlDram Memory TechnologiesFunctional Profiling And DebugHeterogeneous Compute ArchitecturesMemory HierarchiesMulti-Level CachingNon-Coherent InterconnectPciePerformance And Power ModelingPower ManagementSecurity And Access ControlSocSoft Real-Time AcceleratorsVirtualization
An Hour Ago
Hybrid
Milpitas, CA, USA
15-24 Hourly
Entry level
15-24 Hourly
Entry level
eCommerce • Fashion • Retail • Sales • Wearables • Design
Serve customers as a trusted stylist by greeting guests, demonstrating product knowledge, providing styling advice, and creating complete looks. Drive sales through customer connections, storytelling, and operational excellence (stockroom organization, POS). Support team collaboration, omni-channel selling, flexible scheduling, and light physical tasks including lifting up to 50 lbs.

What you need to know about the San Francisco Tech Scene

San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.

Key Facts About San Francisco Tech

  • Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Google, Apple, Salesforce, Meta
  • Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
  • Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
  • Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account