HowURun Logo

HowURun

Founding Engineer - Platform

Reposted One Month Ago
In-Office or Remote
Hiring Remotely in San Francisco, CA, USA
250K-350K Annually
Senior level
In-Office or Remote
Hiring Remotely in San Francisco, CA, USA
250K-350K Annually
Senior level
Design and own a cloud-native, low-latency platform for real-time, stateful AI inference and live video generation: manage GPU-heavy Kubernetes clusters, observability, autoscaling, security, and platform primitives while collaborating with ML teams and mentoring engineers.
The summary above was generated by AI
The problem we saw

AI inference today is slow, expensive, and stateless. Send a query, wait, get a response, reset. That's fine for batch — but AI is becoming interactive, and interactive means inference has to respond instantly, hold context across a session, and be steerable in real time.

Nobody had built an infrastructure that does all three at once. The bottleneck isn't the models. It's the runtime underneath them.

 
What we're building to fix it

uRun — Universal Runtime is the layer that makes real-time, stateful inference possible. Our platform lets AI respond instantly, hold context across a session, and be directed as it runs.

We prove it through the hardest problem in the stack: real-time AI video generation. Not pre-rendered clips. Not queued jobs. Live, steerable, continuous video that responds as you speak. Solve that, and the rest of the inference stack follows, and that's what we've done. We're an infrastructure company; we build the layer model labs, builders, and research teams ship on top of.

 
Where you come in

You'll design and own the scalable, low-latency infrastructure that powers uRun's real-time inference runtime, the platform that makes live, interactive, multi-user AI workloads possible.

This is not classic ops or cloud management. You'll be deep in the AI runtime itself, not just keeping VMs up. Latency, frame rate, and interactive quality of service are first-class platform properties, and they're yours to own. The workloads are GPU-constrained, memory-bound, and bursty, not stateless web backends, so you'll often write platform features, custom controllers, and scaling logic rather than only operating commercial tooling.

You'll report directly to our founder, Keegan McCallum, and set the technical direction the engineering organisation grows around.

 
What you'll actually be doing day-to-day
  • Design, operate, and evolve the cloud-native platform that runs uRun's real-time inference and video runtime, Kubernetes, GPU-heavy workloads, and streaming pipelines

  • Own observability, reliability, and performance at scale: SLO-driven capacity, autoscaling, failover, and cost-efficient GPU provisioning

  • Build and maintain the platform primitives that product and ML teams depend on, service meshes, deployment pipelines, secrets and credential management, and configuration-as-code

  • Partner closely with ML and video-workload engineers to optimise for low-latency inference, memory-bound workloads, and streaming data flows

  • Define and champion platform standards for security, observability, and incident response, drawing on SRE-style practices

  • Mentor and unblock other engineers, and act as a technical leader on architecture, trade-offs, and long-term platform evolution

 
What skills you need for the journey
  • 7+ years as an engineer, with a proven track record architecting and owning large-scale production systems

  • Deep Kubernetes expertise, including GPU-heavy clusters (NVIDIA tooling, autoscaling on GPU nodes) and service-mesh patterns

  • Strong cloud and infrastructure-as-code: AWS, GCP, or Azure; Terraform, Pulumi, or equivalent; networking and security (VPC, IAM, API-gateway-style routing)

  • SRE-style thinking and observability depth: Prometheus/Grafana, OpenTelemetry, distributed tracing, SLOs, incident response, and post-mortems

  • Proficiency in at least one of Python, Go, or TypeScript/Node.js for platform tooling, automation, and glue code

  • Experience with streaming or real-time systems: WebRTC, low-latency video pipelines, or comparable latency-sensitive workloads. This is central to the role, not a bonus

  • A track record of mentoring engineers and influencing cross-functional teams

 
Things that will give you an edge
  • Hands-on experience with GPU-constrained, memory-bound, or bursty workloads

  • Experience writing custom Kubernetes controllers, scaling logic, or other platform features in-house

  • Early-stage startup experience: owning ambiguous problems end-to-end and setting technical direction with limited scaffolding

 
What you'll get in return
  • Competitive salary and meaningful equity in an early-stage AI infrastructure company. The band above is our target; for an exceptional candidate we'll go higher. Equity is real, you're early, and the grant reflects that.

  • Health, dental, and vision — full coverage

  • 401(k) — company-supported retirement savings

  • FSA/HSA — flexible spending accounts for healthcare costs

  • Paid time off — we trust you to manage your time

  • Top-tier tooling — access to the best AI tools available: Claude, Codex, Kimi, and whatever else helps you move faster

  • MacBook Pro and AirPods — the hardware you need, on us

How we work (and what that feels like day-to-day)

We build the stage, not the show. We're an infrastructure company, a developer-tools company, and a production partner for model labs, and focus is a deliberate choice we've made and hold to.

Day-to-day, that means a small team, a high bar, and real ownership. You won't wait for permission or inherit a backlog of someone else's decisions, in a founding security role, the function is what you make it.

It also means ambiguity: priorities shift, not everything is documented, and you'll often be the person who decides what "secure enough, for now" means. That suits some people and not others, and we'd rather you know that before you apply.

  • Watch our launch party video

  • Read the manifesto

  • Follow us on LinkedIn

  • Follow us on X

Similar Jobs

One Month Ago
Remote
United States
Mid level
Mid level
Information Technology • Consulting
Join as a founding full-stack engineer to build an AI-native enterprise platform (agents, connectors, RAG, workflows). Own end-to-end product areas, design reusable primitives, ensure production readiness, work directly with customers, and shape roadmap and engineering practices.
Top Skills: AWSCeleryCrmsFastapiGmailGoogle CalendarLlm ApisPostgresPythonReactRetrieval SystemsSlackTypescript
20 Days Ago
Remote
USA
146K-250K Annually
Senior level
146K-250K Annually
Senior level
Edtech
Design and build internal platforms, tooling, and AI-powered workflows to reduce developer friction, improve velocity, quality, and reliability. Partner with product, infra, and security to create reusable paved paths, measure impact with engineering metrics, and help define the Developer Experience practice.
Top Skills: Ai-Assisted DevelopmentAi-Powered WorkflowsCi/CdDeveloper EnvironmentsDeveloper ToolingDoraInternal Developer PlatformsRelease EngineeringSoftware Delivery SystemsSpace
13 Minutes Ago
Remote
United States
152K-177K Annually
Senior level
152K-177K Annually
Senior level
Healthtech • Social Impact • Software • Telehealth
Designs and builds Salesforce architecture supporting patient, clinician, insurance, and operational workflows. Responsibilities include Salesforce development and automation, system integrations, data modeling, security, monitoring, recovery, technical standards, deployment processes, stakeholder alignment, and mentoring. The role requires architecture ownership for complex implementations and experience in regulated or HIPAA-compliant environments is preferred.
Top Skills: Automated Deployment ToolingSalesforceSalesforce ApexSalesforce AutomationSalesforce Data 360Salesforce Data CloudVersion Control

What you need to know about the San Francisco Tech Scene

San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.

Key Facts About San Francisco Tech

  • Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Google, Apple, Salesforce, Meta
  • Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
  • Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
  • Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account