MLabs Logo

MLabs

Staff Software Engineer - Backend & AI Infra

Posted 3 Days Ago
Remote
Hiring Remotely in United States
Senior level
Remote
Hiring Remotely in United States
Senior level
Lead design and implementation of high-performance agent runtimes, backend services, and self-hosted model/agent infrastructure. Build low-latency execution systems, real-time data pipelines, telemetry loops, CI/CD for zero-downtime deployments, and ensure fleet reliability on AWS/EKS.
The summary above was generated by AI

Staff Software Engineer - Backend & AI Infra

Remote | Full-time
Location:
Based in US to GMT timezones

Compensation: Competitive Compensation Package

Our client is a high-growth technology firm. They are seeking a Staff Software Engineer to spearhead two critical domains: the core agent runtime and backend infrastructure powering a high-frequency trading fleet, and the comprehensive migration of model hosting and agent deployment to in-house, proprietary infrastructure.

This is a foundational, high-impact building role. The successful candidate will design and implement the backend services, runtime engines, and deployment systems that enable a fleet of autonomous agents to operate with superior speed, reliability, and intelligence. By moving away from third-party LLM providers and hosted platforms, this role will establish the sovereign infrastructure necessary for the next generation of autonomous financial software.

Key Responsibilities

Agent Runtime & Backend Development

  • Plugin Runtime Ownership: Lead the evolution of the per-agent process, migrating from a distributed Go/Python hybrid to a centralized, high-performance Go service utilizing Postgres state and real-time websocket price feeds.
  • Rules Engine Engineering: Build a YAML-configurable "Scanner Gateway" to bridge signal production and execution, allowing for complex scoring and filtering without direct code manipulation.
  • Advanced Execution Systems: Develop and maintain the RatchetStop Backend, a centralized profit-trailing service capable of sub-second evaluation and websocket-based order execution to protect capital even when agents are offline.
  • Data & Connectivity: Manage the Model Context Protocol (MCP) server bridging agents to platform tools, and oversee a high-throughput data pipeline (Redis, Postgres, ClickHouse) for real-time market intelligence ingestion.

Model & Agent Hosting Migration

  • Infrastructure Sovereignty: Lead the technical execution of migrating agents from third-party platforms to a custom-built, Senpi-hosted environment featuring isolated workspaces and state persistence.
  • Model Serving: Evaluate and implement the transition from external LLM APIs (Anthropic, Google) to self-hosted inference, optimizing for telemetry capture and performance.
  • Telemetry & Feedback Loops: Architect systems to capture every agent decision and score, creating a self-reinforcing loop where the fleet learns and improves from collective performance data.
  • Deployment Pipelines: Build robust CI/CD pipelines for zero-downtime rollouts, ensuring that updates to scanner logic or runtime patches do not interrupt active market positions.

Infrastructure & Operations

  • System Reliability: Design monitoring and alerting frameworks to detect agent failures, state corruption, or authentication expirations before they impact financial performance.
  • Cloud Orchestration: Manage AWS/EKS environments using Infrastructure-as-Code (IaC).
  • Incident Response: Own the operational health of the fleet, acting as the primary responder for high-stakes trading system incidents.

IInterview Process

  1. Founder / CEO Interview: Introduction to the vision and strategic goals.
  2. Take-Home Test: A practical assessment of technical design and coding capabilities.
  3. Technical Interview: A deep dive into systems architecture and engineering expertise.
  4. Final Interview: Cultural alignment and final technical synthesis.

Requirements
  • Technical Essentials
    • Expert Backend Engineering: Proficiency in writing production-grade code in Go, Python, and Node.js/TypeScript (Go is strongly preferred for runtime services).
    • Startup Experience: A proven track record of building complex backend services (APIs, job scheduling, distributed systems) from scratch in a fast-paced environment.
    • Real-Time Systems: Deep understanding of low-latency environments, websocket management, and sub-second condition evaluation.
    • Database Mastery: Production experience with Postgres, Redis, and at least one analytical database (e.g., ClickHouse, TimescaleDB, or BigQuery).
    • Orchestration: Hands-on experience deploying, scaling, and debugging production workloads on Kubernetes (AWS EKS).
    • End-to-End Ownership: Demonstrated ability to design, build, deploy, and maintain systems throughout their entire lifecycle.
  • Preferred Qualifications
    • LLM Infrastructure: Experience with model serving and optimizing inference (e.g., vLLM, TGI, or TensorRT-LLM).
    • FinTech/Trading: Background in exchange APIs, wallet operations, or on-chain infrastructure where uptime has direct financial consequences.
    • Agentic Frameworks: Familiarity with Model Context Protocol (MCP) or orchestrating multi-agent platforms.

Benefits
    • Competitive compensation and equity packages.
    • The opportunity to build foundational infrastructure in a new category of autonomous software.
    • High-autonomy environment with a focus on engineering excellence.
    • Collaborative culture working alongside industry-leading founders and engineers.

Due to the high volume of applications we anticipate, we regret that we are unable to provide individual feedback to all candidates. If you do not hear back from us within 4 weeks of your application, please assume that you have not been successful on this occasion. We genuinely appreciate your interest and wish you the best in your job search.

Commitment to Equality and Accessibility:

At MLabs, we are committed to offer equal opportunities to all candidates. We ensure no discrimination, accessible job adverts, and providing information in accessible formats. Our goal is to foster a diverse, inclusive workplace with equal opportunities for all. If you need any reasonable adjustments during any part of the hiring process or you would like to see the job-advert in an accessible format please let us know at the earliest opportunity by emailing [email protected].

MLabs Ltd collects and processes the personal information you provide such as your contact details, work history, resume, and other relevant data for recruitment purposes only. This information is managed securely in accordance with MLabs Ltd’s Privacy Policy and Information Security Policy, and in compliance with applicable data protection laws. Your data may be shared only with clients and trusted partners where necessary for recruitment purposes. You may request the deletion of your data or withdraw your consent at any time by contacting [email protected].

Similar Jobs

2 Hours Ago
In-Office or Remote
Junior
Junior
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
Plan and execute high-intent events (roundtables, workshops, conference) to drive qualified pipeline. Manage venues, vendors, contracts, logistics, reporting, and sales alignment. Travel monthly, work closely with sales, customer, product, and marketing teams to deliver world-class attendee experiences.
Top Skills: ConfluenceJIRA
3 Hours Ago
Remote or Hybrid
63K-99K Annually
Junior
63K-99K Annually
Junior
Digital Media • Information Technology • News + Entertainment
Responsible for developing and maintaining client relationships in advertising sales to achieve annual sales goals, including market research, proposals, and revenue generation activities.
Top Skills: AdvertisingCustomer Relationship Management (Crm)Sales
3 Hours Ago
Remote or Hybrid
California, USA
84K-157K Annually
Senior level
84K-157K Annually
Senior level
Digital Media • Information Technology • News + Entertainment
Sell integrated networking, security, and communications solutions (SD-WAN, UCaaS, network security) to enterprise multi-site accounts. Prospect, develop territory relationships, deliver in-person presentations, meet revenue and quota targets, collaborate with internal teams, and manage complex sales cycles while supporting customers and partners.
Top Skills: EthernetNetwork SecuritySd-WanUcaasWireless

What you need to know about the San Francisco Tech Scene

San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.

Key Facts About San Francisco Tech

  • Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Google, Apple, Salesforce, Meta
  • Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
  • Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
  • Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account