Lead GPU-edge inference systems, ensuring compliance and performance through design and monitoring. Manage global infrastructure for AI deployment.
Full-time | Remote | Infrastructure | Reports to CTO
About Elloe
Elloe is the trust layer for AI.
We sit between the world’s most powerful language models and the institutions that can't afford to get it wrong — hospitals, banks, regulators. We trace and block failures in real time. That’s not marketing — we’re deployed at the European Commission, with NIH clinical trials, and inside a Top-5 EU bank catching GDPR violations live.
This is the enforcement layer GenAI has been missing. We're not visualizing problems — we're fixing them.
About the Role
You’ll lead our GPU-edge inference systems. From chaos-resilient deployment to SHAP-driven compliance metrics, you’ll own global infra that makes AI safe and performant.
What You’ll Own
1. Global Edge Routing
- Design zone-routing that ensures <50ms SLA in 10+ regions
- Build fallback orchestration to handle compliance-aware rollbacks
2. GPU Infra Ops
- Maximize utilization across 100K+ GPUs via mesh & load prediction
- Integrate compliance overlays with VaultChain and SHAP triggers
3. Reliability Telemetry
- Ship `/vault/audit`, `/inference/predict`, `/compliance/log` endpoints
- Trace every edge request across governance and model layers
Who You Are
- Senior systems engineer with GPU fleet experience (KubeRay, Istio, Envoy)
- Operated real-time AI infra with 10M+ QPS loads
- Comfortable with compliance observability and infra governance
Why This Matters
Our competitive edge isn’t just AI — it’s defensible enforcement. This role turns that into product.
You’ll Leave This Role With
- Referenceable contributions to enforcement infra that’s live in EU and US institutions
- First-hand product work across legal, engineering, and GTM teams
- Influence over how regulatory primitives become systems people trust
Logistics & Application
- Start Date: Flexible (Q3–Q4 ideal)
- Location: Remote-first; timezone overlap with NY or EU preferred
- Compensation: Top of market salary + equity
- To Apply: Send your resume and a sentence on the hardest infra problem you'd want to own at scale.
Similar Jobs
Professional Services • Consulting • Financial Services
Coordinates DFK Africa activities, calendars, meetings, communications, member recruitment, prospect research, onboarding, and referral initiatives. Supports document preparation, office administration, business development tracking, proposal coordination, front-office operations, and client experience. Maintains records, databases, action trackers, budgets, and opportunity pipelines while ensuring timely follow-through, professional presentation, and escalation of competing priorities.
Top Skills:
Ai Productivity ToolsCRMExcelMicrosoft OutlookMicrosoft PowerpointMicrosoft WordTask-Management Tools
Healthtech • Biotech • Pharmaceutical • Manufacturing
Manages end-to-end clinical trial study start-up activities from site selection through activation. Responsibilities include site suitability assessments, regulatory and ethics submissions, essential document collection, TMF maintenance, issue resolution, vendor and payment coordination, and handover to execution CRAs. The role requires compliance with ICH-GCP, local regulations, SOPs, and inspection-readiness standards while coordinating multiple sites and stakeholders.
Top Skills:
Ich-GcpTmf
Healthtech • Biotech • Pharmaceutical • Manufacturing
Develop, validate, and maintain SAS and R programs for clinical trial analysis and reporting. Lead statistical programming activities, create ADaM datasets and TLFs, support regulatory submissions, and ensure compliance with CDISC and ICH-GCP standards. Collaborate with cross-functional study teams, perform quality reviews, improve processes, and mentor junior programmers across clinical development, oncology, and real-world evidence programs.
Top Skills:
AdamCdiscDefine.XmlRSASSdtm
What you need to know about the San Francisco Tech Scene
San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.
Key Facts About San Francisco Tech
- Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Google, Apple, Salesforce, Meta
- Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
- Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
- Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine
