The role involves developing scalable ML algorithms, optimizing LLM inference performance, managing model serving pipelines, and collaborating with data engineers for efficient knowledge graph generation.
About zaimler
AI agents can't reason over data they don't understand. Enterprise data today is fragmented across dozens of systems with no shared context, meaning, or structure, and that's why most enterprise AI is failing. The shift from copilots to autonomous agents is creating an entirely new infrastructure layer, and we're building it.
zaimler is the context infrastructure for the agentic era: a platform that automatically discovers domain knowledge, maps relationships, and gives AI agents the semantic understanding to operate with precision at scale. Imagine knowledge graphs that support real-time inference, built for systems that need to reason, not just retrieve.
zaimler was founded by Biswajit Das (ex-VP Engineering, Truera), a Data Infra veteran and former Chief Architect at Visa, and Sofus Macskassy (ex-Director of Engineering, LinkedIn), who built one of the largest knowledge graphs in production in the industry at LinkedIn. We're growing and deploying with major enterprises across insurance, travel, and technology. If you want to build infrastructure that the next decade of enterprise AI runs on, we'd love to talk.
You'll own our inference and model-serving infrastructure end to end. This isn't a research role. It's a build role: you're setting up and scaling the systems that let our agents actually run in production, fast and reliably, at increasing concurrency.
You report to Sofus and work closely with our ML and infra teams.
What You’ll Own
- Set up and scale inference/Ray Serve for ML and LLM model serving, integrated with our data analysis and agent workflows
- Scale agent GPU infrastructure for concurrency and efficiency across multiple agent workloads
- Optimize and improve the engine builder and model server that power scalable agent orchestration
What You Need
- Proven ability to build scalable ML/AI platforms from scratch, end-to-end, for production use cases. You've owned a zero-to-one build before, or can show you're capable of it
- Deep understanding of the inference stack: vLLM, KV cache, and the optimization layers underneath model serving
- Experience building distributed systems for AI/ML workloads at scale, connecting them to real product or vertical integrations
- 3+ years of relevant experience. We care about capability, not tenure
Nice to Have
- Ray / Ray Serve experience
- Familiarity with AIBrix
Why Join
- A rare chance to shape both company and product direction as an early team engineer
- Work alongside engineers and researchers from LinkedIn, Visa, Meta, and Branch
- Onsite culture in San Mateo, built for deep collaboration and high-velocity building
- Full benefits (medical, dental, vision, 401k)
- We sponsor H-1B visas and assist with immigration
We value builders over résumés. If this role excites you but you don't check every box, we still want to hear from you. zaimler is an equal opportunity employer.
Similar Jobs
Artificial Intelligence • Cloud • Machine Learning • Mobile • Software • Virtual Reality • App development
Build and optimize large-scale machine learning infrastructure for content retrieval and recommendation. Responsibilities include developing feature generation and serving pipelines, high-performance inference systems, cloud-based training and evaluation infrastructure, and data management systems. The role partners with ML engineers to deploy models, improve reliability and efficiency, and operate highly available distributed systems using Java, Go, C++, and Python.
Top Skills:
C++Caffe2FlinkGoJavaPythonPyTorchRayScikit-LearnSparkSpark MlTensorFlow
Automotive • Big Data • Information Technology • Robotics • Software • Transportation • Manufacturing
Design and build scalable, reliable ML training infrastructure for advanced AI research and model development. Optimize distributed training performance, resource utilization, data loading, and costs across heterogeneous GPU and cloud environments. Improve platform observability, debuggability, operational excellence, and user experience. Collaborate with ML engineers, research scientists, and cross-functional partners to integrate new technologies supporting intelligent driving systems.
Top Skills:
AWSAzureDistributed ComputingFsdpGCPGpu ComputingPipeline ParallelismPythonPyTorchTensorFlow
Artificial Intelligence • Cloud • Machine Learning • Mobile • Software • Virtual Reality • App development
Design, build, and optimize scalable ML infrastructure for training, evaluation, and high-performance inference. Develop feature generation/serving pipelines, data management and labeling systems, and collaborate with ML engineers to deploy production models while ensuring reliability, scalability, and production-quality code.
Top Skills:
AdkCaffe2FlinkFrontier LlmGoJavaLangfusePythonPyTorchRayScikit-LearnSparkSpark MlTensorFlow
What you need to know about the San Francisco Tech Scene
San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.
Key Facts About San Francisco Tech
- Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Google, Apple, Salesforce, Meta
- Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
- Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
- Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine
