Automate operational processes, improve developer and machine learning workflows, manage deployment tooling, and maintain secure, reliable hybrid infrastructure across Linux, GPU data centers, and AWS. Responsibilities include infrastructure monitoring, auditing, security, on-call support, root cause analysis, and automation using containers, orchestration, CI/CD, configuration management, networking, storage, and cloud technologies.
About Deploy
Deploy is an intelligence infrastructure platform that gives developers and enterprises access to open source and proprietary AI models. For leading open source LLMs, Deploy operates an optimized model inference engine that keeps costs and latency low while maintaining high throughout. Deploy also offers a set of proprietary AI models that address challenges in content safety, AI & deepfake detection, sponsorship intelligence, and IP & publicity protection. Trusted by the world's largest and most innovative organizations, Deploy's solutions unlock high-performance AI model inference at production scale.
Deploy has raised more than $200M from leading investors, including Tomales Bay Capital, General Catalyst, 8VC, Glynn Capital, Bain & Company, Visa Ventures, and others. The company has more than 250 employees across offices in San Francisco, Seattle, New York, and Delhi.
Deploy has raised more than $200M from leading investors, including Tomales Bay Capital, General Catalyst, 8VC, Glynn Capital, Bain & Company, Visa Ventures, and others. The company has more than 250 employees across offices in San Francisco, Seattle, New York, and Delhi.
DevOps and Systems Team
Our unique machine learning needs led us to open our own data centers, with an emphasis on GPU resources. Even with these data centers, we maintain a hybrid infrastructure into AWS to power some parts of our consumer apps. As we continue to commercialize our machine learning models, we also need to grow our DevOps and Systems team to maintain the reliability of a SaaS offering for our customers. Our ideal candidate is someone who is able to thrive in an unstructured environment and takes automation seriously. You believe there is no task that can’t be automated and no server scale too large. You take pride in ensuring developers can deploy their servers without worrying about downtime.
Responsibilities
- Automate manual operational processes
- Improve workflows of developer, data, and machine learning teams
- Manage integration and deployment tooling
- Create, maintain, monitor, secure and audit infrastructure
- Manage a diverse array of technology platforms, following best practices and procedures
- Participate in on-call rotation and root cause analysis
- Utilize OWASP top 10 techniques to secure code from vulnerabilities
- Maintain awareness of industry best practices for data maintenance handling as it relates to your role
- Adhere to policies, guidelines and procedures pertaining to the protection of information assets
- Report actual or suspected security and/or policy violations/breaches to an appropriate authority
Requirements
- Minimum 1 - 2 years of previous experience in development, operations, IT, or a related field
- Comfortable working on Linux infrastructures (Debian) via the CLIAble to learn quickly in a fast-paced environment
- Able to multitask, prioritize, and manage time efficiently independently
- Able to physically lift equipment at least 30 pounds
- Can communicate effectively across teams and management levels
- Degree in computer science, or similar, is an added plus!
Technology Stack
- Operating Systems - Linux/Debian Family/Ubuntu
- Configuration Management - Chef/Ansible/Puppet/Salt
- Containerization - Docker
- Container Orchestrators - Mesosphere/Kubernetes
- Scripting Languages - Python/Ruby/Node/Bash
- CI/CD Tools - Jenkins
- Network hardware - Arista/Cisco/Fortinet
- Hardware - HP/SuperMicro
- Storage - Ceph, S3
- Database - Scylla, Postgres, Pivotal GreenPlum
- Message Brokers: RabbitMQ
- Logging/Search - ELK Stack
- AWS: VPC/EC2/IAM/S3
- Networking: TCP / IP, ICMP, SSH, DNS, HTTP, SSL / TLS, Storage systems, RAID, distributed file systems, NFS / iSCSI / CIFS
Who We Are
We are a group of ambitious individuals who are passionate about creating a revolutionary AI company. At Deploy, you will have a steep learning curve and an opportunity to contribute to one of the fastest growing AI start-ups in San Francisco. The work you do here will have a noticeable and direct impact on the development of the company.
Thank you for your interest in Deploy and we hope to meet you soon!
The current expected base salary for this position ranges from $120,000 - $180,000. Actual compensation may vary depending on a number of factors, including a candidate’s qualifications, skills, competencies and experience, and location. Base pay is one part of the total compensation package that is provided to compensate and recognize employees for their work; stock options may be offered in addition to the range provided here.
Similar Jobs
Automotive • Big Data • Information Technology • Robotics • Software • Transportation • Manufacturing
Leads the architecture, implementation, and operational excellence of DevOps, CI/CD, build, release, and developer productivity platforms for next-generation infotainment systems. Designs scalable embedded Linux build pipelines, automates releases, improves observability, builds self-service tooling, and drives cross-functional initiatives. The role mentors engineers, influences technical direction, and advances software delivery reliability and developer velocity across multiple vehicle programs.
Top Skills:
Android AutomotiveArmArtifactoryBashBuildbarnCi/CdCloud ComputingDatadogDockerEmbedded LinuxGitGithub ActionsGitlab CiGrafanaGroovyJenkinsKubernetesOpenembeddedPrometheusPythonQnxRemote Build ExecutionSonarqubeYocto
Artificial Intelligence • Cloud • Information Technology • Software
Design, deploy, automate, secure, and troubleshoot large-scale Linux, AI, and HPC environments. Build infrastructure automation and CI/CD solutions with Ansible, Python, Bash, Jenkins, and Git; manage clusters, software distribution, containers, observability, and system security. Lead integration and root-cause debugging across hardware, firmware, operating systems, networking, middleware, and applications while partnering across engineering teams.
Top Skills:
AIAnsibleArtifactoryBashBmcBright Cluster ManagerCi/CdCursorDockerElkEnvironment ModulesGitGithub CopilotHpcHpcmJenkinsKubernetesKvmLinuxLmodNexusOpenbmcOpenstackPulpPythonRpmSatelliteSlurmVMwareWarewulfXcat
Information Technology • Software
Build and operate Linux-based ML training clusters and inference cloud infrastructure. Responsibilities include access management, hardware validation, job scheduling, container orchestration, CI/CD, observability, incident response, capacity planning, autoscaling, cost tracking, and production security. The role supports heterogeneous accelerators, large-scale training, LLM serving, developer workflows, and reliable model deployments while collaborating across training, inference, product, and technical teams.
Top Skills:
Amd RocmAnsibleApptainerAWSAzureBashDockerDocker HubGCPGmailGrafanaInfinibandKubernetesLinuxNvidia CudaPrometheusPythonRayRoceSglangSlackSlurmTelegrafTerraformTpusVllmVscode
What you need to know about the San Francisco Tech Scene
San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.
Key Facts About San Francisco Tech
- Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Google, Apple, Salesforce, Meta
- Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
- Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
- Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine
