Easy Apply
Easy Apply
Own and operate end-to-end infrastructure for decentralized confidential ML inference: design GPU cluster management, optimize performance, build CI/CD, maintain observability, create runbooks, participate in on-call, and implement cost and security strategies.
About The Role
The NEAR AI engineering team is developing decentralized and confidential machine learning infrastructure to power user owned AI. We currently focus on building infrastructure to enable private and confidential inference that works across different compute providers, as well as a blockchain-based coordination layer that incentivizes computer providers to join the decentralized inference network.
You will own various components and drive critical decisions throughout their life cycles, including architecture, implementation, and maintenance. You will collaborate with highly knowledgeable and skilled colleagues who are passionate about solving hard problems that can disrupt the industry.
What You'll Be Doing:
- End-to-end infrastructure ownership (for handling telemetry data, for performing testing, etc)
- Design and implementation of infrastructure components that manage clusters of GPU with special configurations
- Performance tuning and optimizations
- Create and maintain runbooks that support the on-call rotation
- Participate in the on-call rotation.
- Support code releases and delivery
- Plan and implement infrastructure cost and security strategies
- Plan and implement effective CI/CD Pipelines to facilitate development processes
What We're Looking For:
- Agility to quickly learn new programming languages and technologies
- Ability to write clean and efficient code
- Ability to transform ambiguous problems into tangible solutions or prototypes
- Linux systems proficiency
- Experience with software concurrency or parallelism
- Experience in building, operating, and scaling Cloud infrastructure (GCP, AWS, etc)
- Experience with data visualization and observability tooling (Grafana, Graphite, Zabbix, etc)
- Detail-oriented mindset with a focus on setting priorities and progressing towards objectives
- Excellent communication and teamwork skills
- Bachelor's Degree in Computer Science or a related field
We'd Love If You Have:
- Experience with NEAR or other blockchain internals
- Experience with GPUs
- Experience with Trusted Execution Environments
- Experience debugging and troubleshooting complex concurrent systems
- Professional experience with Rust
Locations: onsite, San Francisco office
Top Skills
AWS
Blockchain
Ci/Cd
GCP
Gpus
Grafana
Graphite
Linux
Near
Rust
Trusted Execution Environments
Zabbix
Near AI San Francisco, California, USA Office
535 Mission St, San Francisco, California, United States, 94105 2997
Similar Jobs
Marketing Tech • Social Media • Software • Analytics • Business Intelligence
As a Site Reliability Engineer, you'll design scalable systems, drive infrastructure initiatives, improve security, and collaborate across teams to enhance system resilience. You'll also investigate failures and contribute to security tooling while building your skills in a supportive environment.
Top Skills:
AnsibleAWSChefGithub ActionsGitlabGoJavaJenkinsLinuxPythonRubySaltstackTerraform
Big Data • Cloud • Software • Database
Lead a 6–8 person team managing the Kubernetes fleet and core runtime components (CoreDNS, cert-manager, Gatekeeper). Define technical vision and roadmap, guide migration from Terraform to Operator-driven lifecycle management, perform hands-on architectural reviews and PR reviews, resolve operational incidents, and collaborate with engineering leaders and stakeholders.
Top Skills:
Kubernetes,Coredns,Cert-Manager,Gatekeeper,Terraform,Crossplane,Operators,Aws,Gcp,Azure,Service Mesh,Load Balancing,Observability,Alerting,Containerization
Cloud • Mobile • Software
Staff-level SRE responsible for owning reliability domains, driving SRE practices (SLIs/SLOs, error budgets), building observability, leading multi-team reliability initiatives, contributing code and IaC for AWS, participating in on-call and incident response, and mentoring engineers to improve system reliability and performance.
Top Skills:
Python,Node.Js,Typescript,Datadog,Prometheus,Grafana,Honeycomb,New Relic,Aws,Terraform,Ecs,Eks,Kubernetes,Pagerduty,Opsgenie,Incident.Io,Llms/Ai Tools
What you need to know about the San Francisco Tech Scene
San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.
Key Facts About San Francisco Tech
- Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Google, Apple, Salesforce, Meta
- Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
- Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
- Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine
