Seekr Technologies Logo

Seekr Technologies

Senior AI Infrastructure Engineer

Reposted 3 Months Ago
Be an Early Applicant
In-Office
Menlo Park, CA, USA
160K-230K Annually
Senior level
In-Office
Menlo Park, CA, USA
160K-230K Annually
Senior level
Design, build, and operate large-scale AI infrastructure for training, inference, evaluation, and autonomous agent workloads across cloud, on-prem, hybrid, and edge. Lead architecture, reliability, performance tuning, GitOps/IaC automation, and cross-functional collaboration while mentoring engineers and supporting production incidents and continuous improvement.
The summary above was generated by AI

Seekr is building the infrastructure that powers the next generation of enterprise AI. As a Senior AI Infrastructure Engineer, you will design, build, and operate the platforms that enable large-scale training, serving, evaluation, and deployment of foundation models and autonomous AI agents.

You will work across distributed systems, Kubernetes, GPU infrastructure, high-performance inference, and enterprise AI platforms to build secure, scalable, and highly reliable systems capable of serving workloads ranging from edge AI deployments to trillion-parameter foundation models.

This role requires deep expertise in distributed systems, cloud-native infrastructure, AI platform engineering, and production software development. You will collaborate with research scientists, software engineers, product teams, and infrastructure engineers to define the architecture and technical direction of Seekr’s AI platform.

Duties and Responsibilities

  • Design, develop, deploy, and maintain production AI infrastructure supporting model training, fine-tuning, inference, evaluation, and agentic AI workloads.
  • Design and operate scalable Kubernetes-based infrastructure supporting GPU-accelerated workloads across cloud, on-premises, hybrid, and edge environments.
  • Architect and optimize high-performance inference platforms capable of serving models ranging from resource-constrained edge deployments to trillion-parameter foundation models, with a focus on latency, throughput, scalability, reliability, and cost efficiency.
  • Build and maintain distributed systems that enable reliable scheduling, orchestration, deployment, monitoring, and lifecycle management of AI workloads.
  • Develop enterprise platforms supporting autonomous and multi-agent AI systems, including secure tool execution, orchestration, memory, evaluation, governance, and observability.
  • Design, implement, and automate AI infrastructure using Infrastructure-as-Code, GitOps, CI/CD pipelines, and modern software engineering practices.
  • Evaluate and integrate emerging AI infrastructure technologies, model serving frameworks, hardware accelerators, and cloud-native platforms to improve platform performance, scalability, and reliability.
  • Collaborate with engineering, research, product, and cross-functional teams to deliver secure, scalable, and production-ready AI platforms.
  • Lead technical design discussions, perform architecture reviews, mentor engineers, and establish engineering standards and best practices across the AI Infrastructure organization.
  • Participate in production support activities, including troubleshooting complex distributed systems, performance tuning, incident response, and continuous operational improvement.

Skills and Qualifications

  • 5–8 years of professional software engineering experience building distributed systems, cloud infrastructure, or large-scale platform services
  • Strong production ML infra experience, executes complex work independently, owns significant components
  • 4 year or higher degree or additional relevant experience, in addition to years of work experience
  • Demonstrated success designing and operating production Kubernetes environments supporting cloud-native applications and distributed services.
  • Strong software engineering skills using Python and one or more modern programming languages such as Go, Rust, or C++.
  • Proven ability to design, build, and operate production AI or machine learning infrastructure.
  • Expertise developing and optimizing large-scale AI inference platforms, including GPU utilization, distributed inference, batching, caching, quantization, and accelerator performance.
  • Familiarity with modern AI serving technologies such as vLLM, SGLang, TensorRT-LLM, Triton Inference Server, Ray Serve, or similar platforms.
  • Knowledge of distributed computing, networking, storage systems, cloud-native architectures, and infrastructure automation using technologies such as Kubernetes, Helm, Argo CD, Docker, Prometheus, Grafana, OpenTelemetry, and Infrastructure-as-Code tools.
  • Experience developing enterprise AI platforms, autonomous agents, or multi-agent systems, including orchestration, tool execution, governance, observability, and evaluation.
  • Familiarity with event-driven architectures, distributed messaging systems, and public cloud platforms including AWS, Azure, Oracle Cloud Infrastructure, or Google Cloud Platform.
  • Demonstrated technical leadership, including driving architectural decisions, mentoring engineers, and leading complex technical initiatives across cross-functional teams.
  • Demonstrated ability to analyze, profile, and optimize AI systems for performance, scalability, reliability, and cost across distributed compute environments.

This range reflects Seekr’s good faith estimate of  what it expects to pay for this role at the time of posting. Placement within the range depends on a number of factors, including but not limited to geographic location, applicable labor categories under Seekr’s federal government contracts, relevant prior work experience, specific skills, education, and certifications. This role may also be eligible for annual bonus, equity, other other incentive compensation.

 
The proposed salary range for this position is:
$160,000—$230,000 USD

About the Company:  

Seekr is a leader in explainable and trustworthy artificial intelligence designed to power mission-critical decisions in enterprises, government, and regulated industries. SeekrFlow™, our end-to-end AI platform, provides secure, auditable AI solutions tailored to sectors where transparency, accuracy, and compliance are paramount. Available across cloud, on-premises, and edge environments, SeekrFlow reduces bias, strengthens data integrity, and simplifies model oversight so organizations can rely on trusted AI decisions in high-stakes settings that impact society’s most sensitive and vital systems. Trusted by leading enterprises and government agencies, we partner with defense, finance, telecom, and critical infrastructure leaders to enable AI solutions that drive real-world results with unmatched transparency and control. We are a team of strategic thinkers and problem-solvers tackling the toughest challenges facing critical infrastructure and global enterprises through best-in-class AI models and customer deployment. Our team operates with unwavering commitment to our core values and mission:
  • We are driven by outcomes—our customers' success is what we strive for every day.
  • We believe trust is earned, which is why we build explainability and transparency into the entire AI lifecycle.
  • We take our responsibility to deliver secure AI seriously.
  • We believe innovation drives progress—we are building the technologies that power the systems our society depends on.

Company Benefits:

  • Meaningful Mission & Impact - Work with a deeply talented, collaborative team solving some of the toughest AI challenges that matter. 
  • Equity Ownership – RSUs that let you share directly in Seekr’s long‑term success and growth.
  • Time Off That Respects Real Life – Unlimited PTO plus 14 paid company holidays to truly recharge. 
  • Work Your Way – A flexible hybrid work environment with offices in Reston, VA and Austin, TX.
  • Competitive Total Rewards – A role‑appropriate compensation structure that supports long‑term growth, including base salary, bonuses, or commission plans depending on role.
  • 401(k) with Company Match – Build your future with a retirement plan that includes employer matching. 
  • Comprehensive Health & Wellness – Medical, dental, vision, and life insurance coverage starting day one—for you and your family.  
  • Parental Leave – Paid parental leave to support employees as they welcome a new child through birth, adoption, or foster placement.

Important Notice: 
 
To conform to U.S. Government international trade regulations, applicant must be a U.S. Citizen, lawful permanent resident of the U.S., protected individual as defined by 8 U.S.C. 1324b(a)(3), or eligible to obtain the required authorizations from the U.S. Department of State or U.S. Department of Commerce.
 
Seekr is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, creed, sex, sexual orientation, gender identity, marital status, national origin, age, veteran status, disability, or any other characteristic protected by applicable law.

Similar Jobs

16 Days Ago
Hybrid
66K-91K Annually
Senior level
66K-91K Annually
Senior level
Cloud • Information Technology • Security • Software • Cybersecurity
Build and operate auditable multi-agent systems on Cloudflare’s platform for infrastructure forecasting, supply planning, cost modeling, approvals, and decision analysis. The role involves designing durable workflows, integrating statistical and machine learning models, creating BigQuery pipelines, enforcing risk controls and auditability, and authoring technical specifications and architectural standards.
Top Skills: A2AAi GatewayAsnAstroAutogenBgpBigQueryCloudflare WorkersCloudflare WorkflowsD1Durable ObjectsGitlab CiHonoHttp ApisLanggraphLlmsOpenapiPythonQueuesR2ReactSQLTerraformTypescriptVectorizeWorkers AiZod
4 Days Ago
In-Office or Remote
United States
48K-168K Annually
Senior level
48K-168K Annually
Senior level
Agency • Information Technology
Design and scale automated testing for MCP servers and AI agent integrations. Build MCP client harnesses, functional and contract tests, CI/CD quality gates, load and concurrency tests, and LLM-in-the-loop evaluation pipelines. Validate protocol compliance, streaming transports, error handling, performance, observability, authentication, and reliability under production workloads. Collaborate with AI engineers to assess tool selection, multi-step chaining, and failure recovery.
Top Skills: DockerGithub ActionsGitlab CiJenkinsJestJmeterJson-RpcK6LocustMcpNode.jsOauth 2.1PytestPythonServer-Sent EventsStreamable HttpTypescriptVitestWebsockets
9 Days Ago
In-Office
141K-205K Annually
Senior level
141K-205K Annually
Senior level
Big Data • Fintech • Mobile • Payments • Financial Services • Data Privacy
Designs, develops, validates, deploys, and operationalizes AI/ML solutions for infrastructure reliability, forecasting, observability, automation, and enterprise decision-making. Builds data pipelines, APIs, models, dashboards, and MLOps capabilities across hybrid cloud and on-premises environments. Manages the model lifecycle, including governance, monitoring, validation, documentation, and remediation. Partners with engineering, data science, risk, cybersecurity, architecture, operations, and product teams in a regulated enterprise setting.
Top Skills: APIsCi/CdConfluenceGensimGpu ComputingHugging Face TransformersHybrid CloudJIRAJupyterKanbanMlopsModel ServingNlpNumpyNvidia Ai PlatformsObservabilityOn-Premises InfrastructurePandasPythonPyTorchRed Hat Openshift AiRelational DatabasesScikit-LearnShinySpacySQLStreamlitTableauTensorFlowWorkflow Orchestration

What you need to know about the San Francisco Tech Scene

San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.

Key Facts About San Francisco Tech

  • Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Google, Apple, Salesforce, Meta
  • Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
  • Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
  • Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account