Mirantis Logo

Mirantis

Senior DevOps Engineer – PostgreSQL & Kafka on Kubernetes

Posted 4 Days Ago
In-Office or Remote
Hiring Remotely in Remote, OR
Senior level
In-Office or Remote
Hiring Remotely in Remote, OR
Senior level
Operate PostgreSQL and Kafka on Kubernetes across cloud and bare-metal environments. Own GitOps, infrastructure as code, upgrades, automation, observability, high availability, backups, disaster recovery, security, multi-tenancy, and self-service provisioning. Manage replication, CDC pipelines, failover drills, and performance troubleshooting while supporting on-call operations and incident reviews. Build tooling in Go or Python and collaborate with application teams on schema and platform standards.
The summary above was generated by AI
Company Description

Mirantis, an IREN company, is the Kubernetes-native AI infrastructure company, enabling organizations to build and operate scalable, secure, and sovereign infrastructure for modern AI, machine learning, and data-intensive applications. By combining open source innovation with deep expertise in Kubernetes orchestration, Mirantis empowers platform engineering teams to deliver composable, production-ready developer platforms across any environment—on-premises, in the cloud, at the edge, or in sovereign data centers. As enterprises navigate the growing complexity of AI-driven workloads, Mirantis delivers the automation, GPU orchestration, and policy-driven control needed to manage infrastructure with confidence and agility. Committed to open standards and freedom from lock-in, Mirantis ensures that customers retain full control of their infrastructure strategy.  https://www.mirantis.com/

Job Description

We are looking for a Senior Data Platform Engineer to run the PostgreSQL and Apache Kafka platform behind k0rdent-ai — our multi-tenant control plane for enterprise GPU infrastructure. Every cluster provisioned, every GPU-hour consumed, and every tenant action is recorded on this platform, so it must be reliable, secure, and recoverable.

This is a hands-on DevOps / SRE role for stateful systems. You will deploy and operate PostgreSQL (CloudNativePG) and Kafka (Strimzi) on Kubernetes using operators, Helm, and GitOps — across cloud and bare-metal clusters, in a global control plane and multiple regions. You will own automation, upgrades, observability, backups, and disaster recovery, and give product teams self-service access to databases and topics through code.

Main Responsibilities

  • Run PostgreSQL and Kafka on Kubernetes: Deploy, upgrade, scale, and operate CloudNativePG and Strimzi clusters with Helm charts and operator custom resources, across cloud and bare-metal Kubernetes.
  • GitOps & Infrastructure as Code: Manage everything declaratively with Argo CD (or Flux), Helm, and Terraform; build CI/CD pipelines for database and Kafka changes, schema migrations, and operator upgrades.
  • High Availability & Disaster Recovery: Design and operate high availability within each region and cross-region disaster recovery — PostgreSQL replica clusters, backups and point-in-time recovery, Kafka MirrorMaker 2 — with defined RPO/RTO targets and regular failover drills.
  • Self-Service Platform: Give product teams self-service provisioning of databases, users, topics, and ACLs through code, with secure defaults and guardrails.
  • Observability & Operations: Build monitoring and alerting (Prometheus, Grafana, OpenTelemetry) for replication lag, backups, consumer lag, and capacity; participate in on-call and lead incident reviews.
  • Security & Multi-Tenancy: Implement TLS/mTLS, secrets management (Vault/OpenBao), network policies, Kafka ACLs, and per-tenant isolation; integrate database and Kafka access with our identity platform (Keycloak / OIDC).
  • Data Movement & CDC: Operate the outbox and change-data-capture pipelines (Debezium, Kafka Connect) that keep databases and event streams consistent between the global control plane and regions.
  • Automation & Tooling: Write automation and small services in Go or Python to remove manual work, and partner with application teams on schema standards and performance troubleshooting.

Qualifications

Must Have

  • Experience: 8+ years in DevOps, SRE, platform, or infrastructure engineering, including 3+ years running stateful systems (databases or message streaming) in production.
  • Kubernetes: Strong hands-on Kubernetes operations — StatefulSets, persistent volumes and storage classes, pod disruption budgets, scheduling and affinity, network policies, and cluster upgrades — on cloud and/or bare-metal clusters.
  • Operators & Helm: Production experience running PostgreSQL and/or Kafka through Kubernetes operators (CloudNativePG, Zalando, or Crunchy PGO; Strimzi, Confluent for Kubernetes, or similar), and authoring and maintaining Helm charts. Depth with one operator matters more than the specific product.
  • GitOps & IaC: Day-to-day use of Argo CD or Flux, Terraform, and CI/CD pipelines (GitHub Actions, GitLab CI, or similar) in a declarative, review-driven workflow.
  • PostgreSQL Operations: Practical PostgreSQL administration — replication and failover, backup and point-in-time recovery, connection pooling (PgBouncer), version upgrades, and performance troubleshooting.
  • Kafka Operations: Running Kafka in production — brokers, topics and partitions, replication, consumer groups, monitoring, and capacity planning.
  • Reliability & DR: Designing and testing high availability and disaster recovery for stateful systems, with defined RPO/RTO.
  • Automation: Strong scripting and programming in Go (preferred) or Python, plus Bash.

Nice to Have

  • Cross-region replication (CloudNativePG replica clusters, Kafka MirrorMaker 2) and global/regional multi-site architectures.
  • Debezium, Kafka Connect, and transactional outbox / CDC patterns.
  • Identity integration for data platforms (Keycloak, OIDC, LDAP/Active Directory).
  • Observability stacks (Prometheus, Grafana, OpenTelemetry, VictoriaMetrics).
  • Secrets and security tooling (Vault/OpenBao, cert-manager, mTLS).
  • Bare-metal infrastructure, Ceph or object storage, or GPU/AI infrastructure.
  • Contributions to CloudNativePG, Strimzi, or related open-source projects.
  • Experience in SOC 2 or ISO 27001 environments.

Education and Experience

Bachelor's degree in Computer Science or a related field, or equivalent practical experience.

Additional Information

What does Mirantis offer you?

  • Work with an established Silicon Valley leader in the cloud infrastructure industry;
  • Work with exceptionally passionate, talented and engaging colleagues, helping Fortune 500 and Global 2000 customers implement next-generation cloud technologies;
  • Be a part of cutting-edge, open-source innovation;
  • Thrive in the high-energy environment of a young company where openness, collaboration, risk-taking, and continuous growth are valued;
  • Professional development and training;
  • Attend conferences and working groups;
  • Company outings, happy hours, hackathons, and tech talks;
  • Receive a competitive compensation package with a strong benefits plan.

We are a Leader for Container Management in G2 (#2 after AWS)!

HQ

Mirantis Campbell, California, USA Office

900 E Hamilton Ave,, Campbell, CA, United States, 95008

Similar Jobs

37 Minutes Ago
Remote
United States
92K-130K Annually
Senior level
92K-130K Annually
Senior level
Cloud • Greentech • Social Impact • Software • Consulting
Own budgeting, forecasting, long-range planning, reporting, financial modeling, and decision support. Partner with business leaders to analyze performance, spending, headcount, SaaS metrics, profitability, investments, EBITDA, working capital, and M&A opportunities. Maintain EPM models and reporting integrity, improve processes, prepare executive and Board materials, and communicate risks and recommendations to financial and non-financial stakeholders.
Top Skills: AbacumAnaplanExcelMicrosoft PowerpointPigmentWorkday Adaptive Planning
37 Minutes Ago
Remote
USA
170K-185K Annually
Senior level
170K-185K Annually
Senior level
Artificial Intelligence • Cloud • Information Technology • Energy • Infrastructure as a Service (IaaS)
Leads public-policy and community-engagement strategy for development opportunities, assessing sites, navigating approvals, monitoring legislation, and building relationships with officials, regulators, utilities, and communities. Represents the company at hearings and forums, prepares policy and stakeholder materials, advises internal teams, coordinates external advisors, supports digital engagement, and mentors junior staff. The U.S.-based role requires frequent travel to project sites and communities.
38 Minutes Ago
Remote
USA
165K-190K Annually
Expert/Leader
165K-190K Annually
Expert/Leader
Artificial Intelligence • Cloud • Information Technology • Energy • Infrastructure as a Service (IaaS)
Build and lead Riot’s project controls function for large capital construction projects. Establish standardized systems for cost, scheduling, change management, risk, procurement commitments, forecasting, reporting, and executive dashboards. Implement controls tools integrated with finance and project management systems, oversee onsite control managers and third-party schedulers, and provide leadership recommendations based on project data.
Top Skills: Primavera P6

What you need to know about the San Francisco Tech Scene

San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.

Key Facts About San Francisco Tech

  • Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Google, Apple, Salesforce, Meta
  • Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
  • Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
  • Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account