Bot Auto Logo

Bot Auto

Senior Software Engineer, Workflow Platforms

Posted 14 Days Ago
In-Office or Remote
6 Locations
Senior level
In-Office or Remote
6 Locations
Senior level
The Senior Software Engineer, Workflow Platforms will architect, build, and operate orchestration platforms for machine learning, data pipelines, and CI/CD at Bot Auto, ensuring reliability and efficiency.
The summary above was generated by AI
Company Introduction

At Bot Auto, we are revolutionizing the transportation of goods with our cutting-edge autonomous trucks, enhancing the quality of life for communities around the globe. With the agility of a start-up and the wisdom of seasoned experts, Bot Auto boasts a team that has achieved numerous world-firsts and unparalleled innovations. United by a shared vision, we create miracles and propel the future of transportation. Join us and transform your dreams into reality.

We are seeking a highly skilled and motivated Senior Software Engineer, Workflow Platforms to architect, build, and operate the workflow orchestration platforms that power Bot Auto's engineering and autonomy workloads. From simulation and machine learning training to data pipelines and CI/CD, our teams depend on reliable, scalable workflow systems to move fast. In this role, you will own one or a hybrid of orchestration platforms (such as Argo Workflows and Airflow), operate them at scale, and develop the internal platforms and abstractions built on top of them that make running complex workloads simple, observable, and cost-efficient.

Key Responsibilities
  • Architect, deploy, and operate workflow orchestration platforms (e.g., Argo Workflows, Airflow, or a hybrid) supporting simulation, machine learning and model training, data pipelines, CI/CD, and other general-purpose workloads.
  • Build internal platforms, abstractions, SDKs, and self-service tooling on top of orchestration engines to make authoring, running, and monitoring workflows simple and reliable for engineers.
  • Operate workflow platforms at scale on Kubernetes across cloud (AWS) and on-prem data center environments, handling scheduling, autoscaling, GPU and heterogeneous resources, and cross-cluster orchestration.
  • Ensure reliability, performance, and cost efficiency of workloads through observability, queuing and prioritization, retries, and resource optimization.
  • Partner with ML, simulation, data, and infrastructure teams to understand workload requirements and deliver fit-for-purpose pipelines.
  • Integrate workflow platforms with storage, data streaming and event systems, artifact and model registries, and CI/CD tooling.
  • Establish best practices, templates, and documentation for workflow authoring and operations; mentor engineers across the company.
  • Handle user-impacting issues promptly with clear communication — mitigate in the short term and follow up with durable long-term solutions.
Required Qualifications
  • Bachelor's degree in Computer Science, Engineering, or a related field, or equivalent experience
  • 5+ years of hands-on experience in platform engineering, infrastructure, DevOps, or SRE roles
  • Significant experience with workflow orchestration platforms such as Argo Workflows, Airflow, or comparable systems
  • Strong software development skills in one or more languages: Python, Go, Java, or JavaScript/TypeScript
  • Solid understanding of Kubernetes and distributed systems
Preferred Qualifications
  • Expert-level experience operating Argo Workflows, Airflow, and/or other engines (e.g., Prefect, Dagster, Temporal, Kubeflow Pipelines, Flyte)
  • Experience orchestrating ML training, simulation, or large-scale data and batch workloads, including GPU scheduling
  • In-depth Kubernetes experience (EKS, GKE, AKS, RKE2/Rancher) and cross-cluster orchestration
  • IaC tools proficiency, including Terraform, Pulumi, OpenTofu, or Ansible
  • Experience with data streaming and event platforms, including NATS JetStream, Kafka, Pulsar, or RabbitMQ
  • Familiarity with observability stacks: Prometheus, Grafana, Loki, OpenTelemetry, or comparable
  • Demonstrated ability to optimize workload cost and performance without compromising reliability

Similar Jobs

2 Hours Ago
In-Office or Remote
7 Locations
123K-368K Annually
Senior level
123K-368K Annually
Senior level
Blockchain • eCommerce • Fintech • Payments • Software • Financial Services • Cryptocurrency
Lead and close high-value, complex enterprise deals end-to-end. Drive insight-led strategy, manage multi-stakeholder technical sales cycles with Solutions Engineering, align internal stakeholders (Finance, Legal, Risk, Product), represent the company to executives, influence product and GTM, and use AI tools to increase efficiency.
Top Skills: Ai ToolsApi IntegrationsFintechPaymentsSaaS
2 Hours Ago
Easy Apply
Remote or Hybrid
Easy Apply
137K-189K Annually
Senior level
137K-189K Annually
Senior level
Big Data • Cloud • Software • Database
The Senior Python Engineer will develop and support MongoDB Python drivers, collaborate with teams, and resolve bugs, enhancing user experience with MongoDB tools.
Top Skills: Ai/Ml FrameworksDjangoMongoDBPymongoPython
2 Hours Ago
Easy Apply
Remote or Hybrid
Easy Apply
112K-155K Annually
Senior level
112K-155K Annually
Senior level
Big Data • Cloud • Software • Database
The Senior Product Manager will oversee the strategy and execution of MongoDB's replication and storage engines ensuring system reliability and performance for critical workloads.
Top Skills: DatabasesDistributed SystemsMongoDB

What you need to know about the San Francisco Tech Scene

San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.

Key Facts About San Francisco Tech

  • Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Google, Apple, Salesforce, Meta
  • Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
  • Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
  • Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account