Tensorlake Logo

Tensorlake

Distributed Systems Engineer

Reposted 27 Days Ago
Be an Early Applicant
In-Office
San Francisco, CA, USA
Senior level
In-Office
San Francisco, CA, USA
Senior level
Build core infrastructure for a durable application runtime: implement schedulers, runtimes, and data plane components in Rust; optimize cluster scheduling, resource utilization, and performance; extend SDKs; collaborate across product and engineering from research to production.
The summary above was generated by AI

Our core mission at Tensorlake is to unlock your data wherever it is. We believe that people should have access to the best tools to parse, extract, and manipulate data, run data applications, so they can spend more time putting knowledge into action.

We’re looking for engineers who want to build the operating system for AI Data Applications and Workflows.

About the role

We're looking for experienced distributed systems engineers to build the core infrastructure for our durable application runtime. This is a systems programming role—you'll be writing the schedulers, runtimes, and data plane components that other engineers build applications on top of. Some of the things you'll work on in this role

  • Build and evolve our durable application runtime to support advanced data processing and machine learning workflows
  • Design and implement core components of our cluster scheduler to improve resource utilization, reduce costs, and maximize performance
  • Write systems-level code in Rust for our data plane and execution engine
  • Design and build new capabilities for our SDKs
  • Work closely with the rest of the engineering team to take something from an idea to a polished product
About you
  • You have 5+ years of experience building distributed systems infrastructure—not configuring or operating it, but designing and implementing it from scratch
  • You've written production systems in Rust or other systems programming languages (C, C++, Go at the systems level)
  • You understand how cluster schedulers, databases, and runtimes work at the implementation level because you've built or contributed to them
  • You can autonomously lead, design, and build fault-tolerant systems
  • You enjoy diving deep into performance challenges at the systems level—memory allocation, concurrency primitives, network protocols
  • You want to be part of the entire product development process, from customer research to implementation

This role is not a fit if...

  • Your experience is primarily in DevOps, SRE, or platform operations (Terraform, Kubernetes administration, CI/CD pipelines)
  • You're looking for a role focused on automation, tooling, or infrastructure-as-code rather than building core systems
  • You haven't written substantial code in a systems programming language
Things you should know
  • We’re a startup, and we expect people to be able to wear multiple hats at any given time.
  • We’re distributed across the US and Europe, and everyone is self-sufficient to get work done even when nobody else is around.
  • We do not expect people to work all the time, but we expect everyone to follow up on their commitments.
  • We’re a small team with high ownership and we’re passionate about what we do.
  • Our tech stack is somehow diverse. You’d be mostly working with Rust, Python and FoundationDB on your day to day. But you’ll also need to understand TypeScript, Go, and Terraform enough to touch parts of our backend infrastructure.


Similar Jobs

2 Days Ago
In-Office
Sunnyvale, CA, USA
227K-303K Annually
Expert/Leader
227K-303K Annually
Expert/Leader
Cloud • Information Technology • Machine Learning
Provide technical leadership for security-critical distributed systems, including authorization platforms, a Security Token Service, anomaly detection, bot defense, and API authentication gateways. Define multi-region architectures, fault-tolerance strategies, consistency models, security boundaries, observability, and operational standards. Guide architecture and design reviews, reliability and performance efforts, incident learning, and production readiness while mentoring senior engineers and aligning cross-functional teams.
Top Skills: C++Certificate AuthoritiesCryptographyDistributed StorageGoHsmsJavaJwtKubernetesMessaging SystemsMtlsMulti-Cloud InfrastructureOauth 2.0Openid ConnectPythonRustSAMLScimSecrets ManagementService NetworkingSpiffeSpire
7 Days Ago
Hybrid
San Francisco, CA, USA
168K-266K Annually
Senior level
168K-266K Annually
Senior level
Cloud • Information Technology • Security • Software • Cybersecurity
Design, build, and operate Cloudflare’s globally distributed cache and reverse-proxy data plane. Responsibilities include improving Pingora-based asynchronous systems, cache performance and correctness, purge and Tiered Cache services, APIs, observability, reliability, and production operations. The role owns features end to end, including design, implementation, testing, staged rollouts, incident response, and cross-team collaboration.
Top Skills: CC++ClickhouseGoHTTPKafkaKubernetesLinuxPingoraPostgresQuicRustTcpTls
19 Days Ago
Hybrid
Mountain View, CA, USA
160K-240K Annually
Senior level
160K-240K Annually
Senior level
Artificial Intelligence • Big Data • Cloud • Machine Learning • Software • Business Intelligence • Data Privacy
Build and optimize distributed compute infrastructure for large-scale analytical and AI workloads. Responsibilities include improving query execution, scheduling, resource allocation, reliability, workload routing, and compute efficiency across Spark and related systems. The role involves debugging performance bottlenecks, optimizing joins, scans, shuffles, caching, partitioning, and memory usage, and working with lakehouse formats and cloud object storage. Candidates will implement workload optimization algorithms and may contribute to open source or research.
Top Skills: Adaptive Query ExecutionAmazon EmrAmazon S3Apache FlinkApache HiveApache HudiApache IcebergSparkAws GlueAzure Data Lake StorageC++CatalystDatabricksDatafusionDelta LakeDuckdbGoGoogle Cloud StorageJavaOrcParquetPrestoRustScalaSnowflakeSpark SqlTrinoVelox

What you need to know about the San Francisco Tech Scene

San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.

Key Facts About San Francisco Tech

  • Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Google, Apple, Salesforce, Meta
  • Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
  • Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
  • Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account