Engineering Manager, Storage
OVERVIEW
Rapidly growing startups all face critical infrastructure decisions to ensure they continue to offer great service world-wide. One of the most important areas is developing a scalable, durable, and highly available storage strategy. Our customers data is one of our most important assets and not only does it need to be available for our service to run, we must protect it with security and disaster recovery. Instacart is looking for a leader to help us both through today’s scaling challenges but put us in a good position to avoid further challenges down the road.
This Manager will develop strategies for managed cloud services or internally built and managed systems in-house. They will drive the organizational strategy for what data stores we support and help development teams select the storage solution that best suits their needs. You will build your team from the ground up and lay out our strategy for offering a Storage Platform. This is required for large engineering organizations to collaborate with shared stores and provides the abstraction that makes it easy for teams to manage their own data stores. Storage spans more than just databases. We also expect this group to drive our strategy for data streaming and caching.
ABOUT THE JOB
- Recruit and organize a team of world-class managers and engineers aligned on the vision of developing a Storage Platform for a scaled engineering operation
- Define our Storage strategy, including how and when we decide to shard databases or introduce new storage technology
- Lead capacity planning and management across our data systems
- Define the reliability automation that continuously replaces databases to ensure our highest possible reliability
- Abstract managed service utilization for development teams ensuring safe and secure utilization
- Lead the creation of developer tooling and workflows to help assist with schema management collaboration and safety
- Develop programs and tools that guide developers on how to work with data at scale and protect our Storage infrastructure from self-inflicted poor usage patterns
- Enable rapid development velocity with self-service sandbox and dev provisioning
- Own the backup, restoration, and disaster recovery strategy for our data
ABOUT YOU
- You have worked with database systems at large scale requiring single database instances to be broken down by either functional sharding or data-driven sharding
- Experience with RDBMS, NoSQL, search, caching, queueing, file systems, block storage and beyond
- AWS specific experience working with S3, RDS or Aurora
- Kafka, Kinesis or other related streaming infrastructure leadership
- You are capable of understanding current headroom for data systems and predict future headroom
- You can write and present effectively. You have proven experience with authoring roadmap documents, project plans, RCAs, and team development documents. You are able to speak with clarity and influence to entry level engineers and technical/business leadership alike.
- You think about Infrastructure as products to be offered to the rest of your engineering partners
- 5-10 years of people management experience