Senior Data Infrastructure Engineer
Who We Are:
Komodo Health is addressing the global burden of disease through the development of the world’s most actionable map of healthcare data. Our solutions drive a more transparent, efficient and productive healthcare ecosystem through the creation of quantitative solutions to qualitative problems.
As a fast growing startup that has already partnered with multiple Fortune 500 companies, we have very ambitious goals that have been designed with career development in mind. As a company, we value our culture of encouraging growth, collaboration, and constructive debate as well as delivering innovative solutions that “wow” our customers.
The Opportunity at Komodo Health:
You will be a member of our Infrastructure Team. You will have the opportunity to use the latest and greatest tools to make sure the the data infrastructure is robust and scalable.
As one of the members of this business-critical team, you will:
- Design and Architect Data Infrastructure
- Mentor junior engineers
- Optimize Spark Infrastructure
- Building out big tooling to interact with Big Data infra
- Evaluate data technologies, such as:
- Delta lake (Data Lake)
- Apache Presto (SQL Query Engine)
What You Bring to Komodo:
- You possess a sense of curiosity and the ability to think thoroughly about problems and develop robust solutions.
- You’re passionate about about big data technologies and architecting scalable infrastructure.
- You’re able to communicate effectively, work cross-functionally and provide technical leadership
- You have a demonstrated track record of success and engineering excellence
- You possess a strong DevOps and partnership mindset
- You’re humble, respectful, and appreciate the diversity within our Engineering organization
After 3 months, you will:
- Architecting and design data infrastructure
- Insuring architecture is secure.
- Mentoring junior engineers
Responsibilities:
- Architect and optimize our Kubernetes and Spark infrastructure to ensure it’s scalable and efficient
- Work deeply with AWS compute, storage, and analytics services
- Build and maintain Docker images used by our Kubernetes and Spark clusters
- Evaluate different cluster managers such as YARN, Mesos, and Kubernetes
- Collaborate with our data scientists and data engineers to understand their use cases, needs, and pain points and translate that into infrastructure that accelerates them
- Select the key tools and systems that will be used to build out the infrastructure
- Setup monitoring, logging, and alerting on our big data systems
- Respond to and troubleshoot issues and incidents with Kubernetes and Spark
- Automate infrastructure with languages and tools such as Helm, Terraform, Packer, CloudFormation, Python, and Bash
- Willingness to participate in on-call rotations
Qualifications:
- B.S., M.S., or Ph.D in Computer Science, Software Engineering, or equivalent experience
- Deep understanding of big data systems and architecture
- 8+ years in an infrastructure engineering role
- 5+ years of Docker, Kubernetes, and container management
- 3+ years of experience with big data technologies such as Spark, Hadoop
- You have a strong background in operating systems, distributed systems, large scale software engineering
- You have experience building large scale, low-latency distributed systems using open source tools
- You have experience working with cloud infrastructure, especially AWS
- You have experience with deploying Spark at scale
- You have excellent programming skills in Python, C++, or other programming languages
Nice-to-Haves:
- You have experience working in a regulated environment especially HIPAA and healthcare data
- You have experience building machine learning production systems at scale
- You have experience with Elastic Map Reduce and AWS Glue
- AWS certifications
Benefits:
- Competitive salary
- Performance bonuses
- Unlimited PTO
- Equity
- 401K Plan
- Wellness Stipend
- Your choice of equipment
- Comprehensive Vision, Medical, and Dental insurance
- Pre-tax commuter benefits
- Community involvement through our philanthropy group, Komodo Cares
- Awesome office locations in San Francisco (SoMa) or New York City (Flatiron)
- The opportunity to help scale a team and company and work with smart people
At Komodo Health, we don’t just accept difference — we celebrate it, we support it, and we thrive on it for the benefit of our employees, our products, and our community. Komodo Health is proud to be an equal opportunity workplace.