Senior Data Infrastructure Engineer

Sorry, this job was removed at 11:09 a.m. (PST) on Friday, February 21, 2020
Find out who's hiring in San Francisco.
See all Data + Analytics jobs in San Francisco
Apply
By clicking Apply Now you agree to share your profile information with the hiring company.

Who We Are:

Komodo Health is addressing the global burden of disease through the development of the world’s most actionable map of healthcare data. Our solutions drive a more transparent, efficient and productive healthcare ecosystem through the creation of quantitative solutions to qualitative problems.

As a fast growing startup that has already partnered with multiple Fortune 500 companies, we have very ambitious goals that have been designed with career development in mind. As a company, we value our culture of encouraging growth, collaboration, and constructive debate as well as delivering innovative solutions that “wow” our customers. 

The Opportunity at Komodo Health:

You will be a member of our Infrastructure Team. You will have the opportunity to use the latest and greatest tools to make sure the the data infrastructure is robust and scalable.

As one of the members of this business-critical team, you will: 

  • Design and Architect Data Infrastructure 
  • Mentor junior engineers
  • Optimize Spark Infrastructure 
  • Building out big tooling to interact with Big Data infra
  • Evaluate data technologies, such as:
    • Delta lake (Data Lake) 
    • Apache Presto (SQL Query Engine)

What You Bring to Komodo:

  • You possess a sense of curiosity and the ability to think thoroughly about problems and develop robust solutions.
  • You’re passionate about about big data technologies and architecting scalable infrastructure.
  • You’re able to communicate effectively, work cross-functionally and provide technical leadership
  • You have a demonstrated track record of success and engineering excellence
  • You possess a strong DevOps and partnership mindset
  • You’re humble, respectful, and appreciate the diversity within our Engineering organization

After 3 months, you will:

  • Architecting and design data infrastructure
  • Insuring architecture is secure.
  • Mentoring junior engineers

Responsibilities:

  • Architect and optimize our Kubernetes and Spark infrastructure to ensure it’s scalable and efficient
  • Work deeply with AWS compute, storage, and analytics services
  • Build and maintain Docker images used by our Kubernetes and Spark clusters
  • Evaluate different cluster managers such as YARN, Mesos, and Kubernetes
  • Collaborate with our data scientists and data engineers to understand their use cases, needs, and pain points and translate that into infrastructure that accelerates them
  • Select the key tools and systems that will be used to build out the infrastructure
  • Setup monitoring, logging, and alerting on our big data systems
  • Respond to and troubleshoot issues and incidents with Kubernetes and Spark
  • Automate infrastructure with languages and tools such as Helm, Terraform, Packer, CloudFormation, Python, and Bash
  • Willingness to participate in on-call rotations

 Qualifications:

  • B.S., M.S., or Ph.D in Computer Science, Software Engineering, or equivalent experience
  • Deep understanding of big data systems and architecture
  • 8+ years in an infrastructure engineering role
  • 5+ years of Docker, Kubernetes, and container management
  • 3+ years of experience with big data technologies such as Spark, Hadoop
  • You have a strong background in operating systems, distributed systems, large scale software engineering
  • You have experience building large scale, low-latency distributed systems using open source tools
  • You have experience working with cloud infrastructure, especially AWS
  • You have experience with deploying Spark at scale
  • You have excellent programming skills in Python, C++, or other programming languages

Nice-to-Haves:

  • You have experience working in a regulated environment especially HIPAA and healthcare data
  • You have experience building machine learning production systems at scale
  • You have experience with Elastic Map Reduce and AWS Glue
  • AWS certifications

Benefits:

  • Competitive salary
  • Performance bonuses
  • Unlimited PTO
  • Equity
  • 401K Plan
  • Wellness Stipend
  • Your choice of equipment
  • Comprehensive Vision, Medical, and Dental insurance
  • Pre-tax commuter benefits
  • Community involvement through our philanthropy group, Komodo Cares
  • Awesome office locations in San Francisco (SoMa) or New York City (Flatiron)
  • The opportunity to help scale a team and company and work with smart people

At Komodo Health, we don’t just accept difference — we celebrate it, we support it, and we thrive on it for the benefit of our employees, our products, and our community. Komodo Health is proud to be an equal opportunity workplace.

Read Full Job Description
Apply Now
By clicking Apply Now you agree to share your profile information with the hiring company.

Location

680 Folsom Street, San Francisco, CA 94107

Similar Jobs

Apply Now
By clicking Apply Now you agree to share your profile information with the hiring company.
Learn more about Komodo HealthFind similar jobs