Software Engineer - Data

| Remote
Sorry, this job was removed at 5:16 a.m. (PST) on Friday, September 10, 2021
Find out who’s hiring remotely
See all Remote jobs
Apply
By clicking Apply Now you agree to share your profile information with the hiring company.

The Role
If being part of a small dynamic, agile software engineering team practicing TDD with an emphasis on software quality, with a tremendous opportunity to make a big impact, this is the job for you!  This role will provide you with an opportunity to make a huge impact.  You will help drive and maintain a high-level of operational excellence in data engineering.

What You’ll Do

  • Develop integrations to move data into the raw zone of the data lake
  • Build ETL/ELT pipelines to transform data in the raw zone, and load it to the structured and consumer zones of the data lake, and to serving tiers
  • Define and lead the best practices in security, data privacy, quality, and data governance
  • Help lead and collaboratively define Lark's next generation data platform
  • Help build online data validation to ensure the assumptions we’ve tested for in our code remain true; outlier and aberration detection, change-detection, etc.
  • Collaborate with teams across the company to help develop data products that drive company success
  • Evaluate, integrate and build tools and infrastructure to accelerate Data Engineering, Data Science, Business Intelligence, Reporting and Analytics as needed
  • Drive data literacy across business functions

What You’ll Need

  • Knowledge of the “Testing Pyramid”, and have helped other engineers apply it correctly
  • You know S.O.L.I.D. principles and practice them intuitively and appropriately
  • Expertise in Scala, Python, and Java
  • Demonstrated expertise in Object Oriented (OO) and Functional programming (FP) including an expert knowledge of common design patterns, idioms, best practices, dependency injection/inversion frameworks and techniques, testing frameworks, Monad-Transformer-Libraries (MTL), Tagless-Final encoding (and when it’s appropriate), etc.
  • Fluency in data structures, algorithms, distributed computing, storage systems, and multiple consistency models
  • In-depth knowledge of AWS (including EMR, DMS, Athena, RDS, Aurora, Lambda, Redshift, etc.)
  • Expertise in stream data processing (e.g., DMS, Flink, Spark, Kinesis, Kafka)
  • Advanced SQL skills
  • Deep Knowledge of multiple database technologies, their tradeoffs, and how to make the best use of each
  • Willingness to learn and mentor in a collaborative team environment
  • Humility with an intrinsic positive drive
  • Passion for developing a world-class engineering culture
  • Value, respect, and an enthusiasm for diversity, inclusion, and alternative perspectives
  • Goal-oriented, with a desire to create an environment of psychological safety
  • Ability to thrive in an environment promoting and enabling collaboration
  • Solid understanding and hands-on experience in computer network

Education and Experience

  • BS or MS in Computer Science, Mathematics, Computer Engineering, or equivalent experience
  • 3-7 years hands-on software engineering experience with a focus on quality; 2+ years in data engineering
  • Expertise with Apache Spark, DataFrame & Dataset API, spark internals and optimization
  • Data warehouse modernization, building data-marts, star/snowflake schema designs, ETL/ELT pipelines
  • Building production-grade data backup/restore strategies, and disaster recovery solutions experience

Technologies we use in data engineering:

  • Scala, sbt, Python, Pytest, tox, Java, Maven, Github, Code Artifact, Apache Spark (on EMR and Databricks), Airflow, AWS (DynamoDB, RDS, Kinesis, SQS, SNS, MWAA, S3, Lambda, Event Bridge, MSK, EKS, ECR, Kubernetes, Kafka, Delta Lake, SparkML, GraphX, Snowflake and Periscope (Sisense)

JOIN US

Lark is a companion that lives on the user’s phone and provides daily coaching, guidance, and health insights to users. We are on a mission to make the world a healthier, happier place. Come join our team!

 

About Lark

Lark is the world's largest A.I. healthcare provider, servicing nearly 2 million patients suffering from or at risk of chronic disease with A.I. Nurses. Lark uses cutting-edge AI and connected health monitors to provide real-time unlimited 24/7 text-based counseling to help users make healthier choices and manage their conditions. Lark’s A.I. Diabetes Prevention Program (DPP), Smoking Cessation, Behavioral Health, Weight Loss, Diabetes Care, and Hypertension Programs have demonstrated clinically validated outcomes published in 11 peer-reviewed journals and analyst reports. Lark’s DPP, which is now the second-largest and lowest cost DPP in the country, has received the highest clinical certification - CDC Full Recognition. Lark works with some of the largest payers and self-insured employers to help them manage 30.5 million members to live healthier lives. Forrester Research has named Lark "Most Innovative Digital Health Product of the Year", Lark, Uber, Airbnb, WeChat were named the 10 Most Innovative Companies in the World, and Apple named Lark "Top 10 Apps of the Year" against a pool of over 2 million apps.

 

Working at Lark 

Lark offers the option to work remotely in the United States. For Colorado Applicants only: minimum annual salary is $97,000 (minimum salary varies for other geographies). You may also be offered a bonus, stock options and/or benefits. We have identified the “core” period of the day during which all employees are required to work for scheduled meetings, syncs, scrums between 10 a.m. and 3 p.m. Pacific time. The company is headquartered in Mountain View, CA.

Lark is an Equal Opportunity and Affirmative Action Employer. We believe that diverse teams foster innovation and add to our mission-driven culture. We strongly encourage people from underrepresented groups to apply.


#LI-PH1
#BI-Remote 



Read Full Job Description
Apply Now
By clicking Apply Now you agree to share your profile information with the hiring company.

Location

2570 El Camino Real, Mountain View, CA 94040

Similar Jobs

Apply Now
By clicking Apply Now you agree to share your profile information with the hiring company.
Learn more about Lark HealthFind similar jobs