Lead Big Data Engineer

| San Francisco
Sorry, this job was removed at 9:44 a.m. (PST) on Thursday, January 30, 2020
Find out who's hiring in San Francisco.
See all Data + Analytics jobs in San Francisco
Apply
By clicking Apply Now you agree to share your profile information with the hiring company.

Named as one of Fortunes’ 100 Fastest Growing Companies for 2019, EPAM is committed to providing our global team of 30,100+ EPAMers with inspiring careers from day one. EPAMers lead with passion and honesty and think creatively. Our people are the source of our success and we value collaboration, try to always understand our customers’ business, and strive for the highest standards of excellence. No matter where you are located, you’ll join a dedicated, diverse community that will help you discover your fullest potential.
 

DESCRIPTION

You are curious, persistent, logical and clever – a true techie at heart. You enjoy living by the code of your craft and developing elegant solutions for complex problems. If this sounds like you, this could be the perfect opportunity to join EPAM as a Lead Big Data Engineer. Scroll down to learn more about the position’s responsibilities and requirements.

#LI-DNI

WHAT YOU’LL DO

  • Lead, design and implement innovative analytical solution using Hadoop, NoSQL, and other Big Data related technologies
  • Work with product and engineering teams to understand requirements, evaluate new features and architecture to help drive decisions
  • Build collaborative partnerships with architects, technical leads and key individuals within other functional groups
  • Perform detailed analysis of business problems and technical environments and use this in designing quality technical solution
  • Actively participate in code review and test solutions to ensure it meets best practice specifications
  • Build and foster a high performance engineering culture, mentor team members and provide team with the tools and motivation to make things happen
  • Work with stakeholders and cross-functional teams to develop new solutions or enhance existing solution

WHAT YOU HAVE

  • 5+ years of software development and deployment experience with at least 2 years of hands-on experience with Hadoop applications (e.g. administration, configuration management, monitoring, debugging, and performance tuning)
  • Strong experience building data ingestion pipelines (simulating Extract, Transform, Load workload), data warehouse or database architecture
  • Solid, in depth understanding of Hadoop, Spark and Hive
  • Strong experience with data modeling
  • Hands-on development experience using open source big data components such as Hadoop, Hive, Pig, Spark, HBase, Hawk, Oozie, Mahout, Flume, Kafka, ZooKeeper, Sqoop etc. preferably with Hortonworks distro
  • Microsoft Azure: Experience designing, deploying, and administering scalable, available, and fault tolerant systems on Microsoft Azure using HDInsights or Analytics Platform System (APS)
  • Experience with Azure Management Portal, Azure Machine Learning, and Azure SQL Server
  • Solid understanding of DevOps principles and practices
  • Experience with Scala/Java/Python (any combination)
  • Analytical approach to problem-solving with an ability to work at an abstract level and gain consensus; excellent interpersonal, leadership and communication skills
  • Data-oriented personality. Motivated, independent, efficient and able to handle several projects; work under pressure with a solid sense for setting priorities
  • Ability to work in a fast-paced (startup like) agile development environment
  • Friendly, articulate, and interested in working in a fun, small team environment
  • Experience working in the retail industry with a large-scale enterprise organization, ecommerce, marketing and CRM applications will be a plus
  • BS or MS in Computer Science or equivalent; MS preferred

WHAT WE OFFER

  • Medical, Dental and Vision Insurance (Subsidized)
  • Health Savings Account
  • Flexible Spending Accounts (Healthcare, Dependent Care, Commuter)
  • Short-Term and Long-Term Disability (Company Provided)
  • Life and AD&D Insurance (Company Provided)
  • Employee Assistance Program
  • Unlimited access to LinkedIn learning solutions
  • Matched 401(k) Retirement Savings Plan
  • Paid Time Off
  • Legal Plan and Identity Theft Protection
  • Accident Insurance
  • Employee Discounts
  • Pet Insurance
  • EPAM welcomes all applicants and will consider qualified candidates with criminal history such as arrest and conviction records in a manner consistent applicable law, including the San Francisco Fair Chance Ordinance and Los Angeles Fair Chance Initiative for Hiring
Read Full Job Description
Apply Now
By clicking Apply Now you agree to share your profile information with the hiring company.

Location

EPAM is located in the heart of SF's historic Financial District, accessible by car, bus lines, streetcars and the California Cable Car line.

Similar Jobs

Apply Now
By clicking Apply Now you agree to share your profile information with the hiring company.
Learn more about EPAM SystemsFind similar jobs