Lead Big Data Engineer at EPAM Systems

| San Francisco
Sorry, this job was removed at 9:44 a.m. (PST) on Thursday, January 30, 2020
Find out who's hiring in San Francisco.
See all Data + Analytics jobs in San Francisco

Named as one of Fortunes’ 100 Fastest Growing Companies for 2019, EPAM is committed to providing our global team of 30,100+ EPAMers with inspiring careers from day one. EPAMers lead with passion and honesty and think creatively. Our people are the source of our success and we value collaboration, try to always understand our customers’ business, and strive for the highest standards of excellence. No matter where you are located, you’ll join a dedicated, diverse community that will help you discover your fullest potential.
 

DESCRIPTION

You are curious, persistent, logical and clever – a true techie at heart. You enjoy living by the code of your craft and developing elegant solutions for complex problems. If this sounds like you, this could be the perfect opportunity to join EPAM as a Lead Big Data Engineer. Scroll down to learn more about the position’s responsibilities and requirements.

#LI-DNI

WHAT YOU’LL DO

  • Lead, design and implement innovative analytical solution using Hadoop, NoSQL, and other Big Data related technologies
  • Work with product and engineering teams to understand requirements, evaluate new features and architecture to help drive decisions
  • Build collaborative partnerships with architects, technical leads and key individuals within other functional groups
  • Perform detailed analysis of business problems and technical environments and use this in designing quality technical solution
  • Actively participate in code review and test solutions to ensure it meets best practice specifications
  • Build and foster a high performance engineering culture, mentor team members and provide team with the tools and motivation to make things happen
  • Work with stakeholders and cross-functional teams to develop new solutions or enhance existing solution

WHAT YOU HAVE

  • 5+ years of software development and deployment experience with at least 2 years of hands-on experience with Hadoop applications (e.g. administration, configuration management, monitoring, debugging, and performance tuning)
  • Strong experience building data ingestion pipelines (simulating Extract, Transform, Load workload), data warehouse or database architecture
  • Solid, in depth understanding of Hadoop, Spark and Hive
  • Strong experience with data modeling
  • Hands-on development experience using open source big data components such as Hadoop, Hive, Pig, Spark, HBase, Hawk, Oozie, Mahout, Flume, Kafka, ZooKeeper, Sqoop etc. preferably with Hortonworks distro
  • Microsoft Azure: Experience designing, deploying, and administering scalable, available, and fault tolerant systems on Microsoft Azure using HDInsights or Analytics Platform System (APS)
  • Experience with Azure Management Portal, Azure Machine Learning, and Azure SQL Server
  • Solid understanding of DevOps principles and practices
  • Experience with Scala/Java/Python (any combination)
  • Analytical approach to problem-solving with an ability to work at an abstract level and gain consensus; excellent interpersonal, leadership and communication skills
  • Data-oriented personality. Motivated, independent, efficient and able to handle several projects; work under pressure with a solid sense for setting priorities
  • Ability to work in a fast-paced (startup like) agile development environment
  • Friendly, articulate, and interested in working in a fun, small team environment
  • Experience working in the retail industry with a large-scale enterprise organization, ecommerce, marketing and CRM applications will be a plus
  • BS or MS in Computer Science or equivalent; MS preferred

WHAT WE OFFER

  • Medical, Dental and Vision Insurance (Subsidized)
  • Health Savings Account
  • Flexible Spending Accounts (Healthcare, Dependent Care, Commuter)
  • Short-Term and Long-Term Disability (Company Provided)
  • Life and AD&D Insurance (Company Provided)
  • Employee Assistance Program
  • Unlimited access to LinkedIn learning solutions
  • Matched 401(k) Retirement Savings Plan
  • Paid Time Off
  • Legal Plan and Identity Theft Protection
  • Accident Insurance
  • Employee Discounts
  • Pet Insurance
  • EPAM welcomes all applicants and will consider qualified candidates with criminal history such as arrest and conviction records in a manner consistent applicable law, including the San Francisco Fair Chance Ordinance and Los Angeles Fair Chance Initiative for Hiring
Read Full Job Description
Apply now
By clicking continue you agree to Built In’s Privacy Policy and Terms of Use.

Technology we use

  • Engineering
    • .NETLanguages
    • C#Languages
    • C++Languages
    • JavaLanguages
    • JavascriptLanguages
    • PythonLanguages
    • ScalaLanguages
    • SqlLanguages
    • SwiftLanguages
    • Big DataLanguages
    • AWSLanguages
    • AzureLanguages
    • D3JSLibraries
    • FluxLibraries
    • ReactLibraries
    • ReduxLibraries
    • AngularJSFrameworks
    • DjangoFrameworks
    • FlaskFrameworks
    • HadoopFrameworks
    • Node.jsFrameworks
    • SparkFrameworks
    • SpringFrameworks
    • CassandraDatabases
    • DB2Databases
    • HBaseDatabases
    • HiveDatabases
    • MemcachedDatabases
    • Microsoft SQL ServerDatabases
    • MongoDBDatabases
    • MySQLDatabases
    • OracleDatabases
    • PostgreSQLDatabases
    • SAP HANADatabases
    • TeradataDatabases

Location

EPAM is located in the heart of SF's historic Financial District, accessible by car, bus lines, streetcars and the California Cable Car line.

An Insider's view of EPAM Systems

How would you describe the company’s work-life balance?

My manager ensures that I have a great work-life balance at EPAM. This is of particular importance to me being the mother of a 19-month-old. They allow me the flexibility to care for my child while providing me with a rewarding career path.

Regine Jones

Senior Manager, Life Sciences Consulting

How has your career grown since starting at the company?

EPAM gave me a fresh start and a great opportunity. From the first day, I was given the support I needed from my mentors to feel that anything is possible. At EPAM, I had the rights tools, support and drive to know that I could really grow my career here.

Ariani

Junior Data Scientist

How do your team's ideas influence the company's direction?

Our team is constantly looking for ways to improve our ability to deliver to the customer and ways to provide our people with a great work environment and career opportunities. Through involvement with different practices within the company, we provide meaningful feedback and ideas to enhance and better target our solutions to our customer needs.

Martin

VP, Technology Solutions

What makes someone successful on your team?

To be successful at EPAM and on my team, you have to be tenacious with a proclivity for pioneering into emerging areas and driving hyper-growth.

Broderick

Managing Principal, Health & Life Sciences Consulting

What are EPAM Systems Perks + Benefits

EPAM Systems Benefits Overview

EPAMers appreciate our flexible and casual work environment, excellent benefits and endless opportunities to thrive. In addition to health benefits, a 401(K) matching program and paid time off, EPAM offers the following perks:

- Competitive Salary & Bonus Program
- Career Development Opportunities
- Tech Community Meet-Ups & Hackathons
- Access to LinkedIn Learning Solutions
- Cutting-edge Internal Tools
- Volunteer & Mentoring Programs
- Travel & Relocation Opportunities
- Employee Discounts

Culture
Volunteer in local community
Partners with Nonprofits
Friends outside of work
Eat lunch together
Daily stand up
Open door policy
Team owned deliverables
Team based strategic planning
Group brainstorming sessions
Pair programming
Open office floor plan
Diversity
Documented equal pay policy
Dedicated Diversity/Inclusion Staff
Highly diverse management team
Unconscious bias training
Diversity manifesto
Someone's primary function is managing the company’s diversity and inclusion initiatives
Health Insurance & Wellness Benefits
Flexible Spending Account (FSA)
Disability Insurance
Dental Benefits
Vision Benefits
Health Insurance Benefits
Life Insurance
Pet Insurance
Wellness Programs
Retirement & Stock Options Benefits
401(K)
401(K) Matching
Performance Bonus
Child Care & Parental Leave Benefits
Generous Parental Leave
Flexible Work Schedule
Remote Work Program
Vacation & Time Off Benefits
Generous PTO
Paid Holidays
Perks & Discounts
Casual Dress
Commuter Benefits
Company Outings
Stocked Kitchen
Professional Development Benefits
Job Training & Conferences
Tuition Reimbursement
Cross functional training encouraged
Promote from within
Mentorship program
Time allotted for learning
Online course subscriptions available
Customized development tracks
More Jobs at EPAM Systems24 open jobs
All Jobs
Finance
Data + Analytics
Design + UX
Dev + Engineer
Project Mgmt
Sales
Sales
new
San Francisco
Sales
new
San Francisco
Developer
new
San Francisco
Project Mgmt
new
San Francisco
Design + UX
new
San Francisco
Project Mgmt
new
San Francisco
Project Mgmt
new
San Francisco
Developer
new
San Francisco
Data + Analytics
new
San Francisco
Developer
new
San Francisco
Data + Analytics
new
San Francisco
Data + Analytics
new
San Francisco
Developer
new
San Francisco
Developer
new
San Francisco
Developer
new
San Francisco
Developer
new
San Francisco
Developer
new
San Francisco
Project Mgmt
new
San Francisco
Developer
new
San Francisco
Sales
new
San Francisco
Sales
new
San Francisco