LibSys Inc. Logo

LibSys Inc.

Sr. Hadoop/Hive Consultant

Reposted 3 Months Ago
Be an Early Applicant
In-Office
Foster City, CA, USA
Senior level
In-Office
Foster City, CA, USA
Senior level
Design and implement a BI solution on Hadoop/Hive: develop ETL processes, data transformations, populate Hadoop cluster and BI server, add security controls, support reporting, and iterate on user-driven enhancements.
The summary above was generated by AI
Company Description

The client is VISA

Job Description

Position: Sr. Hadoop/Hive Consultant

Location – Foster City, CA

Duration: 1 year long

The Analytics Software Engineer will work directly with Client Sales Analytics Team and Solutions Architects to develop and deploy a business intelligence and analytics solution for internal end users and stakeholders. The ideal candidate will have experience or the ability to develop a warehouse environment for analytical consumption and deployment of visual aggregated data to internal consumers. 

Responsibilities 

The responsibilities for this position are: 

Collaboratively develop a business intelligence (BI) solution, using Hadoop (Hive) 

Coordinate with, support, and complement the solutions architect 

Develop and implement ETL processes to securely and consistently populate the designated Hadoop cluster, as well as the BI server 

Develop data transformations and extractions in Hadoop/Hive as needed to support canned and ad hoc reporting and analytical requirements 

Implement administrative access and security controls, once solution is in place 

Gather user requirements for and develop early iteration enhancements post release 

Qualifications

Qualifications 

Required Skills 

The candidate must have the following: 

- Bachelor of Science or Masters of Science in Computer Science or related degree from an accredited university or equivalent experience 

- Familiarity with NOSQL and distributed architecture (Hadoop) 

- Experience in relational database usage with commercial-grade databases such as Oracle or MySQL 

- Experience with Test Driven Development 

- Experience in designing and scripting functional tests and unit tests 

- Good oral and written communications skills 

Familiarity with: 

- Cloudera distribution software 

- Tableau BI/data visualization 

- Experience with Agile, methodologies like Scrum and Kanban 

Additional Information

All your information will be kept confidential according to EEO guidelines.

Similar Jobs

A Minute Ago
Remote or Hybrid
United States
Junior
Junior
Automotive • Big Data • Information Technology • Robotics • Software • Transportation • Manufacturing
Manages Chevrolet dealership relationships across West Texas, coaching dealer leadership, driving vehicle and parts sales, optimizing inventory, launching GM programs, analyzing performance, resolving concerns, and ensuring compliance with GM standards. The role requires frequent territory travel, strong business planning, data analysis, relationship management, and legal operation of a motor vehicle.
Top Skills: Consensus Allocation SystemData Visualization ToolsGoogle WorkspaceSpreadsheet And Reporting ToolsVehicle Ordering System
A Minute Ago
Hybrid
Mountain View, CA, USA
125K-193K Annually
Senior level
125K-193K Annually
Senior level
Automotive • Big Data • Information Technology • Robotics • Software • Transportation • Manufacturing
Develops vehicle E/E and SDV platform architecture and sourcing strategies across ICE and EV programs. Leads architecture trade studies, evaluates compute, connectivity, semiconductor, ECU, networking, and software solutions, and translates architecture decisions into RFQs, supplier requirements, and commercial evaluation criteria. Assesses total cost, supply-chain risks, supplier roadmaps, and lifecycle considerations. Partners with technical teams, suppliers, and leadership on requirements, validation, sourcing decisions, and architecture recommendations.
Top Skills: AcceleratorsAutomotive E/E ArchitectureCentralized/Domain/Zonal ComputingConnectivity SystemsEcusEmbedded SystemsEv PlatformsIce PlatformsIn-Vehicle NetworksMcusMemoryProcessorsSemiconductorsSensorsSocsSoftware-Defined Vehicles (Sdv)
A Minute Ago
Remote or Hybrid
United States
185K-284K Annually
Senior level
185K-284K Annually
Senior level
Automotive • Big Data • Information Technology • Robotics • Software • Transportation • Manufacturing
Lead AI and autonomous vehicle behavior safety strategy for Level 3–4 automated driving systems. Own behavior safety claims, evidence criteria, validation methodologies, performance indicators, and launch-readiness assurance. Evaluate ML-driven AV performance using simulation, closed-course, and public-road data. Define safety metrics and strategies for imitation and reinforcement learning systems, interpret applicable standards, and influence cross-functional engineering teams and executives.
Top Skills: Artificial IntelligenceAutonomous Driving SystemsAvsc Best PracticesBigQueryDataflowDeep LearningGenerative AiGitGoogle Cloud PlatformImitation LearningIso 21448Iso 5083Iso/Pas 8800JIRALarge Language ModelsMachine LearningMlflowReinforcement LearningRobotics

What you need to know about the San Francisco Tech Scene

San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.

Key Facts About San Francisco Tech

  • Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Google, Apple, Salesforce, Meta
  • Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
  • Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
  • Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account