LanceSoft Logo

LanceSoft

Hadoop Developer / Big Data Developer

Reposted 6 Days Ago
In-Office
Irving, TX
Senior level
In-Office
Irving, TX
Senior level
The role involves design and development using Hadoop and its ecosystem, requiring strong programming skills in Java, Python, and SQL, with experience in data warehouses.
The summary above was generated by AI
Company Description

In business since 2000, LanceSoft is a nationally certified Minority Business Enterprise (MBE) that has established itself as a pioneer in providing highly scalable, cost-effective workforce solutions to a diverse set of customers across various industries in the United States.

Job Description

Description:

Design and development on Hadoop software ecosystem and development on MapReduce, HBase, Hive, Pig,

Programming in Spark/Storm

Programming in distributed messaging system –Kafka

Programming in PIG/Python

Top Skill Sets:

• Hadoop Hortonworks distribution or Cloudera

• HIVE/PIG/MapReduce

• Programming in Linux

• Programming in Advance Java

Required skill plus years of experience:

6+ years in application development experience in Java / Java EE / Python / Ruby or Scala

6+ years in strong development experience in core Java and Linux environment.

6+ years of strong SQL skills (MySQL, PostgreSQL, RDBMS)

2+ years in Hadoop – HDFS, Hive, MapReduce, HBase

2+ years of experience with NOSQL database – HBase

1+ years of working knowledge in Kafka/Storm data pipelines

6+ years of experience in working in a Data warehouse environment

4+ years of Linux skills

2+ years in code documentation and API/Framework documentation/process build.

* Bachelor’s degree

Desired Skills:

• Scala or Python programming

Additional Information

All your information will be kept confidential according to EEO guidelines.

LanceSoft Fremont, California, USA Office

39510 Paseo Padre Parkway, Fremont, United States, 94538

LanceSoft San Jose, California, USA Office

San Jose, United States

Similar Jobs

Yesterday
In-Office
100K-150K Annually
Senior level
100K-150K Annually
Senior level
Artificial Intelligence • Information Technology • Software • Consulting
Design, build, and operate large-scale Hadoop-based data pipelines and streaming platforms. Implement ETL/ELT with Spark, Hive, Pig, and Sqoop; build Kafka/Flink/Spark Streaming pipelines; optimize performance; manage storage formats (Parquet/ORC/Delta/etc.); enforce data governance, monitoring, and orchestration (Airflow/Oozie); document architectures and mentor junior engineers.
Top Skills: AirflowApache AtlasSparkAws EmrBigQueryCi/CdCollibraDatabricksDeltaFlinkHadoopHbaseHdfsHiveHudiIcebergInfrastructure-As-CodeJavaKafkaKubernetesMapreduceNoSQLOozieOrcParquetPigPythonScalaShellSnowflakeSpark StreamingSQLSqoopTrino
An Hour Ago
Remote or Hybrid
United States
42K-42K Annually
Junior
42K-42K Annually
Junior
Fintech • Information Technology • Insurance • Financial Services • Big Data Analytics
Handle inbound Long Term Care insurance calls; document interactions; research and resolve errors, contract discrepancies, and processing delays; liaise with operational teams; use computerized systems to track and troubleshoot; meet KPIs, adhere to schedules, and deliver empathetic, solution-focused customer service.
An Hour Ago
Remote or Hybrid
United States
121K-149K Annually
Senior level
121K-149K Annually
Senior level
Fintech • Information Technology • Insurance • Financial Services • Big Data Analytics
Manage relationships with third-party administrators, vendors, brokers, and Korea-based clients. Negotiate domestic and international vendor and client contracts and SLAs, monitor vendor performance, lead renewals, handle claims escalations, deliver Korean-language onboarding presentations and materials, translate portal/content, and pursue new business opportunities with brokers.

What you need to know about the San Francisco Tech Scene

San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.

Key Facts About San Francisco Tech

  • Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Google, Apple, Salesforce, Meta
  • Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
  • Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
  • Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account