Cygnus Professionals Inc. Logo

Cygnus Professionals Inc.

Big Data Engineer

Posted 23 Days Ago
In-Office
Palo Alto, CA
Junior
In-Office
Palo Alto, CA
Junior
The Big Data Engineer will work with Java, Spark, and Hadoop to design and implement large-scale data processing systems, focusing on distributed systems and machine learning algorithms.
The summary above was generated by AI
Company Description

Headquartered in New Jersey (U.S), Cygnus Professionals Inc. is a next generation global information technology Solution and Consulting company powered by strong management and leadership team with over 30 person years of experience. Today, Cygnus has strong footprints in more than 4 countries with more than 25 satisfied customers. We strive to extend our presence across industries and geographies with our industry-focused business excellence.
Cygnus Professionals Inc. has been named by the US Pan Asian American Chamber of Commerce Education Foundation (USPAACC) as one of the “Fast 100 Asian American Businesses” – joining the country’s fastest-growing Asian American-owned companies, based on percentage revenue growth over the immediate past two years.

Job Description

Greetings from Cygnus Professionals,

Hope you’re doing great !

I have a requirement for you Kindly go through it, If you feel comfortable and would like to apply for this role so kindly provide me your updated profile along with your contact details and rate part.

Role: Big Data Engineer w/Spark

Location: Palo Alto, CA

Duration: Potential Contract to Hire

Mode of Interview: Skype After Phone

!! Need Green Card OR US Citizen OR EAD GC Candidates Only !!


Position Description:

Experience with Java, Spark and Hadoop

A minimum of 2 years of experience working with distributed systems

Knowledge in distributed system design, data pipelining, and implementation

Knowledge in machine learning algorithms

Knowledge and experience in building large scale applications using various software design patterns and OO design principles

Experience with either distributed computing (Hadoop/Spark/Cloud) or parallel processing (CUDA/threads/MPI)

Expertise in design pattern (UML diagrams) and data modeling of large scale analytic systems

Experience in research, analysis, and the conversion of large amount of raw collected data and content into new sets of data that is structured and does not reduce data context in order to enable the Productization of new products

Worked with data warehousing and distributed/parallel processing of large data sets using parallel computing system to map/reduce computation and Linux clusters (e.g. Hadoop/Cloud technologies, HDFS); cluster;

Experienced in modern development methodology such as Agile, Scrum and SDLC

Ability to work in a research oriented, fast pace, and highly technical environment

Quick thinker and a fast learner, collaborative spirit, and excellent communication and interpersonal skills

Additional Information

** U.S. Citizens and those who are authorized to work independently in the United States are encouraged to apply. We are unable to sponsor at this time.
** All your information will be kept confidential according to EEO guidelines.

Top Skills

Cloud
Cuda
Hadoop
Hdfs
Java
Linux Clusters
Parallel Processing
Spark

Similar Jobs

23 Days Ago
In-Office
Cupertino, CA, USA
10-12 Annually
Expert/Leader
10-12 Annually
Expert/Leader
Information Technology • Software
The Big Data Developer (Spark) will be responsible for Spark and Scala development, Hadoop performance tuning, and SQL coding. Requires extensive experience in data processing and performance optimization.
Top Skills: HadoopJavaScalaSparkUnix
16 Days Ago
In-Office
4 Locations
127K-192K Annually
Senior level
127K-192K Annually
Senior level
Big Data • Cloud • Marketing Tech • Social Impact • Software
The role involves building and maintaining data pipelines, managing cloud infrastructure, collaborating with analysts, and applying AI technologies to enhance identity resolution.
Top Skills: AirflowBigQueryDataflowDataprocDockerGoogle Cloud PlatformHadoopJavaKafkaPubsubPythonSparkSQLTerraform
6 Days Ago
In-Office or Remote
Santa Monica, CA, USA
140K-180K Annually
Senior level
140K-180K Annually
Senior level
Events • Music • Software • Sports
Collaborate with cross-functional teams to develop solutions in Big Data and Business Intelligence, focusing on modern Java development and software architecture.
Top Skills: AWSJavaNoSQLRestful ApisSpring Framework

What you need to know about the San Francisco Tech Scene

San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.

Key Facts About San Francisco Tech

  • Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Google, Apple, Salesforce, Meta
  • Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
  • Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
  • Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account