Cygnus Professionals Inc. Logo

Cygnus Professionals Inc.

Big Data Engineer

Reposted 21 Hours Ago
In-Office
Palo Alto, CA
Junior
In-Office
Palo Alto, CA
Junior
The Big Data Engineer will work with Java, Spark, and Hadoop to design and implement large-scale data processing systems, focusing on distributed systems and machine learning algorithms.
The summary above was generated by AI
Company Description

Headquartered in New Jersey (U.S), Cygnus Professionals Inc. is a next generation global information technology Solution and Consulting company powered by strong management and leadership team with over 30 person years of experience. Today, Cygnus has strong footprints in more than 4 countries with more than 25 satisfied customers. We strive to extend our presence across industries and geographies with our industry-focused business excellence.
Cygnus Professionals Inc. has been named by the US Pan Asian American Chamber of Commerce Education Foundation (USPAACC) as one of the “Fast 100 Asian American Businesses” – joining the country’s fastest-growing Asian American-owned companies, based on percentage revenue growth over the immediate past two years.

Job Description

Greetings from Cygnus Professionals,

Hope you’re doing great !

I have a requirement for you Kindly go through it, If you feel comfortable and would like to apply for this role so kindly provide me your updated profile along with your contact details and rate part.

Role: Big Data Engineer w/Spark

Location: Palo Alto, CA

Duration: Potential Contract to Hire

Mode of Interview: Skype After Phone

!! Need Green Card OR US Citizen OR EAD GC Candidates Only !!


Position Description:

Experience with Java, Spark and Hadoop

A minimum of 2 years of experience working with distributed systems

Knowledge in distributed system design, data pipelining, and implementation

Knowledge in machine learning algorithms

Knowledge and experience in building large scale applications using various software design patterns and OO design principles

Experience with either distributed computing (Hadoop/Spark/Cloud) or parallel processing (CUDA/threads/MPI)

Expertise in design pattern (UML diagrams) and data modeling of large scale analytic systems

Experience in research, analysis, and the conversion of large amount of raw collected data and content into new sets of data that is structured and does not reduce data context in order to enable the Productization of new products

Worked with data warehousing and distributed/parallel processing of large data sets using parallel computing system to map/reduce computation and Linux clusters (e.g. Hadoop/Cloud technologies, HDFS); cluster;

Experienced in modern development methodology such as Agile, Scrum and SDLC

Ability to work in a research oriented, fast pace, and highly technical environment

Quick thinker and a fast learner, collaborative spirit, and excellent communication and interpersonal skills

Additional Information

** U.S. Citizens and those who are authorized to work independently in the United States are encouraged to apply. We are unable to sponsor at this time.
** All your information will be kept confidential according to EEO guidelines.

Top Skills

Cloud
Cuda
Hadoop
Hdfs
Java
Linux Clusters
Parallel Processing
Spark

Similar Jobs

11 Hours Ago
Hybrid
4 Locations
195K-343K Annually
Expert/Leader
195K-343K Annually
Expert/Leader
Artificial Intelligence • Cloud • Machine Learning • Mobile • Software • Virtual Reality • App development
Seeking a Staff Software Engineer to architect, build, and optimize data processing infrastructure for ML, ETL, reporting, and analytics at Snap.
Top Skills: SparkAWSBeamC++FlinkGCPGoogle DataflowIcebergJavaKubernetesPython
22 Days Ago
In-Office
San Francisco, CA, USA
Senior level
Senior level
Information Technology • Software
Seeking a Senior Big Data Engineer with at least 8 years of Java or Scala experience and expertise in big data technologies and cloud deployment.
Top Skills: AccumuloAkkaAvroAWSCassandraElasticsearchHadoopHbaseHdfsJavaMesosMongoDBPerlPythonScalaShellSparkUnix/Linux
22 Days Ago
In-Office
San Francisco, CA, USA
Senior level
Senior level
Information Technology • Consulting
Seeking a Sr. Big Data Engineer with 8 years of Java/Scala experience, Unix/Linux systems knowledge, and expertise in big data technologies and cloud deployment.
Top Skills: AccumuloAkkaAvroAWSCassandraElasticsearchHadoopHbaseHdfsJavaLinuxMesosMongoDBPerlPythonScalaShellSparkUnix

What you need to know about the San Francisco Tech Scene

San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.

Key Facts About San Francisco Tech

  • Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Google, Apple, Salesforce, Meta
  • Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
  • Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
  • Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account