Intelliswift Logo

Intelliswift

Big Data Architect

Reposted 8 Days Ago
Be an Early Applicant
In-Office
San Ramon, CA, USA
Expert/Leader
In-Office
San Ramon, CA, USA
Expert/Leader
The Big Data Architect role requires expertise in data warehouse solutions and the Hadoop ecosystem to integrate and analyze large datasets.
The summary above was generated by AI
Job Description

Good understanding of SDLC process and experience working in agile environment. 

Minimum 10 years of experience in working on Data warehouse and integration solutions. 

Experience in Data Analytics with Big Data 

Good working Experience on Data Integration, warehousing concepts - Dimensional and Relational models, ETL tools, and Reporting. 

Good Experience integrating multiple Big Data solutions and legacy database systems 

Experience processing large amounts of structured and unstructured data. 

Expert level knowledge of Hadoop ecosystem components – Hadoop, Map Reduce, Pig, Hive, Solr, Elastic search, Spark, Kafka, Storm, Falcon, Oozie, Hawq, Gemfire XD etc. 

Expert level knowledge of one or more NoSQL databases - HBase, Cassandra, MongoDB 

Advanced skills using one or more scripting languages (e.g. python, UNIX shell scripts) 

Ability to quickly understand business problems, find patterns and insights. 

Ability to quickly learn new technologies and work effectively in a very dynamic environment. 

Proven ability to build, manage and foster a team-oriented environment 

Proven ability to work creatively and analytically in a problem-solving environment 

Excellent communication (written and oral) and interpersonal skills 

Excellent leadership and management skills

Additional Information

Local candidate preferred but not mandatory.

HQ

Intelliswift Santa Clara, California, USA Office

Santa Clara, CA, United States

Similar Jobs

4 Days Ago
In-Office
Expert/Leader
Expert/Leader
Artificial Intelligence • HR Tech • Information Technology • Consulting
Design and architect scalable, resilient big-data systems (Lambda architecture) using Cloudera HDFS and Cassandra; build high-availability Java/J2EE applications; implement cloud integration and application-level encryption; mentor and lead a 10-15 person onsite/offshore team; guide agile sprint execution and best practices.
Top Skills: Automation ScriptsCassandraCi-CdCloud IntegrationClouderaHadoopHdfsHp Secure DataJ2EeJavaLambda ArchitectureNoSQL
14 Days Ago
In-Office or Remote
United States
64K-225K Annually
Senior level
64K-225K Annually
Senior level
Agency • Information Technology
Lead architect to design and implement large-scale, distributed big data solutions using Java and Big Data technologies. Hands-on with Java 1.8+, Apache Spark, MapReduce, Hadoop/Cloudera, Hive, Impala, YARN, and Kafka. Perform data analysis, design scalable architectures, enforce testing (JUnit), and optionally use Unix/Python scripting. Manage global technology teams, apply industry best practices, and communicate effectively across stakeholders.
Top Skills: SparkClouderaHadoopHiveImpalaJavaJunitKafkaMapreducePythonShell ScriptingYarn
21 Days Ago
In-Office
San Francisco, CA, USA
Expert/Leader
Expert/Leader
Information Technology • Professional Services • Software • Consulting
Design and lead big-data architectures and solutions using open-source frameworks (Kafka, Spark, Scala, Solr, HDFS, Hive, Oozie, YARN, Cloudera). Define data architecture, data marts and dimensional models, perform data analysis/profiling with SQL, review code, integrate ETL solutions, liaise with business stakeholders, and provide technology advisory in a consulting environment with regular travel.
Top Skills: AzureClouderaETLHdfsHiveJavaKafkaLinuxOozieScalaSolrSparkSQLYarn

What you need to know about the San Francisco Tech Scene

San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.

Key Facts About San Francisco Tech

  • Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Google, Apple, Salesforce, Meta
  • Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
  • Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
  • Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account