Senior Java Big Data Developer to design and build Big Data applications on Cloudera/Hadoop using Java and Spark/MapReduce. Work with Hive, Impala, YARN, Kafka; perform data analysis, unit testing, and scripting. Lead/manage global technology teams and follow industry practices and standards.
Qualifications
- Minimum 8+ years of relevant experience in applications development
- Expertise in Bigdata ecosystem (Cloudera Distribution) using spark and Map Reduce
- Java (core) 1.8 or above - Hands-on experience (advanced concepts of data structures, memory management and design patterns)
- Apache Spark - Hands on (preferable on Java spark)
- Bigdata ecosystem (Good understanding of Hadoop, preferable cloud era distribution), exposure to Hive, Impala, Yarn, Kafka
- Good Data analysis and programing skills and understanding of large datasets (no sql joins)
- Good knowledge of Java and spark architecture and design principles
- Good experience in Junit/Testing frameworks
- Unix/Python shell scripting experience is a big plus
- Experience managing global technology teams
- Working knowledge of industry practices and standards
- Good communication skills
Compensation, Benefits and Duration
Minimum Compensation: USD 52,000
Maximum Compensation: USD 184,000
Compensation is based on actual experience and qualifications of the candidate. The above is a reasonable and a good faith estimate for the role.
Medical, vision, and dental benefits, 401k retirement plan, variable pay/incentives, paid time off, and paid holidays are available for full time employees.
This position is not available for independent contractors
No applications will be considered if received more than 120 days after the date of this post
Photon San Francisco, California, USA Office
San Francisco, United States
Similar Jobs
Fintech • Payments • Software
Build and manage education-sector client relationships through the full sales cycle, from prospecting and lead generation to closing. Develop new-business pipelines, communicate the company’s value proposition, achieve revenue quotas, and conduct consultative product demonstrations. Collaborate with product, technical, operations, and marketing teams to support solution delivery and implementation. Conduct market research, manage multiple projects, and grow new accounts across the Americas.
Top Skills:
CRMSaaSSalesforce
Fintech • Payments • Software
Sell Flywire’s education payments and software solutions to colleges and universities across the United States. Manage the full enterprise sales cycle, generate pipeline and new business, conduct consultative product demonstrations, achieve revenue quotas, and build relationships with senior institutional leaders. Collaborate with product, technical, operations, and marketing teams to support solution delivery, implementation, lead generation, and market expansion.
Top Skills:
CRMSaaSSalesforce
Automotive • Big Data • Information Technology • Robotics • Software • Transportation • Manufacturing
Leads GM’s enterprise career development, internal mobility, reskilling, and redeployment strategy, with emphasis on skilled trades and manufacturing populations. Builds operating models, workforce transition pathways, multi-year roadmaps, and success metrics; partners with HR, learning, talent, analytics, and business leaders; uses workforce insights and AI responsibly; and manages a small team. Requires extensive experience in career development, workforce planning, job architecture, reskilling, people leadership, and manufacturing or skilled-trades environments.
Top Skills:
Artificial Intelligence (Ai)HrisTalent Management Platforms
What you need to know about the San Francisco Tech Scene
San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.
Key Facts About San Francisco Tech
- Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Google, Apple, Salesforce, Meta
- Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
- Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
- Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine
