Designs, develops and supports Big Data ingestion pipelines and production Hadoop applications. Troubleshoots data processing issues, ensures platform stability, mentors support teams, follows incident/change processes, and collaborates with infrastructure and source-system leads to maintain timely data delivery and quality.
Company Description
Sonsoft , Inc. is a USA based corporation duly organized under the laws of the Commonwealth of Georgia. Sonsoft Inc. is growing at a steady pace specializing in the fields of Software Development, => Software Consultancy and Information Technology Enabled Services.
- Responsible for data Ingestion, data quality, development, production code management and testing/deployment strategy in BigData development (Hadoop).
- Acts as a lead in identification and troubleshooting processing issues impacting timely availability of data in the BigData or delivery of critical reporting within established SLAs. Provide mentoring to Level 2 production support team.
- Identifies and recommends technical improvements in production application solutions or operational processes in support of BigData platform and information delivery assets (ie, data quality, performance, supporting Data scientists etc.)
- Focuses on the overall stability and availability of the BigData platform and the associated interfaces and transport protocols.
- Researches, manages and coordinates resolution of complex issues through root cause analysis as appropriate
- Establishes and maintains productive relationships with technical leads of key operational sources systems providing data to BigData plaform.
- Establishes and maintains productive relationships with technical leads of key infrastructure support areas, such as system/Infra engineers.
- Participate in daily standup meetings.
- Ensure adherence to established problem / incident management, change management and other internal IT processes
- Responsible for communication related to any day to day issues and problem resolutions. Communication may include direct department management as well downstream/upstream application contacts and business partners.
- Ensures comprehensive knowledge transition from development teams on new or modified applications moving to ongoing production support.
- Seeks improvement opportunities in design, solution implementation approaches in partnership with development team for ensuring the performance and health of the BigData platform.
- Ensures timely and accurate escalation of issues to management
Requirements:
- At least 2+ years developing and supporting data ingestion using Talend for BigData/Hadoop. (sourced from Teradata, Oracle, files etc)
- Java, Oozie knowledge is preferable. Talend, Pig, Python, Hive knowledge is a must.
- Familiar with all components of the BigData stack in detail, e.g., Hadoop, Pig, Hive, HBase, Oozie
- Advanced experience with large BigData or Data warehouse environment is a plus.
- Possess a strong technology, data, and production support background.
- Proven experience working with onshore/off shore support team.
- Previous experience working in a high paced, high pressure Production Support environment
- Proven analytical and problem solving skills for assessment of complex production support issues and recommend / implement effective solutions
- Previous experience in using IT Ticketing processes for managing incidents and issue resolution and conversant with established Change control / Change management standards
- Natural technical and functional curiosity
- Familiar with Agile Methodology.
Preferred
- Experience in Design and architecture review.
- Ability to work in team in diverse/ multiple stakeholder environment
- Ability to work in Onsite Offshore model
- Experience in Financial Services Domain.
- Experience and desire to work in a Global delivery environment.
- Bachelor’s degree or foreign equivalent required from an accredited institution. Will also consider three years of progressive experience in the specialty in lieu of every year of education.
- At least 4 years of experience with Information Technology.
** U.S. citizens and those authorized to work in the U.S. are encouraged to apply. We are unable to sponsor at this time.
Note:-
- This is a Full-Time Permanent job opportunity for you.
- Only US Citizen, Green Card Holder, TN Visa, GC-EAD, H4-EAD & L2-EAD can apply.
- No OPT-EAD & H1B Consultants please.
- Please mention your Visa Status in your email or resume.
Similar Jobs
Information Technology • Professional Services • Software • Consulting
Design, build, and deliver large-scale, high-volume Big Data solutions using Hadoop ecosystem tools. Develop ETL frameworks, implement MapReduce/Hive/Pig jobs, integrate with Spark, Kafka, Flume, and write Java and scripting code (Scala/Python). Estimate sizing for projects and work in a global delivery environment.
Top Skills:
APIsClouderaData WarehouseETLFlumeHadoopHiveHortonworksJavaKafkaMapreduceOoziePigPythonScalaSparkSpringSqoop
Information Technology • Professional Services • Software • Consulting
Design and architect business processes and Big Data solutions. Develop, configure, validate and deploy Hadoop/Hive solutions. Lead project and talent management, consult on problem definition, and support client engagements that require regular travel.
Top Skills:
HadoopHive
Information Technology • Professional Services • Software • Consulting
Design, build and deliver large-scale, high-volume Big Data solutions using the Hadoop ecosystem (Hive, Pig, MapReduce, Sqoop, Oozie). Develop Java/Spring APIs, use Scala/Python scripting, and work with Spark, Flume, Kafka. Size/estimate projects, build Hadoop frameworks, support ETL/data-warehouse initiatives in a global delivery environment.
Top Skills:
APIsClouderaData WarehouseETLFlumeHadoopHiveHortonworksJavaKafkaMapreduceOoziePigPythonScalaSparkSpringSqoop
What you need to know about the San Francisco Tech Scene
San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.
Key Facts About San Francisco Tech
- Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Google, Apple, Salesforce, Meta
- Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
- Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
- Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine
