Procom Consultants Group Ltd. Logo

Procom Consultants Group Ltd.

Big Data Software Engineer

Posted 3 Months Ago
Be an Early Applicant
In-Office
Sunnyvale, CA, USA
Mid level
In-Office
Sunnyvale, CA, USA
Mid level
Develop and enhance a retail engagement analytics product by implementing data engineering solutions: build real-time data flows, work with NoSQL stores, support data infrastructure and visualization, clean and prep noisy datasets, and recommend improvements to data reliability, efficiency, and quality.
The summary above was generated by AI
Company Description

Procom is a leading provider of professional IT services and staffing to businesses and governments in Canada.
With revenues over $500 million, the Branham Group has recognized Procom as the 3rd largest professional services firm in Canada and is now the largest “Canadian-Owned” IT staffing/consulting company.
Procom’s areas of staffing expertise include:
• Application Development
• Project Management
• Quality Assurance
• Business/Systems Analysis
• Datawarehouse & Business Intelligence
• Infrastructure & Network Services
• Risk Management & Compliance
• Business Continuity & Disaster Recovery
• Security & Privacy
Specialties• Contract Staffing (Staff Augmentation)
• Permanent Placement (Staff Augmentation)
• ICAP (Contractor Payroll)
• Flextrack (Vendor Management System)

Job Description

Big Data Software Engineer

On behalf of our client, Procom Services is searching for a Big Data Software Engineer  for a contract opportunity in Sunnyvale, CA.

Big Data Software Engineer Job Details

This position is to perform software engineering (programming) tasks with a small team to enhance a promising Retail Engagement Analytics product to expand the data analytic capabilities. The best candidate will be one who can implement independently with well defined interfaces in the code, but also able to work with others in a small team. We’re looking for a Data Engineer who finds creative solutions to tough problems. A programmer who’s not afraid to pave the way for bigger and better things. We are looking from someone who appreciates the stability of a larger company, yet interesting in going after specific leading edge technologies for a globally recognized product suite.

Big Data Software Engineer Mandatory Skills

  • Familiar with data mining, predictive models, and handling real time data flows. 
  • Facile with all the main web protocols as well as JavaScript. 
  • Java experience required, but we are open to other experience if you’re willing to learn the languages we use. 
  • Experienced with using a No-SQL database like Mongo or Elastic Search. 
  • Experience with data infrastructure and visualization toolsets – eg. Tableau, Qlik, amazon redshift, etc 
  • Able to recommend ways to improve data reliability, efficiency, and quality. 
  • Enough programming knowledge to clean and scrub noisy datasets. 
  • Bonus points if experience includes working with IOT and sensor data.

Big Data Software Engineer Start Date

ASAP

Big Data Software Engineer Assignment Length

7+ months

Additional Information

All your information will be kept confidential according to EEO guidelines. Please send your resume in Word format only. 

Similar Jobs

Yesterday
In-Office or Remote
190K-250K Annually
Senior level
190K-250K Annually
Senior level
Big Data • HR Tech • Mobile • Software • Database
Designs, builds, deploys, and operates scalable data pipelines, datalake systems, streaming and batch processing frameworks, MLOps infrastructure, data documentation tooling, and an agentic data exploration platform. The role improves engineering velocity, data reliability, observability, discoverability, and machine learning development across customer-facing products.
Top Skills: Amazon Ec2Amazon MskAmazon S3Apache AirflowApache FlinkApache IcebergApache KafkaSparkAWSAws GlueAws IamDelta LakeDockerKubernetesParquetSpark Structured Streaming
Yesterday
In-Office or Remote
135K-185K Annually
Junior
135K-185K Annually
Junior
Big Data • HR Tech • Mobile • Software • Database
Build and operate scalable data pipelines, data lake infrastructure, batch and streaming processing systems, MLOps frameworks, data documentation tooling, and an AI-assisted data exploration platform. The role requires Apache Spark, containerized services, distributed systems, and customer-facing data infrastructure experience, with preferred expertise in AWS, Kafka, Flink, Airflow, Iceberg or Delta Lake, Kubernetes, and Docker.
Top Skills: Amazon Ec2Amazon MskAmazon S3Apache AirflowApache FlinkApache IcebergApache KafkaSparkAWSAws GlueAws IamDelta LakeDockerKubernetesParquetSpark Structured Streaming
16 Days Ago
Hybrid
San Francisco, CA, USA
130K-197K Annually
Senior level
130K-197K Annually
Senior level
Big Data • Cloud • Marketing Tech • Social Impact • Software
Lead the design, implementation, modernization, and optimization of large-scale big data systems processing trillions of identity graph connections. Develop batch processing solutions, REST APIs, and scalable applications using Spark, cloud platforms, and modern infrastructure tools. Collaborate with product managers and engineering teams while emphasizing performance, reliability, security, privacy, compliance, and cost effectiveness.
Top Skills: Apache BeamSparkAWSAzureBigQueryBigtableDataprocDockerGCPGradleHadoopHelmHiveJavaKafkaKubernetesPubsubRest ApisSinglestoreSQLTerraform

What you need to know about the San Francisco Tech Scene

San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.

Key Facts About San Francisco Tech

  • Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Google, Apple, Salesforce, Meta
  • Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
  • Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
  • Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account