Xperteez Technology Logo

Xperteez Technology

Big Data Engineer, Remote - Contract

Reposted 9 Days Ago
Remote
Hiring Remotely in United States
Entry level
Remote
Hiring Remotely in United States
Entry level
Design, build, and maintain scalable big data pipelines, architectures, distributed databases, and storage systems. Use Python and frameworks such as Hadoop, Spark, or Flink for data integration, transformation, and processing. Ensure system performance, availability, security, governance, and data quality while collaborating with cross-functional teams and documenting technical solutions.
The summary above was generated by AI

Job Title: Big Data Engineer

Job Type: Contract

Location: Remote

Job Summary: In this role, you'll apply your expertise to help train next-generation AI systems. Your work will shape how models learn, reason, and perform through high-quality, real-world input.

Required Skills

  • big data

  • Python

  • databases

  • data engineering

Key Responsibilities:

  • Design, build, and maintain scalable big data pipelines and architectures to support robust data solutions.

  • Collaborate with cross-functional teams to understand and deliver on data requirements and business objectives.

  • Implement data integration, transformation, and processing solutions using Python and relevant big data technologies.

  • Develop, manage, and optimize distributed databases and storage systems for efficiency and reliability.

  • Monitor, troubleshoot, and enhance data systems to ensure high availability and performance.

  • Enforce data quality, security, and governance standards across all solutions.

  • Document solutions and communicate complex technical concepts effectively, both in writing and verbally.

Required Skills and Qualifications:

  • Proven expertise in big data engineering with hands-on experience building and maintaining large-scale data pipelines.

  • Advanced proficiency in Python for data processing, automation, and integration.

  • Deep understanding of relational and NoSQL databases, including optimization and management techniques.

  • Experience with distributed data processing frameworks (e.g., Hadoop, Spark, Flink).

  • Strong foundation in data modeling, ETL processes, and data warehousing principles.

  • Excellent written and verbal communication skills, with the ability to convey technical ideas clearly to both technical and non-technical stakeholders.

  • Detail-oriented, proactive, and self-motivated, thriving in remote and autonomous work environments.

Preferred Qualifications:

  • Prior experience in fast-paced or startup-like environments supporting global teams.

  • Expertise with cloud-based big data platforms (e.g., AWS, GCP, Azure).

  • Familiarity with machine learning operations and data science workflows is a plus.

Similar Jobs

41 Minutes Ago
Remote
USA
122K-190K Annually
Senior level
122K-190K Annually
Senior level
Consumer Web • Healthtech • Professional Services • Social Impact • Software
Own and scale paid social and premium video channels, including strategy, media buying, optimization, budgeting, creative testing, and incrementality measurement. Build AI-powered workflows for campaign execution, QA, pacing, reporting, and insights. Partner with creative, agency, and product marketing teams while turning performance data into channel and budget decisions. This is a senior individual contributor role requiring extensive paid social, OLV/CTV, data measurement, and AI automation experience.
Top Skills: AIAi AgentsAttributionCtvMarketing Mix Modeling (Mmm)MetaOlv
44 Minutes Ago
Remote or Hybrid
United States
98K-165K Annually
Senior level
98K-165K Annually
Senior level
Artificial Intelligence • Cloud • Sales • Security • Software • Cybersecurity • Data Privacy
Lead end-to-end execution of a 12+ initiative product security program, managing cross-team dependencies, vendor procurement, BAU security operations, and executive reporting. Maintain roadmap and tracking in Jira/Confluence, drive procurement/POCs, produce executive-ready metrics, and establish program cadence to ensure timely remediation and predictable delivery.
Top Skills: Ai And Machine LearningCi/CdCloud-Native SecurityConfluenceDevsecopsIdentity And Access Management (Iam)JIRAScmVulnerability Management
44 Minutes Ago
Remote or Hybrid
United States
133K-224K Annually
Senior level
133K-224K Annually
Senior level
Artificial Intelligence • Cloud • Sales • Security • Software • Cybersecurity • Data Privacy
Design, build, and deploy scalable Java microservices within an AWS cloud-native platform. Provide technical leadership, architectural direction, code reviews, troubleshooting, proof-of-concept development, and cross-functional collaboration. Lead complex backend features, improve engineering practices with AI tools, support observability and reliability goals, and participate in on-call rotations. Mentor engineers and help drive technical simplification across distributed, event-driven systems.
Top Skills: AirflowAWSClaudeCursorDatabricksDatadogGrafanaJavaKafkaPrometheusRedisSnowflake

What you need to know about the San Francisco Tech Scene

San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.

Key Facts About San Francisco Tech

  • Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Google, Apple, Salesforce, Meta
  • Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
  • Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
  • Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account