Socure Logo

Socure

Senior Data Engineer

Reposted 25 Days Ago
Remote or Hybrid
Hiring Remotely in US
160K-195K Annually
Senior level
Remote or Hybrid
Hiring Remotely in US
160K-195K Annually
Senior level
The Senior Data Engineer will design and build scalable data platforms, handle automation for data operations, and ensure reliability and performance of data pipelines while collaborating with various teams.
The summary above was generated by AI
Why Socure?

Socure is building the identity trust infrastructure for the digital economy — verifying 100% of good identities in real time and stopping fraud before it starts. The mission is big, the problems are complex, and the impact is felt by businesses, governments, and millions of people every day.

We hire people who want that level of responsibility. People who move fast, think critically, act like owners, and care deeply about solving customer problems with precision. If you want predictability or narrow scope, this won’t be your place. If you want to help build the future of identity with a team that holds a high bar for itself — keep reading.

About the Role

We are looking for a Senior Data Engineer to join our Data Automation team. You will play a critical role in designing and building scalable data platforms and pipelines that power Socure’s identity verification products and analytics. This role is ideal for someone who has a strong passion for solving real business problems with data, and combines deep hands-on data engineering expertise with strong ownership.

What You'll Do

• Design and build batch and streaming data pipelines to support automated data ingestion, ML feature engineering and analytics across multiple product domains.

• Own end-to-end delivery of complex, ambiguous data initiatives, including architecture, implementation, testing, deployment, monitoring, and documentation.

• Develop and evolve the data platform to support large-scale data processing using modern cloud-native technologies.

• Automate data operations (validation, quality checks, alerting, backfills, and recovery workflows) to reduce manual effort and improve consistency.

• Optimize cost, performance, and reliability of data workloads.

• Partner closely with cross-functional teams (Data Science, Product, Engineering) to understand requirements, translate them into technical solutions.

• Evaluate and adopt new technologies (new processing engines, storage formats, orchestration tools, GenAI-assisted ingestion) to keep the platform modern and efficient.

What You Bring

• 5+ years of hands-on data engineering experience, building and maintaining production-grade data platforms and pipelines.

• Strong programming skills in general-purpose language (such as Python or Scala) for data processing, and SQL for data analytics.

• Deep experience with distributed data processing frameworks, such as Apache Spark, including performance tuning and optimization.

• Proven experience building data solutions using services on AWS (EMR, Lambda, s3, etc).

• Strong understanding of data modeling and data warehousing concepts, including partitioning, schema design for large-scale datasets.

• Experience operating and supporting production pipelines, including monitoring, alerting, incident response, and improving reliability over time.

• Solid foundation in software engineering practices, including version control, CI/CD, testing strategies, and code review.

• Strong communication and collaboration skills, with the ability to work effectively with both technical and non-technical stakeholders.

Preferred Qualifications

• Experience with streaming or near-real-time data processing (Kafka, Kinesis, etc).

• Hands-on experience with data orchestration tools (Airflow, Step Functions, etc).

• Familiarity with modern data platform patterns such as Data Lakehouse, Data Mesh, and large-scale data sharing across teams.

• Experience with prompt engineering using modern GenAI, Large Language Models (LLM).

• Experience mentoring other engineers and contributing to engineering-wide standards, best practices.

As a note; Socure cannot provide sponsorship now or in the future for this role.

Socure is an equal opportunity employer that values diversity in all its forms within our company. We do not discriminate based on race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status.
If you need an accommodation during any stage of the application or hiring process—including interview or onboarding support—please reach out to your Socure recruiting partner directly.

Follow Us!

YouTube | LinkedIn | X (Twitter) | Facebook

Similar Jobs

2 Days Ago
Easy Apply
Remote or Hybrid
United States
Easy Apply
120K-201K Annually
Senior level
120K-201K Annually
Senior level
Artificial Intelligence • Cloud • Computer Vision • Hardware • Internet of Things • Software
Design, build, and maintain scalable Spark-based ETL pipelines and computed tables in a central data lake. Integrate structured and unstructured IoT, sensor, and external data for analytics, model training, and dashboards. Collaborate with Data Science, Analytics, and ML teams to ensure reliable, high-quality customer-facing datasets.
Top Skills: AirflowAWSAzureDagsterData LakeDatabricksDelta LakeETLGCPGitGitPrefectPysparkPythonRest ApisSparksqlSQL
3 Days Ago
Remote or Hybrid
115K-145K Annually
Senior level
115K-145K Annually
Senior level
AdTech • Cloud • Digital Media • Information Technology • News + Entertainment • App development
Design, build, and scale cloud-native data platforms and pipelines. Translate business requirements into production-ready data solutions, owning modeling, performance, reliability, cost optimization, CI/CD, testing, monitoring, and data quality. Mentor junior engineers and collaborate with cross-functional teams in an Agile environment.
Top Skills: AirflowAws S3Azure Blob StorageBigQueryCi/CdGcp Cloud StorageIcebergPythonSnowflakeSQL
4 Days Ago
Easy Apply
Remote or Hybrid
San Francisco, CA, USA
Easy Apply
155K-220K Annually
Senior level
155K-220K Annually
Senior level
Fintech • HR Tech
Build and deliver end-to-end, production-grade data solutions: design and maintain scalable ETL pipelines, ingest from diverse sources, implement dbt transformations, ensure data quality and observability, optimize performance and cost, and partner with analytics, product, and engineering teams to drive business impact.
Top Skills: AIAlertingAPIsAutomated TestingAutomationBigQueryCi/CdData ObservabilityDatabricksDbtETLEvent StreamsJavaMonitoringPythonRedshiftScalaSnowflakeSQL

What you need to know about the San Francisco Tech Scene

San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.

Key Facts About San Francisco Tech

  • Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Google, Apple, Salesforce, Meta
  • Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
  • Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
  • Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account