xScion Solutions Logo

xScion Solutions

Senior Data Engineer

Reposted 18 Days Ago
In-Office or Remote
Hiring Remotely in San Francisco, CA
Senior level
In-Office or Remote
Hiring Remotely in San Francisco, CA
Senior level
As a Senior Data Engineer, you will design and develop data solutions using AWS services, automate data pipelines, and work on cloud migration from Hadoop to AWS. You will also collaborate on architecture and support existing applications.
The summary above was generated by AI

As an employee, you Turn Change Into Value® - for our clients, for our company, for your professional growth, for the consumers. We hire the best and brightest, who are driven to create lasting value. At xScion, you aren't just another team member, you're impactful. You're empowered. You're driven. You're an xScioneer.

Location: Los Angeles, San Francisco, Salt Lake City, Portland, Seattle

As a Senior Data Engineer, You Will:

  • Design, develop, and operationalize large-scale enterprise data solutions using AWS services such as S3, Glue, Athena, Lambda, RedShift, EMR, Spark, and DynamoDB
  • Analyze, redesign, and re-platform on-premise data solutions from Cloudera Hadoop platforms to AWS native data stack
  • Design, develop, and deploy data pipelines from ingestion to consumption within a big data architecture using Java, Python, or Scala
  • Participate in discussions related to architecture, design, and product development to understand business requirements and translate them into technical solutions
  • Take responsibility for complete user stories through analysis, design, development, and testing as per project timelines
  • Develop and maintain scripts to automate batch jobs
  • Support and maintain existing applications, troubleshooting and resolving technical issues
  • Follow appropriate technical best practices and internal processes while complying with various information security controls
  • Maintain existing data solutions running on Hadoop stack using HDFS, Oozie, Impala, and Hive, handling some enhancements until the cloud migration.

To Be Successful, You Need: 

  • Bachelor's Degree in Computer Science, Information Technology, or other relevant fields
  • Must be a US Citizen or a Green Card holder for over 3 years with the intent to become a US Citizen.
  • 7+ years of software development experience related to data engineering
  • Hands-on experience in Java, Python, or Scala with the ability to understand/write complex SQL queries
  • Proficient in AWS services such as S3, Glue, Athena, Lambda, RedShift, EC2, EMR, Spark, and DynamoDB using Java, Python, Scala, or PySpark
  • Experience deploying software solutions to the cloud platform through CI/CD in a DevOps model
  • General understanding of application and data security concepts with exposure to AWS IAM, CloudTrail, CloudWatch, AWS Config, Secrets Manager, and KMS
  • Hands-on experience with Hadoop technologies such as HDFS, Oozie, Impala, and Hive
  • Experience with Ansible, Terraform, or Cloud Formation scripts to develop or support Infrastructure as Code
  • Experience working with Hadoop-based Big Data architecture and solutions.
  • Experience working in an Agile development environment using Agile tools like Jira or Rally.
  • Proficiency with UNIX commands and shell scripts.
  • Ability to effectively communicate, collaborate, and work in a team environment to deliver high-quality work independently.
  • Nice to have experience with RDBMS and data warehouses
  • Nice to have experience with Machine Learning technologies and data visualization tools

Why xScion?

  • We have an amazing culture– We were named a Best Places to Work in Virginia 8 times, including 2025.
  • We are poised for rapid growth– We are on the cutting edge of digital transformation in Financial Services, Healthcare, Nonprofit and Public Sector and continuously welcome new clients to the xScion family.
  • We believe in your continuous development– We invest in our teams’ development, including our Communities of Practice, technology partnerships, sandbox and paying for certifications and trainings to improve their skills because we are committed to collectively being the best at what we do.
  • We want you to make an impact in whatever you do– Our people are given the opportunity to provide impactful change to our clients and team.
  • We believe in equality - As a woman-owned organization, we believe in an inclusive and diverse culture where everyone’s uniqueness makes us stronger.
  • Great Benefits: Medical, dental, 401(k) match, flexible spending and more, but we also have unique perks such as up to 27 days off a year (including your birthday!), remote work opportunities, parental leave, wellness benefits and many other things that inspire balance and flexibility.

We’re Transforming RegTech Organizations:

At xScion, we Turn Change Into Value. We help clients in highly regulated industries start or accelerate their digital transformation initiatives by shifting their mindset and goals into smaller, actionable steps that create lasting value. With more than 20 years of experience supporting Regulatory Technology (RegTech), xScion provides both domain experts and tailored solutions to help organizations navigate complex compliance and technology requirements. We specialize in Business Agility, Cloud Transformation and Organizational Change Management solutions for clients in Financial Services, Public Sector, Nonprofits and Healthcare. Our experts help prepare and create change to clients’ processes, technology and culture in order to improve operational efficiencies and the customer experience. As a certified Woman-Owned Small Business, we are proud to be the most trusted solutions partner that business and technology leaders count on to deliver lasting, impactful value.

All qualified applicants will receive consideration for employment and will not be discriminated against on the basis of race, color, religion, sex, sexual orientation, gender identity, national origin, age, disability, or protected veteran status. xScion takes affirmative action in support of its policy to employ and advance in employment individuals who are minorities, women, protected veterans and individuals with disabilities.

You will be added to our talent community when you apply to this job. You may opt out at any time.

Want to Learn More about xScion? 

Check us out on www.xscion.com or socially at LinkedIn, Twitter and Glassdoor.

Top Skills

Ansible
Spark
Aws Athena
Aws Dynamodb
Aws Emr
Aws Glue
Aws Lambda
Aws Redshift
Aws S3
Ci/Cd
CloudFormation
Hdfs
Hive
Impala
Java
Oozie
Python
Scala
Terraform
Unix

Similar Jobs

5 Days Ago
Remote or Hybrid
United States
60K-160K Annually
Senior level
60K-160K Annually
Senior level
Cloud • Insurance • Payments • Software • Business Intelligence • App development • Big Data Analytics
The Data Engineer will design and implement data pipelines, manage Looker, automate deployment, and ensure data quality for business reporting needs.
Top Skills: BashBigQueryCi/CdDebeziumGitGoogle Cloud PlatformHelmKafkaKubernetesLookerPub/SubPythonSQLTerraform
7 Days Ago
In-Office or Remote
San Francisco, CA, USA
137K-214K Annually
Senior level
137K-214K Annually
Senior level
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
As a Senior Data Engineer, you'll build scalable data solutions, architect data models, and improve data quality while collaborating with stakeholders and analytics teams.
Top Skills: AirflowAWSPythonSparkSQL
Yesterday
Easy Apply
Remote or Hybrid
United States
Easy Apply
112K-170K Annually
Senior level
112K-170K Annually
Senior level
Artificial Intelligence • Cloud • Computer Vision • Hardware • Internet of Things • Software
The role involves architecting and maintaining marketing databases, implementing data infrastructure for AI/ML, managing data pipelines, and collaborating with stakeholders to develop data-driven solutions.
Top Skills: DatabricksDomoGoogle AnalyticsGoogle BigqueryKubeflowLookerMarketoMixpanelMlflowPythonRdsRedshiftSalesforceSnowflakeSQLTableau

What you need to know about the San Francisco Tech Scene

San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.

Key Facts About San Francisco Tech

  • Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Google, Apple, Salesforce, Meta
  • Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
  • Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
  • Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account