As an AWS Data Engineer, you will develop data pipelines, create data models, troubleshoot issues, and collaborate with teams while utilizing tools like PySpark and SQL.
Mactores is a trusted leader among businesses in providing modern data platform solutions. Since 2008, Mactores have been enabling businesses to accelerate their value through automation by providing End-to-End Data Solutions that are automated, agile, and secure. We collaborate with customers to strategize, navigate, and accelerate an ideal path forward with a digital transformation via assessments, migration, or modernization.
Mactores is seeking an AWS Data Engineer (Senior) to join our team. The ideal candidate will have extensive experience in PySpark and SQL, and have worked with data pipelines using Amazon EMR or Amazon Glue. The candidate must also have experience in data modeling and end-user querying using Amazon Redshift or Snowflake, Amazon Athena, Presto, and orchestration experience using Airflow.
What you will do?
- Develop and maintain data pipelines using Amazon EMR or Amazon Glue.
- Create data models and end-user querying using Amazon Redshift or Snowflake, Amazon Athena, and Presto.
- Build and maintain the orchestration of data pipelines using Airflow.
- Collaborate with other teams to understand their data needs and help design solutions.
- Troubleshoot and optimize data pipelines and data models.
- Write and maintain PySpark and SQL scripts to extract, transform, and load data.
- Document and communicate technical solutions to both technical and non-technical audiences.
- Stay up-to-date with new AWS data technologies and evaluate their impact on our existing systems.
What are we looking for?
- Bachelor's degree in Computer Science, Engineering, or a related field.
- 3+ years of experience working with PySpark and SQL.
- 2+ years of experience building and maintaining data pipelines using Amazon EMR or Amazon Glue.
- 2+ years of experience with data modeling and end-user querying using Amazon Redshift or Snowflake, Amazon Athena, and Presto.
- 1+ years of experience building and maintaining the orchestration of data pipelines using Airflow.
- Strong problem-solving and troubleshooting skills.
- Excellent communication and collaboration skills.
- Ability to work independently and within a team environment.
You are preferred if you have
- AWS Data Analytics Specialty Certification
- Experience with Agile development methodology
Life at Mactores
We care about creating a culture that makes a real difference in the lives of every Mactorian. Our 10 Core Leadership Principles that honor Decision-making, Leadership, Collaboration, and Curiosity drive how we work.
1. Be one step ahead
2. Deliver the best
3. Be bold
4. Pay attention to the detail
5. Enjoy the challenge
6. Be curious and take action
7. Take leadership
8. Own it
9. Deliver value
10. Be collaborative
We would like you to read more details about the work culture on https://mactores.com/careers
The Path to Joining the Mactores Team
At Mactores, our recruitment process is structured around three distinct stages:
Pre-Employment Assessment:
You will be invited to participate in a series of pre-employment evaluations to assess your technical proficiency and suitability for the role.
Managerial Interview: The hiring manager will engage with you in multiple discussions, lasting anywhere from 30 minutes to an hour, to assess your technical skills, hands-on experience, leadership potential, and communication abilities.
HR Discussion: During this 30-minute session, you'll have the opportunity to discuss the offer and next steps with a member of the HR team.
At Mactores, we are committed to providing equal opportunities in all of our employment practices, and we do not discriminate based on race, religion, gender, national origin, age, disability, marital status, military status, genetic information, or any other category protected by federal, state, and local laws. This policy extends to all aspects of the employment relationship, including recruitment, compensation, promotions, transfers, disciplinary action, layoff, training, and social and recreational programs. All employment decisions will be made in compliance with these principles.
Note: Please answer as many questions as possible with this application to accelerate the hiring process.
Top Skills
Airflow
Amazon Athena
Amazon Emr
Amazon Glue
Amazon Redshift
Presto
Pyspark
Snowflake
SQL
Similar Jobs
Information Technology • Consulting
Lead data architecture, develop ETL pipelines using AWS Glue, integrate with CMIC ERP, and ensure data quality for AI-driven projects.
Top Skills:
Amazon Api GatewayAmazon S3Amazon TextractAuroraAws GlueAws LambdaAws Step FunctionsDynamoDBRdsSQL
Artificial Intelligence • Information Technology • Software • Database
Build production-grade AI-powered data tooling: extract data from Snowflake, generate and store embeddings, enable semantic search, design enrichment pipelines using LLM APIs, optimize AWS infrastructure, and create reusable services and SDKs for scalable, observable data and AI workflows.
Top Skills:
AWSEcsEksEmbeddingsIamLambdaLlm ApisOpenaiPineconePythonS3Semantic SearchSnowflakeVector Databases
Artificial Intelligence • Healthtech • Machine Learning • Natural Language Processing • Biotech • Pharmaceutical
The Senior Oncology Account Specialist promotes Pfizer products to healthcare providers, educates on proper usage, and strengthens brand presence with target customers while managing account relations to enhance patient care quality.
What you need to know about the San Francisco Tech Scene
San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.
Key Facts About San Francisco Tech
- Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Google, Apple, Salesforce, Meta
- Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
- Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
- Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine
