Software Engineer (Big Data)

What you'll do:

• Contribute to the development and optimization of large-scale data workflows using technologies such as Apache Spark or similar frameworks

• Develop and operate our large scale data processing systems, making them more elastic and fault tolerant, solving distributed data and compute challenges

• Assist in deploying and maintaining production systems, including CI/CD workflows

• Provide technical input into roadmaps for the team

• Write clean, maintainable, and well-tested code

Who you are:

• Recent graduate (0-1 years) with a Bachelor's Degree in computer science or equivalent experience
  

• You must be work-authorized in the United States without the need for current or future employer sponsorship. We are not currently able to engage candidates on OPT. 

• Familiarity with data processing frameworks such as Apache Spark, Hadoop, or similar.

• Familiarity with containerization tools (e.g., Docker and Kubernetes)

• Experience with workflow orchestration tools (e.g., Airflow) is a plus

• Proficient in Java and/or Python programming languages

• Linux system administration/automation is a plus

• Strong problem-solving and debugging skills

• Organized and detail-oriented

What you'll learn in this role:

• Hands-on experience with large-scale distributed systems in production

• Exposure to real-world data science and modeling workflows

• Best practices in building scalable and reliable data infrastructure

• Collaboration across engineering and modeling teams