Senior Data Engineer

| San Francisco
Apply now
By clicking continue you agree to Built In’s Privacy Policy and Terms of Use.

BigCommerce is disrupting the e-commerce industry as the SaaS leader for fast-growing, mid-market businesses. We enable our customers to build intuitive and engaging stores to support every stage of their growth.

BigCommerce named a “Best and Brightest” place to work in San Francisco 2020 is looking for a Senior Data Engineer. This is an exciting opportunity to build a real time big data pipeline and SaaS analytics platform using latest cloud technologies for the #1 e-commerce SaaS platform. 

An ideal candidate will have a background in Computer Science or a related technical field and possess extensive experience in building distributed scalable data pipelines and working with large data stores. You will be working with cross-functional teams in a highly visible role. You are gritty, focused on results, a self-starter and have demonstrated success in using engineering and analytics to drive the understanding, growth and success of a product.

What you’ll do

  • Build scalable and reliable near real time data pipeline on cloud that collects, transforms, loads and curates data from various internal and external data sources
  • Build a scalable distributed data store that will be central source of truth
  • Experience in developing high performance, scalable and available web services
  • Own data quality for the pipelines you build and make them auditable
  • Evaluate new technologies and build prototypes for continuous improvements in Data Engineering
  • Build integrations with external systems for transmitting and receiving event data
  • Partner with Infrastructure and Engineering teams to ensure instrumentation, logging and monitoring is in place

Who you are

  • Experience in using big data technologies such as Kafka, Spark, Hadoop, HBase or their equivalents
  • Experience with AWS and/or GCP
  • 5+ years of experience with Java, Scala and/or Python
  • 5+ years of experience with SQL 
  • 3+ years of experience in building and monitoring near real time scalable ETL pipelines
  • Experience with shell scripting
  • Excellent written and verbal communication skills
  • Bachelor's degree in CS, EE or MIS; or equivalent experience

Nice to have

  • Experience with tools such as AirFlow for scheduling and monitoring of data workflow will be a plus
  • Experience with managed data processing services of cloud platforms such as GCP and/or AWS 
  • Experience working with a team distributed over time zones 
  • Knowledge of Google Kubernetes Engine, Cloud Composer 

Diversity & Inclusion at BigCommerce

We have the opportunity to build not only a great business, but a great company, with soul. Our beliefs and commitment to diversity and inclusion are a central part of achieving that.

Our dedication to diversity and inclusion is grounded in two things: a moral belief in the dignity, value, and potential of every individual, and a practical belief that diverse, inclusive teams will create the best outcomes for our customers, partners, employees, and company. We welcome everyone to be a part of our journey.

Current BigCommerce Employees: Please use the internal job board to apply for openings

Read Full Job Description
Apply now
By clicking continue you agree to Built In’s Privacy Policy and Terms of Use.

Technology we use

  • Engineering
    • GolangLanguages
    • JavaLanguages
    • JavascriptLanguages
    • KotlinLanguages
    • PHPLanguages
    • PythonLanguages
    • RubyLanguages
    • ScalaLanguages
    • SqlLanguages
    • SwiftLanguages
    • ElixirLanguages
    • ErlangLanguages
    • Objective -CLanguages
    • ScalaLanguages
    • jQueryLibraries
    • ReactLibraries
    • ReduxLibraries
    • AjaxLibraries
    • AngularJSFrameworks
    • Backbone.jsFrameworks
    • Node.jsFrameworks
    • Ruby on RailsFrameworks
    • SpringFrameworks
    • jQueryFrameworks
    • MongoDBDatabases


Our San Francisco office is in the heart of the Financial District, close to a BART stop and surrounded by great coffee shops, restaurants, and bars.

What are BigCommerce Perks + Benefits

Volunteer in local community
Yearly food and coat drives, beach clean-ups, building bikes to be donated
Friends outside of work
Eat lunch together
Intracompany committees
We empower employees to define our culture in the areas of Wellness, Community/Volunteering and Team Building through our BigCommerce Employee Resource Groups (ERGs).
Open door policy
Open office floor plan
Documented equal pay policy
Dedicated Diversity/Inclusion Staff
Highly diverse management team
Unconscious bias training
Diversity manifesto
Someone's primary function is managing the company’s diversity and inclusion initiatives
Health Insurance & Wellness Benefits
Flexible Spending Account (FSA)
Disability Insurance
Dental Benefits
Vision Benefits
Health Insurance Benefits
Life Insurance
Pet Insurance
Wellness Programs
Team workouts
Acme Co.'s team fitness initiatives include In-office yoga, Sponsored race teams.
Retirement & Stock Options Benefits
Company Equity
Child Care & Parental Leave Benefits
Generous Parental Leave
Flexible Work Schedule
Family Medical Leave
Adoption Assistance
Return-to-work program post parental leave
Vacation & Time Off Benefits
Unlimited Vacation Policy
Generous PTO
Paid Volunteer Time
Paid Holidays
Paid Sick Days
Perks & Discounts
Casual Dress
Commuter Benefits
Free Daily Meals
We provide free breakfast on Wednesday. Employees get free lunch on Monday, Tuesday, Wednesday, Thursday, Friday.
Game Room
Our game room includes Ping Pong, Foosball, Video Games.
Stocked Kitchen
Chips, snacks, bagels, bread, fresh produce, coffee machines, LaCroix, coconut water, oat milk, almond milk, lots of vegan/vegetarian/gluten free options (and normal)
Happy Hours
Happy hours are hosted Once per week.
We offer employees Paid on-site garage parking.
Pet Friendly
Acme Co.'s pet policy is dog friendly daily.
Fitness Subsidies
24 Fitness
Professional Development Benefits
Tuition Reimbursement
Diversity Program
Lunch and learns
Acme Co. hosts lunch and learn meetings on occasion.
Mentorship program
Hack the Hood, Women in Tech
Continuing Education stipend
Online course subscriptions available
More Jobs at BigCommerce10 open jobs
All Jobs
Data + Analytics
Dev + Engineer
Data + Analytics
San Francisco
San Francisco
San Francisco
San Francisco
San Francisco
San Francisco
San Francisco
San Francisco
Apply now
By clicking continue you agree to Built In’s Privacy Policy and Terms of Use.
Save jobView BigCommerce's full profileSee more BigCommerce jobs