Senior Software Engineer, Data Collection

Sorry, this job was removed at 10:04 a.m. (PST) on Thursday, January 23, 2020
Find out who's hiring in San Francisco.
See all Data + Analytics jobs in San Francisco
Apply
By clicking Apply Now you agree to share your profile information with the hiring company.

Company Overview

Do you Know Your Internet? Expanse Does. Expanse protects the world’s most important organizations by discovering risks on the Internet that no one else can find. Expanse is the leader in Internet Operations Management for IT and Security. Expanse customers comprise more than 10 percent of the routable internet and rely on the Expanse platform to discover, manage, and secure their global Internet Assets. Using patented collection and analysis technology, Expanse improves visibility, governance, and IT operations, reducing risk associated with Internet-connected assets and enabling a secure digital transformation. Founded in 2012, Expanse is headquartered in San Francisco and is backed by more than $135M in funding.

Position Summary

Expanse is expanding rapidly and we’re looking for a Senior Software Engineer to join our Global Internet Data Collection team in our San Francisco headquarters. At Expanse, we believe that making the internet a safer place for our customers matters, and this team is right at the forefront of that mission.

As a Senior Engineer on the Data Collection team, you will be responsible for regularly collecting and ingesting a broad set of characteristics of the global internet, providing the foundational dataset upon which the various Expanse product offerings are built. You will learn the ins and outs of a wide array of network protocols, familiarize yourself with the basic infrastructure of the internet, onboard 3rd-party datasets, and securely integrate client data. Additionally, you will apply your experience in large scale data processing and distributed systems to the problem of promptly and reliably processing terabytes of data each day into a coherent view of the internet for consumption by downstream components of the Expanse Platform. Your work will help define and secure the perimeters of the world's most important organizations.

You will be a technical leader within the team, with responsibility for mentoring and supporting your team members and developing features from end-to-end and maintain them in production. You will collaborate with the rest of your team on architectural direction, managing technical debt, and continuously evolving the team's agile development process.

What You’ll Do

  • Evolve the Expanse Platform's ability to more robustly, more frequently, and more thoroughly detect services across the global internet
  • Manage, monitor, and improve the quality and rate of refresh for internet intelligence datasets, including RDAP and BGP information, DNS records, GeoIP, threat feeds, honeypot logs, and more
  • Mentor and support your team members
  • Serve as a representative for your team in architectural planning meetings and other interactions with peer engineering groups
  • Develop a platform supporting rapid development of new feature areas atop Expanse data, as well as automated pipelines that cohere raw datasets into a single, high-quality, and continuous view of the internet
  • Bring the best technologies to bear against the most pressing issue facing the modern internet - cybersecurity
  • Take ownership of projects, drive them to completion, and support them in production

About You

  • 5+ years of experience as a professional software engineer
  • Deep experience in at least one of the following areas, and familiarity with one other:
    • Design and development of stream/event-processing architectures using technologies such as Kafka, RabbitMQ, Storm, Spark, or their equivalents
    • Implementation and operation of distributed systems
    • The subtleties of network infrastructure and protocols (it's okay if you are strong in the other areas and have very little background in this one, you can learn it here)
  • Experience optimizing data pipelines for latency, throughput, and/or economical use of cloud resources
  • Skilled in using "infrastructure as code" tools to manage cloud infrastructure and to execute software releases
  • Familiarity with Kubernetes is a plus
  • Proficiency in Java and/or Go
  • Experienced in supporting your work in production
  • Willing and able to work in San Francisco, CA

Benefits

  • 100% coverage of employee healthcare benefits (Medical, Dental, Vision)
  • 60% coverage for dependent healthcare benefits
  • Unlimited PTO + 8 company holidays
  • Company sponsored parental leave
  • 401k Plan
  • Opportunities for professional development to attend conferences, classes, and workshops
  • $75 every quarter as discretionary team building stipend
  • $50 every month in cell phone reimbursement
  • $65 every month for your wellness to cover costs of gyms, courses and other activities
  • $300, one time, to customize your desk space
  • Pre-tax commuter, HSA, & FSA benefits
  • Stocked kitchen + catered lunch and dinner
  • On-site activities such as Lunch and Learns, Speaker Series, Game Night, and Trivia Night
  • Company-wide events including team building, holiday party, and offsites

Refer a Friend

  • Send your most talented friends our way. If we hire one, you'll get $1,000 even if you're not an Expanse employee. Please email [email protected] to learn more!

Expanse is committed to creating a diverse environment and is proud to be an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex or gender (including pregnancy, gender identity, gender expression, sexual orientation, transgender status), medical condition, HIV/AIDS or Hepatitis C status, marital status, military or veteran status, political activities, affiliations, citizenship, or any other characteristic or class protected by the laws or regulations in the locations where we operate. If you need assistance and/or a reasonable accommodation in the application or recruiting process due to a disability, please contact us at [email protected].

Read Full Job Description
Apply Now
By clicking Apply Now you agree to share your profile information with the hiring company.

Location

425 Market St, San Francisco, 94105

Similar Jobs

Apply Now
By clicking Apply Now you agree to share your profile information with the hiring company.
Learn more about ExpanseFind similar jobs