Design, develop, and operate a highly scalable ClickHouse-based data platform processing massive transaction and data volumes. Responsibilities include schema and query optimization, replication, sharding, capacity planning, production troubleshooting, cloud migration, resilient client SDK development, operational instrumentation, and platform advocacy. The role also requires Java development, infrastructure automation, CI/CD, distributed systems expertise, and collaboration across engineering teams.
Come work at a place where innovation and teamwork come together to support the most exciting missions in the world!
Senior Software Engineer (Data Platform, ClickHouse)
We are seeking a highly motivated and talented Senior Software Engineer to work on Qualys’ next-generation Data Platform and middleware. For this position, we are looking for someone with expertise in ClickHouse.
Working alongside a very talented team of engineers and architects, you will be responsible for prototyping, designing, developing and supporting a highly scalable SaaS based cloud security Data Platform. This is a great opportunity to be an integral part of a team building Qualys’ next generation microservices based technology platform processing over a 100 million transactions and terabytes of data per day, leverage open source technologies, and work on challenging and business-impacting projects.
Responsibilities
For this position, we are especially looking for someone with below capabilities:
- Brings deep expertise in ClickHouse internals and architecture, various ClickHouse engines, partitioning, ordering keys, indexing, and query execution.
- Design and review schemas against real-world read/write patterns, optimizing ingestion, query performance, and storage efficiency.
- Operate ClickHouse at scale on premise or cloud, including replication, sharding, workload management, performance tuning, and production troubleshooting.
- Drive capacity planning across CPU, memory, storage I/O, and network resources, accounting for workload growth, concurrency, background merges, and reliability requirements.
- You will be responsible for engineering of services running data stored with millions of transactions per second, scaling to 100s of terabytes of data. You will be responsible for driving the data source and providing data platform as a service to various applications built in Qualys.
- Be the face and developer advocate of the technology stack you own and contribute back to open-source community if any enhancement needed to fit in Qualys ecosystem.
- You will be instrumenting both day 1 and day 2 operations on these data technologies keeping the 100s of thousands if not millions of operations per second. Migrate, burst into cloud and scale the stack with zero or least amount of downtime.
- You will be responsible for delivering resilient client SDKs to the applications to communicate with the data source you are responsible for.
- You will be constantly in the hunt for better solutions out there to resolve the current scaling, availability, and cost-effective alternative solutions.
Qualifications
- BS/MS degree in Computer Science, Applied Math or related field.
- Experience and expertise in ClickHouse as outlined earlier
- 5+ years hands-on experience with developing SaaS based software products and solutions for service-oriented deployments in public (AWS, GCP, Azure, OCI, etc.) or private clouds.
- Proven expertise in data-driven critical thinking problem-solving
- Ability to debug systems of software and people
- Demonstrated ability to write high-quality, production-ready code (readable, well-tested, with well-designed APIs)
- Demonstrated passion for innovation with an ability to work within agile software development methodologies
- Experience with infrastructure orchestration and automation tools (Terraform)
- Hands-on experience using CI/CD pipelines
- Strong analytical and debugging skills.
- Java programming skills including object-oriented design, prototyping, development, testing, profiling, etc.
- Knowledge of JVM concepts like garbage collection, heap, stack, profiling, class loading, etc.
- Strong in data structures and algorithms.
- Ability to clearly articulate and communicate technical concepts within and across teams.
- Knowledge of the below is a plus
- Experience with distributed systems like Cassandra, Redis, Elasticsearch, Kafka, Ceph, Flink, Spark or similar technologies
- Experience with applying data encryption and data security standards.
- Experience with container and orchestration technologies such as Docker, Kubernetes etc.
- Experience with monitoring tools such as Graphite, Grafana and Prometheus.
- Experience with HashiCorp technologies such as Consul, Vault, Terraform and Vagrant.
- Experience with configuration management tools such as Chef, Puppet or Ansible.
- In-depth experience with continuous integration and continuous deployment pipelines.
- Exposure to Maven, Ant or Gradle for builds.
*******************************************************************************************************************************
The salary range for this position is $125,000 - $145,000 per year. Final compensation will be determined based on several factors, including but not limited to skills, relevant experience, and work location. Please note this range reflects base salary and does not include incentive compensation or potential equity grants. We also offer a comprehensive and highly competitive benefits package.
Qualys is an Equal Opportunity Employer, please see our EEO policy.
Qualys Foster City, California, USA Office
919 E Hillsdale Blvd, Foster City, CA , United States, 94404
Similar Jobs
AdTech • Artificial Intelligence • Digital Media • Machine Learning • Marketing Tech • Analytics • Consulting
Identifies and researches prospective customer accounts, conducts multichannel outbound outreach, schedules discovery calls and demos, and generates qualified sales opportunities. Performs weekly agency visits and monthly market travel to build relationships and expand physical presence. Tracks prospecting activity in HubSpot, uses sales intelligence and outreach tools, supports Growth Directors through the sales funnel, collaborates cross-functionally, and curates LinkedIn content to increase visibility.
Top Skills:
ApolloGoodyHubspot CrmLinkedin Sales NavigatorOutreachSalesforceWinmoZoominfo
Fintech • Information Technology • Payments • Sharing Economy • Financial Services • Cryptocurrency
Supports payroll technology solutions by translating business needs into technical requirements, coordinating with stakeholders and technology teams, leading user acceptance testing, evaluating Workday releases, improving payroll processes, and analyzing incidents and system performance. The role also performs root cause analysis, monitors payroll outcomes, documents requirements, and recommends solutions to improve efficiency, accuracy, and compliance.
Top Skills:
ExcelSoxWorkday Payroll
Information Technology • Internet of Things • Mobile • On-Demand • Software
Acquires residential customers through door-to-door outreach, conducts needs analyses, recommends telecommunications products, presents sales proposals, completes sales documentation, meets monthly targets, monitors competitors, and participates in training. The role requires extensive outdoor territory work, evening and weekend availability, independent work, a driver’s license, personal vehicle, and the ability to work without employment-based immigration sponsorship.
Top Skills:
Computer Operating SystemsModemsPdasRoutersSet-Top ConvertersSmartphonesSoftware ApplicationsWireless Devices
What you need to know about the San Francisco Tech Scene
San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.
Key Facts About San Francisco Tech
- Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Google, Apple, Salesforce, Meta
- Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
- Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
- Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine
