Circana Logo

Circana

Senior Staff Engineer| Hybrid: Chicago, IL

Posted 29 Days Ago
Be an Early Applicant
Remote or Hybrid
Hiring Remotely in United States
190K-190K Annually
Senior level
Remote or Hybrid
Hiring Remotely in United States
190K-190K Annually
Senior level
Design and develop low-latency, high-throughput distributed database kernels for massively parallel analytics. Responsibilities include query execution, columnar storage, transaction management, cluster coordination, hardware-aware optimization, SIMD vectorization, RDMA networking, in-database machine learning, vector indexing, performance tuning, architecture reviews, code reviews, mentoring, and resolving scalability issues.
The summary above was generated by AI

Let’s be unstoppable together!

 

Circana is a leading provider of technology, AI, and data solutions for consumer packaged goods companies, manufacturers, and retailers. Our predictive analytics and Liquid Data® platform help clients measure market share, uncover consumer behavior, and drive growth—powered by six decades of expertise and an expansive, high-quality data set.


At Circana, we are fueled by our passion for continuous learning and growth, we seek and share feedback freely, and we celebrate victories both big and small in an environment that is flexible and accommodating to our work and personal lives.  We’re a global company dedicated to fostering inclusivity and belonging. We value and celebrate the unique experiences, cultures, and viewpoints that each individual brings. By embracing a wide range of backgrounds, skills, expertise, and beyond, we create a stronger, more innovative environment for our employees, clients, and communities. With us, you can always bring your full self to work.  Join our inclusive, committed team to be a challenger, own outcomes, and stay curious together. Circana is proud to be Certified™ by Great Place To Work®. This prestigious award is based entirely on what current employees say about their experience working at Circana. Learn more at www.circana.com.

 

Role Overview

We are seeking Senior Staff Engineers to drive design, evolution, and execution of our next-generation, massively parallel processing (MPP) clustered database engine (Whitebox) that currently powers large-scale retail and consumer analytics solutions across Circana clients in 22+ countries and serving millions of queries every day in real-time against massive data sets . This is a highly technical role for an expert who bridges the gap between High-Performance Computing (HPC) and Big Data systems engineering and low-latency machine learning infrastructure and involves database internals, distributed systems, performance engineering, data processing at scale.


In this role, you will be one of the primary designers and developer responsible for building low-latency, high-throughput distributed database kernels. You will design bare-metal optimized software layers, ensuring our database product fully exploits modern multi-core, vectorized hardware and distributed network fabrics to process terabyte/petabyte-scale datasets and where appropriate, seamlessly executes highly performant analytics and in-database ML inference directly on relational and the occasional vector datasets.


Job Responsibilities

  • Architecture & Design: Play a key role in core architectural choices and roadmap for our distributed database kernel, including query execution engines, custom/hybrid columnar storage layers, distributed transaction managers, and cluster coordination protocols.
  • Low-Level Development: Write, optimize, and maintain highly performant, production-ready backend code utilizing modern C++ (C++20/23).
  • Parallel Execution Planning: Architect MPP execution engines that distribute, schedule, and execute queries across several dozens to hundreds of nodes using MPI and hybrid OpenMP models.
  • Hardware Optimization: Profile and eliminate execution bottlenecks by implementing explicit SIMD vectorization (AVX-512, ARM Neon, SVE) and ensuring absolute cache locality (L1/L2/L3).
  • Distributed Memory & Networks: Design ultra-low latency cluster communication subsystems utilizing RDMA, RoCE, or kernel-bypass tech (DPDK).
  • In-Database ML Framework Design: Architect and implement a native, highly performant, zero-copy ML execution framework directly inside the MPP engine to eliminate data serialization and transport bottlenecks between the database and external AI pipelines.
  • Functional & High-Performance Algorithms: Develop mathematically rigorous, cache-oblivious, and highly vectorized algorithms for real-time statistical computations, matrix operations/manipulations on clustered data
  • Vector & Embedding Infrastructure: Design and optimize or embed/reference distributed high-dimensional vector storage subsystems, custom SIMD-accelerated indexing structures (e.g., HNSW, IVF-PQ), and parallelized approximate nearest neighbor (ANN) search algorithms.
  • Be comfortable working in a cross country/multi time zone team of elite systems engineers, implementing as well as conducting rigorous peer design and development reviews
  • Collaborate with cross-functional teams in defining and developing new platform capabilities.
  • Actively participate in architecture reviews, code reviews, and technical mentoring.
  • Investigate and resolve complex performance and scalability issues.

Required Technical Qualifications

  • Minimum - 4 years Computer Science engineering degree from a reputed institute. Masters in HPC (high performance computing) and Bigdata engineering areas preferred for Senior staff engineer and above roles
  • Modern C++ Expertise: 8+ years of production experience writing hands-on, low-level systems in C++ (C++17/20/23 preferred). Mastery of template metaprogramming, concepts, coroutines, and custom memory allocators is key.
  • HPC Parallelism: Very good to expert-level knowledge of cluster-scale distributed programming using MPI (Message Passing Interface) paired with shared-memory thread-level programming via OpenMP and MapReduce frameworks.
  • Hardware-Aware Engineering: Documented experience with microarchitectural optimization, loop vectorization, pointer-aliasing constraints, and manual SIMD intrinsics programming.
  • Concurrency Mechanics: Deep understanding of OS internals, memory barriers, lock-free data structures, and atomics (std::atomic).
  • Database Internals: Practical experience designing core database subsystems (e.g., vectorized query operators, LSM-trees, B-trees, custom buffer pools, columnar serialization frameworks and query plan optimizers).
  • Strong debugging, performance tuning, and problem-solving skills.
  • Proficiency in one or more leading memory and compute monitoring/performance tools (such as Valgrind, Purify, Intel/AMD/ARM diagnostics etc.)

Bonus Qualifications

  • Track record contributing to open-source or work experience on proprietary distributed engines (e.g., ClickHouse, DuckDB, Doris, CockroachDB, RocksDB, ScyllaDB, or Velox).
  • Experience with cloud-native distributed, elastic environments, object storage tiering (S3/GCS), or zero-copy networking.
  • Experience integrating heterogeneous acceleration (NVIDIA CUDA / ROCm) into big data workloads and hybrid CPU/GPU setups.
  • Vector & Graph Algorithmic experience: Experience building or modifying high-performance vector index/search engines, graph-based indices, or localized quantization frameworks.
  • Functional domain awareness – CPG, Retail, Pharma verticals


What We Offer

  • Work on the bleeding edge of data infrastructure, tackling next gen big data engineering problems to support real time querying and analytics against some of the largest data sets at high concurrency
  • Challenging engineering problems - all the way from functional/data science algorithm implementations on a HPC setup to bare metal/close to OS kernel level programming involving handling of hundreds of billions of records to support real-time analytics at scale.
  • Plenty of valuable exposure to broader BI/Analytics/Bigdata ecosystem including great opportunity to functionally better understand CPG, Retail and related domains.
  • Highly competitive compensation package (Base, Bonus)

Stimulating work environment and a great Circana work culture that allows members to bring their best daily.

 

Circana Behaviors

Beyond technical skills, experience, and role-specific attributes, these shared behaviors are fundamental to our culture and success. We seek individuals who consistently demonstrate and champion these behaviors in their daily work:

  • Stay Curious: Being hungry to learn and grow, always asking the big questions.
  • Seek Clarity: Embracing complexity to create clarity and inspire action.
  • Own the Outcome: Being accountable for decisions and taking ownership of our choices.
  • Center on the Client: Relentlessly adding value for our customers.
  • Be a Challenger: Never complacent, always striving for continuous improvement.
  • Champion Inclusivity: Fostering trust in relationships engaging with empathy, respect, and integrity.
  • Commit to each other: Contributing to making Circana a great place to work for everyone.

Location: This position can be located in the following area(s): Hybrid: Chicago, IL 

 The below range reflects the range of possible compensation for this role at the time of this posting. We may ultimately pay more or less than the posted range. This range may be modified in the future. An employee’s position within the salary range will be based on several factors including, but not limited to, relevant education, qualifications, certifications, experience, skills, seniority, geographic location, performance, shift, travel requirements, sales or revenue-based metrics, any collective bargaining agreements, and business or organizational needs. The salary range for this role is up to $190,000 USD.


This job is also eligible for bonus pay.


We offer a comprehensive package of benefits including paid time off, medical/dental/vision insurance and 401(k) to eligible employees.


An offer of employment may be conditional upon successful completion of a background check in accordance with local legislation and our candidate privacy notice. Your current employer will not be contacted without your permission.


You can apply for this role through the Circana careers website or Intranet site for internal candidates. This role is subject to AI-assisted screening. Circana uses artificial intelligence (AI) to assess resumes for alignment with job requirements by helping locate details in resumes that relate to the job description.


This position is expected to remain open for approximately 30 days and may close earlier if sufficient qualified candidates are identified.


Equal Opportunity Employer/Protected Veterans/Individuals with Disabilities
This employer is required to notify all applicants of their rights pursuant to federal employment laws. For further information, please review the Know Your Rights notice from the Department of Labor.

Similar Jobs

15 Minutes Ago
Remote or Hybrid
USA
41K-83K Annually
Mid level
41K-83K Annually
Mid level
Machine Learning • Payments • Security • Software • Financial Services
Provides enterprise technology support through phone, ticketing, and potentially chat channels. Troubleshoots hardware, software, network, access, and application issues; manages incidents and escalations; documents resolutions in ServiceNow or similar ITSM tools; analyzes trends and operations data; supports knowledge management, training, process improvement, and automation; and coaches junior analysts while maintaining customer service, security, and confidentiality standards.
Top Skills: Call Center TechnologiesHardware InfrastructureItsmNetworkingServicenow
15 Minutes Ago
Remote or Hybrid
USA
86K-173K Annually
Senior level
86K-173K Annually
Senior level
Machine Learning • Payments • Security • Software • Financial Services
Leads the design, automation, deployment, monitoring, and security of Azure cloud infrastructure. Builds Infrastructure as Code with Terraform, Bicep, or ARM templates; manages CI/CD pipelines through Azure DevOps and GitHub; and implements monitoring, logging, alerting, incident response, patching, and vulnerability management. Collaborates with engineering, development, architecture, security, and incident management teams to improve system reliability, scalability, performance, and cost efficiency.
Top Skills: Arm TemplatesAzureAzure DevopsAzure MonitorBashBicepCi/CdElastic StackElk StackGithub ActionsGithub EnterpriseInfrastructure As CodeKubernetesPowershellTerraform
15 Minutes Ago
Remote or Hybrid
USA
38K-75K Annually
Mid level
38K-75K Annually
Mid level
Machine Learning • Payments • Security • Software • Financial Services
Provide high-volume, phone-based technical support and first-line resolution for hardware, software, networking and access issues. Log and track incidents in ServiceNow/ITSM, escalate complex problems, suggest process improvements, and maintain security and confidentiality while working from an approved remote workspace on a set evening/weekend schedule.
Top Skills: Call Center TechnologiesItsmPhone SystemsServicenowTicketing Systems

What you need to know about the San Francisco Tech Scene

San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.

Key Facts About San Francisco Tech

  • Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Google, Apple, Salesforce, Meta
  • Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
  • Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
  • Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account