Zaimler Logo

Zaimler

Data Infrastructure Engineer (Query Engine)

Posted 7 Hours Ago
Be an Early Applicant
In-Office
San Mateo, CA, USA
Senior level
In-Office
San Mateo, CA, USA
Senior level
Design and build scalable, fault-tolerant query engines and integrations with modern data lake formats; optimize query execution using vectorized processing, cost-based optimization, and caching; extend or contribute to open-source platforms; collaborate with product, data science, and engineering teams to align solutions with business needs.
The summary above was generated by AI
About Us
We are on a mission to bridge the gap between enterprise business knowledge and data, democratizing data discovery and curation to prepare organizations for the era of generative AI. Today's data tools are overly complex, poorly integrated, and siloed, forcing AI Practitioners and data scientists alike to spend more time wrestling with tools, relying on tribal knowledge, and navigating data lakes rather than doing meaningful data science work. The current landscape of data tools and processes is heavily manual and needs to catch up with the vast amount of data generated daily. With the advent of Gen AI and multi-modality, this challenge has only grown more complex and broken.
 
Backed by top VC funds, we are committed to making enterprise data AI-ready faster, more reliably, and with a stronger foundation of factual semantic knowledge. This leads to more accurate models, superior outcomes, and better business results. Our team of seasoned data infrastructure and machine learning experts (from LinkedIn, Visa, Truera, Hive, and Branch) has spent the past two decades building bespoke systems to solve these very challenges.
 
Join our growing team of ML research and data infrastructure experts. We're committed to empowering AI and data scientists to seamlessly integrate semantic learning with generative AI. Be part of our journey to shape the future of enterprise AI.

Who You Are

  • Thrives in early-stage environments, eager to build robust systems from scratch.
  • Passionate about distributed systems and solving complex data challenges at scale.
  • Able to navigate ambiguity and adapt to changing requirements in a fast-paced startup.
  • Advocates for engineering efficiency and continuous improvement.
  • A leader who enjoys mentoring others and fostering a strong engineering culture.
  • Excited to work cross-functionally with a team that values transparency, purpose-driven innovation, and collective leadership.

What You Will Be Doing

  • Design and Develop: Build scalable, fault-tolerant query engines optimized for performance and resource efficiency.
  • Optimize Performance: Apply advanced techniques such as vectorized processing, cost-based optimization, and caching to enhance query execution.
  • Integrate Seamlessly: Develop integrations with modern data lake formats (e.g., Apache Iceberg, Delta Lake, and Hudi) and semantic layers.
  • Innovate in Distributed Systems: Architect solutions to handle concurrency, scalability, and reliability in distributed environments.
  • Leverage Open Source: Contribute to or extend platforms like Apache Spark, Presto, and Trino to meet unique product requirements.
  • Collaborate: Work with product, data science, and engineering teams to align technical solutions with business needs.
  • Stay Current: Research and implement the latest advancements in query processing and distributed systems.

Prior Experience

  • Proficiency in programming languages such as Java, Scala, Rust, or C++.
  • Deep understanding of query engine internals, distributed systems architecture, and parallel query processing.
  • Experience with modern big data technologies (e.g., Apache Spark, Presto, Trino) and data formats like Parquet, ORC, or Avro.
  • Proven ability to build and optimize scalable systems capable of processing petabyte-scale datasets.
  • Strong grasp of SQL semantics, execution plans, and query optimization techniques.

Nice to Have

  • Experience in building AI/ML infrastructure and ML production systems at scale.
  • Hands-on experience with Linux, Docker, and other containerization technologies.
  • Prior experience at an early-stage startup, developing systems and processes from scratch.

Why Join Us?
 
We’re a fast-moving, well-funded startup based in San Mateo, working onsite with flexible hours because the best ideas happen when smart people collaborate in person. We take ownership of our work, move with urgency while maintaining quality, and focus on delivering real results—not just effort. We offer competitive compensation, equity, full benefits (Medical, Dental, Vision, 401k), and a workspace built for collaboration, transparency, and deep technical problem-solving.
 
We sponsor H-1B visas and assist with immigration processes to bring the best minds together!

Similar Jobs

11 Minutes Ago
Hybrid
San Francisco, CA, USA
250K-350K Annually
Expert/Leader
250K-350K Annually
Expert/Leader
Artificial Intelligence • Fintech • Payments • Business Intelligence • Financial Services • Generative AI
Lead and scale the US Solutions Engineering organization, drive technical GTM strategy, own pre-sales solution design, POCs and implementations, influence product roadmap, build reusable tools and AI-driven enablement to improve go-live and adoption, and partner with Sales and Product to represent Airwallex to enterprise customers.
Top Skills: AIAPIs
12 Minutes Ago
Hybrid
San Francisco, CA, USA
150K-220K Annually
Senior level
150K-220K Annually
Senior level
Artificial Intelligence • Fintech • Payments • Business Intelligence • Financial Services • Generative AI
Lead development of financial-markets product capabilities (FX, stablecoins, liquidity and risk management). Drive product strategy, collaborate with Treasury and cross-functional teams, build 0→1 customer-facing features, and deliver pricing, execution, and reporting for market-facing financial services.
Top Skills: CryptoFxStablecoin
56 Minutes Ago
Hybrid
15-24 Hourly
Junior
15-24 Hourly
Junior
eCommerce • Fashion • Retail • Sales • Wearables • Design
Serve as the front-line Coach brand ambassador: deliver personalized luxury retail service, drive sales through clienteling and omnichannel tools, meet individual and store KPIs, perform daily store operations (cash wrap, inventory, visual merchandising), and support team collaboration and brand initiatives.
Top Skills: Clienteling ToolsIpadLaptopMobile PosPosShort-Form VideoSocial Selling PlatformsWalkie-Talkie

What you need to know about the San Francisco Tech Scene

San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.

Key Facts About San Francisco Tech

  • Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Google, Apple, Salesforce, Meta
  • Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
  • Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
  • Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account