Design and optimize high-performance compute kernels for AI primitives (GEMM, attention, convolution), profile and tune across heterogeneous hardware, collaborate with compiler/runtime teams (Triton, PyTorch, SYCL), prototype precision formats, and contribute micro-architecture feedback while writing reusable C++/CUDA/Triton/MLIR code.
Description
- Design and implement high-performance compute kernels for AI primitives such as GEMM, attention, normalization, and convolution.
- Optimize for throughput, latency, and memory hierarchy across heterogeneous compute units (SIMD, matrix engines, DMA).
- Collaborate with compiler and runtime teams to integrate kernels into Triton, PyTorch, or SYCL pipelines.
- Profile and tune kernels using tools like Perfetto, VTune, Tracy, or custom simulators.
- Prototype and evaluate precision formats (FP16/BF16/FP8/e5m2, etc.) and stochastic rounding.
- Contribute to micro-architecture feedback loops, helping co-design ISA and memory features with the hardware team.
- Write clear, well-structured, and reusable code (C++/CUDA/Triton/LLVM MLIR).
- Bachelor's or Master's in Computer Science, Computer Engineering, or a related field from a recognized university.
- Strong background in parallel programming (CUDA, Triton, SYCL, OpenCL, Metal, POSIX Threads, or OpenMP).
- Experience with optimization of irregular algorithms, such as graph computations or sparse numerical linear algebra, combining high-level data structure design with low-level SIMD and synchronization optimizations.
- Deep understanding of memory layout, vectorization, thread/block scheduling, and cache behavior.
- Proficiency in C++11 or higher, with strong knowledge of standard algorithms, data structures, and generic programming paradigms.
- Experience with code generation for high-performance computations and knowledge of frameworks like BLAS/BLIS/Torch
- Skilled in performance analysis and parallel debugging using tools such as Valgrind, GNU Debugger, or CI testing frameworks.
- Hands-on experience profiling and optimizing compute or AI workloads (e.g., GEMM, softmax, attention).
- Solid grasp of numerical stability, precision formats, and mixed precision arithmetic.
- Collaborative work style with the ability to operate effectively in multicultural, cross-disciplinary environments.
Similar Jobs
eCommerce • Information Technology • Retail • Industrial
Outside B2B sales role managing ~85 medium customers (~$2M portfolio). Build territory and account plans, grow customer relationships, maintain CRM pipeline, identify opportunities, negotiate deals, and conduct face-to-face customer meetings within an assigned geography.
eCommerce • Information Technology • Retail • Industrial
Outside B2B sales role managing ~85 medium-size MRO customers across a territory. Build territory and account plans, grow sales through relationship development, pipeline management, CRM use, customer meetings, negotiation, and multi-channel outreach. Regular face-to-face customer visits with occasional overnight travel.
Top Skills:
CRM
eCommerce • Information Technology • Retail • Industrial
Outside B2B sales role managing ~85 medium-sized customers and a $2M portfolio. Build territory and account plans, grow customer relationships, maintain pipeline, use CRM to track opportunities, and conduct face-to-face meetings within an assigned geography. Negotiate and close sales while balancing customer satisfaction and profitability.
Top Skills:
CRM
What you need to know about the San Francisco Tech Scene
San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.
Key Facts About San Francisco Tech
- Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Google, Apple, Salesforce, Meta
- Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
- Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
- Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine
.png)
