Design and optimize high-performance compute kernels for AI primitives (GEMM, attention, convolution), profile and tune across heterogeneous hardware, collaborate with compiler/runtime teams (Triton, PyTorch, SYCL), prototype precision formats, and contribute micro-architecture feedback while writing reusable C++/CUDA/Triton/MLIR code.
Description
- Design and implement high-performance compute kernels for AI primitives such as GEMM, attention, normalization, and convolution.
- Optimize for throughput, latency, and memory hierarchy across heterogeneous compute units (SIMD, matrix engines, DMA).
- Collaborate with compiler and runtime teams to integrate kernels into Triton, PyTorch, or SYCL pipelines.
- Profile and tune kernels using tools like Perfetto, VTune, Tracy, or custom simulators.
- Prototype and evaluate precision formats (FP16/BF16/FP8/e5m2, etc.) and stochastic rounding.
- Contribute to micro-architecture feedback loops, helping co-design ISA and memory features with the hardware team.
- Write clear, well-structured, and reusable code (C++/CUDA/Triton/LLVM MLIR).
- Bachelor's or Master's in Computer Science, Computer Engineering, or a related field from a recognized university.
- Strong background in parallel programming (CUDA, Triton, SYCL, OpenCL, Metal, POSIX Threads, or OpenMP).
- Experience with optimization of irregular algorithms, such as graph computations or sparse numerical linear algebra, combining high-level data structure design with low-level SIMD and synchronization optimizations.
- Deep understanding of memory layout, vectorization, thread/block scheduling, and cache behavior.
- Proficiency in C++11 or higher, with strong knowledge of standard algorithms, data structures, and generic programming paradigms.
- Experience with code generation for high-performance computations and knowledge of frameworks like BLAS/BLIS/Torch
- Skilled in performance analysis and parallel debugging using tools such as Valgrind, GNU Debugger, or CI testing frameworks.
- Hands-on experience profiling and optimizing compute or AI workloads (e.g., GEMM, softmax, attention).
- Solid grasp of numerical stability, precision formats, and mixed precision arithmetic.
- Collaborative work style with the ability to operate effectively in multicultural, cross-disciplinary environments.
Similar Jobs
Digital Media • Information Technology • News + Entertainment
Sell Comcast Internet, Data, Video and Voice solutions to small and mid-size businesses. Develop territory, generate leads via prospecting and presentations, promote bundled and advanced communications (PRI, Hosted PBX, multi-location), maintain pipeline and sales records, collaborate with technical and support teams, and meet or exceed sales and customer satisfaction targets.
Top Skills:
Comcast InternetComcast VideoComcast VoiceHosted PbxPri
Digital Media • Information Technology • News + Entertainment
Manage marketing and sales operations for small advertisers in retail trading areas. Hire, train, and evaluate staff; develop regional promotional partnerships and client-facing proposals; produce regular marketing reports; support sales pitches and strategic roll-outs; work variable hours including nights and weekends.
Digital Media • Information Technology • News + Entertainment
Sell integrated networking, security, and communications solutions (SD-WAN, UCaaS, network security) to enterprise multi-site accounts. Prospect, develop territory relationships, deliver in-person presentations, meet revenue and quota targets, collaborate with internal teams, and manage complex sales cycles while supporting customers and partners.
Top Skills:
EthernetNetwork SecuritySd-WanUcaasWireless
What you need to know about the San Francisco Tech Scene
San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.
Key Facts About San Francisco Tech
- Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Google, Apple, Salesforce, Meta
- Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
- Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
- Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine
.png)
