Samsung Semiconductor, Inc. Logo

Samsung Semiconductor, Inc.

Senior Staff Performance Engineer

Posted 17 Days Ago
Be an Early Applicant
In-Office
San Jose, CA, USA
189K-301K Annually
Senior level
In-Office
San Jose, CA, USA
189K-301K Annually
Senior level
Build and operate production-like AI environments for agentic workflows, distributed inference, disaggregated serving, and MoE deployments. Collect traces and telemetry, analyze workload performance across software and hardware layers, identify bottlenecks, and evaluate multi-node scaling behavior. Define benchmarking methodologies and communicate findings to hardware architects, systems engineers, and software researchers. Provide technical direction for workload characterization and performance evaluation across AI platforms.
The summary above was generated by AI

Please Note:

To provide the best candidate experience amidst our high application volumes, each candidate is limited to 10 applications across all open jobs within a 6-month period. 

Advancing the World’s Technology Together

Our technology solutions power the tools you use every day--including smartphones, electric vehicles, hyperscale data centers, IoT devices, and so much more. Here, you’ll have an opportunity to be part of a global leader whose innovative designs are pushing the boundaries of what’s possible and powering the future. 

We believe innovation and growth are driven by an inclusive culture and a diverse workforce. We’re dedicated to empowering people to be their true selves. Together, we’re building a better tomorrow for our employees, customers, partners, and communities.

Please Note:

To provide the best candidate experience amidst our high application volumes, each candidate is limited to 10 applications across all open jobs within a 6-month period. 

Advancing the World’s Technology Together

Our technology solutions power the tools you use every day--including smartphones, electric vehicles, hyperscale data centers, IoT devices, and so much more. Here, you’ll have an opportunity to be part of a global leader whose innovative designs are pushing the boundaries of what’s possible and powering the future. 

We believe innovation and growth are driven by an inclusive culture and a diverse workforce. We’re dedicated to empowering people to be their true selves. Together, we’re building a better tomorrow for our employees, customers, partners, and communities.

The AGI (Artificial General Intelligence) Computing Lab is dedicated to solving the complex system-level challenges posed by the growing demands of future AI/ML workloads. Our team is committed to designing and developing scalable platforms that can effectively handle the computational and memory requirements of these workloads while minimizing energy consumption and maximizing performance. To achieve this goal, we collaborate closely with both hardware and software engineers to identify and address the unique challenges posed by AI/ML workloads and to explore new computing abstractions that can provide a better balance between the hardware and software components of our systems. Additionally, we continuously conduct research and development in emerging technologies and trends across memory, computing, interconnect, and AI/ML, ensuring that our platforms are always equipped to handle the most demanding workloads of the future. By working together as a dedicated and passionate team, we aim to revolutionize the way AI/ML applications are deployed and executed, ultimately contributing to the advancement of AGI in an affordable and sustainable manner. Join us in our passion to shape the future of computing!

Location: Daily onsite presence at our San Jose, CA office / U.S. headquarters in alignment with our Flexible Work policy.

What You’ll Do

  • Build and operate AI environments that reflect production workloads, including agentic workflows, distributed inference, disaggregated serving architectures, and MoE deployments.

  •  Collect workload traces, runtime telemetry, and performance data across the software stack from AI applications.

  •  Characterize and compare workloads across environments and platforms, identifying compute, memory, communication, and scheduling bottlenecks from applications and frameworks to runtimes, hosts, and devices.
  • Communicate findings to hardware architects, systems engineers, and software researchers through reports, presentations, and architecture reviews.
  • Define performance evaluation methodologies and benchmarking standards for adoption across hardware and software teams, and set the technical direction for workload characterization.

What You Bring

  • BS, MS, or PhD in Computer Science, Computer Engineering, Electrical Engineering, or a related field, or equivalent industry experience. Required industry experience: 10+ years with a BS, 8+ years with an MS, or 5+ years with a PhD in performance engineering, AI systems, distributed systems, high-performance computing, or a related area. Candidates with additional experience and a record of technical leadership across teams may be considered at the Senior Staff level.
  • Ability to interpret workload traces, runtime telemetry, and performance data to identify bottlenecks and explain their underlying causes, including how workload characteristics interact with specific operations and mechanisms within software and hardware layers.

  • Knowledge of the LLM software stack, including serving and scheduling, attention and KV-cache management, kernel launch and memory-transfer overhead, and collective communication, and how these interact with accelerator compute throughput, memory hierarchy, memory bandwidth, and interconnect topology.

  • Experience characterizing agentic workflows, long-context processing, MoE models, or disaggregated inference deployments.

  • Experience profiling and optimizing AI workloads on NVIDIA GPU platforms using Nsight Systems and Nsight Compute, with analysis informed by GPU execution, memory hierarchy, and communication mechanisms.

  • Experience analyzing multi-node AI deployments, including synchronization overhead, load imbalance, communication patterns, and scaling behavior.

  • Experience with AI frameworks or serving systems such as PyTorch, vLLM, SGLang, TensorRT-LLM, DeepSpeed, Ray, or Megatron-LM.


What We Offer
The pay range below is for all roles at this level across all US locations and functions. Pay within this range varies by work location and may also depend on job-related knowledge, skills, and experience. We also offer incentive opportunities that reward employees based on individual and company performance. 

This is in addition to our diverse package of benefits centered around the wellbeing of our employees and their loved ones. In addition to the usual Medical/Dental/Vision/401k, our inclusive rewards plan empowers our people to care for their whole selves. An investment in your future is an investment in ours.

Give Back With a charitable giving match and frequent opportunities to get involved, we take an active role in supporting the community.
Enjoy Time Away You’ll start with 4+ weeks of paid time off a year, plus holidays and sick leave, to rest and recharge.
Care for Family Whatever family means to you, we want to support you along the way—including a stipend for fertility care or adoption, caregiver support, and medical travel support.
Prioritize Emotional Wellness With on-demand apps and free confidential therapy sessions, you’ll have support no matter where you are.
Stay Fit Eating well and being active are important parts of a healthy life. Our onsite Café and gym, plus virtual classes, make it easier.
Embrace Flexibility Benefits are best when you have the space to use them. That’s why we facilitate a flexible environment so you can find the right balance for you.

Base Pay Range
$189,000—$301,000 USD

Equal Opportunity Employment Policy 

Samsung Semiconductor takes pride in being an equal opportunity workplace dedicated to fostering an environment where all individuals feel valued and empowered to excel, regardless of race, religion, color, age, disability, sex, gender identity, sexual orientation, ancestry, genetic information, marital status, national origin, political affiliation, or veteran status.

When selecting team members, we prioritize talent and qualities such as humility, kindness, and dedication. We extend comprehensive accommodations throughout our recruiting processes for candidates with disabilities, long-term conditions, neurodivergent individuals, or those requiring pregnancy-related support. All candidates scheduled for an interview will receive guidance on requesting accommodations.

Our Commitment to Innovation and Fairness

At Samsung Semiconductor, we use Artificial Intelligence (AI) tools in the recruitment process to enhance efficiency. However, AI is used as a support tool, not a final decision-maker. All hiring decisions are made by our human recruiting team and hiring managers to ensure every candidate is evaluated fairly and holistically.

Recruiting Agency Policy

We do not accept unsolicited resumes. Only authorized recruitment agencies that have a current and valid agreement with Samsung Semiconductor, Inc. are permitted to submit resumes for any job openings.

Applicant AI Use Policy 

At Samsung Semiconductor, we support innovation and technology. However, to ensure a fair and authentic assessment, we ask that candidates rely on their own knowledge and skills throughout the process. AI tools may be used for basic preparation, grammar, and research, but should not be used to generate or assist with submitted content or live interview responses. If we determine that AI is being used outside these guidelines, we reserve the right to pause or end the interview, and your candidacy may be disqualified.

Trade Secret Notice

By submitting an application, you agree not to disclose to Samsung—or encourage Samsung to use—any confidential or proprietary information (including trade secrets) belonging to a current or former employer or other entity.


Applicant Privacy Policy
https://semiconductor.samsung.com/about-us/careers/us/privacy/

HQ

Samsung Semiconductor, Inc. San Jose, California, USA Office

San Jose, CA, United States

Samsung Semiconductor, Inc. Milpitas, California, USA Office

Milpitas, United States

Samsung Semiconductor, Inc. Santa Clara, California, USA Office

Santa Clara, United States

Similar Jobs

7 Days Ago
Remote or Hybrid
Santa Clara, CA, USA
175K-265K Annually
Senior level
175K-265K Annually
Senior level
Artificial Intelligence • Machine Learning • Software
Own end-to-end performance of LLM inference workloads across orchestration, networking, serving frameworks, runtimes, operating systems, and accelerators. Diagnose regressions through profiling, improve latency, throughput, and stability, encode workload requirements into orchestration, develop telemetry and benchmarks, create investigation playbooks, and mentor engineers. Work spans Kubernetes, heterogeneous hardware, speculative decoding, KV-cache management, batching, NUMA, and cross-team root-cause resolution.
Top Skills: AutoscalingBenchmarkingCC++Cpu PinningCpusetsCudaGpuKubernetesKv-CacheLinuxLlm Inference ServingNcclNetworkingNsightNumaPciePythonQuantizationRustSglangSpeculative DecodingTelemetryTensorrt-LlmVllm
28 Days Ago
In-Office
Palo Alto, CA, USA
110K-260K Annually
Senior level
110K-260K Annually
Senior level
Insurance
The Senior Staff Engineer will enhance cloud performance and observability, optimize CI/CD pipelines, lead automation, mentor engineers, and support containerization initiatives.
Top Skills: AnsibleArgocdCi/CdDockerGitGithub ActionsGrafanaJenkinsKubernetesOpenstackPrometheusPython
2 Months Ago
Remote or Hybrid
San Francisco, CA, USA
148K-260K Annually
Senior level
148K-260K Annually
Senior level
Transportation
As a Software Engineer, you'll design and optimize algorithms for real-time sensor data processing, collaborating with a talented team on high-performance solutions for autonomous driving.
Top Skills: C++CudaHalideMojoOpenclRustTaichiVulkanWarp

What you need to know about the San Francisco Tech Scene

San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.

Key Facts About San Francisco Tech

  • Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Google, Apple, Salesforce, Meta
  • Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
  • Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
  • Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account