NVIDIA is developing processor and system architectures that accelerate machine learning, automotive and high performance computing (HPC) applications. We are seeking a strong candidate to do GEMM kernel development and performance analysis for NVIDIA's new architectures. Your work will play a critical role in shaping the future of deep learning hardware and software, ensuring optimal performance for next-generation AI applications.  This position offers the opportunity to make a meaningful impact in a fast-moving, technology focused company.

What you'll be doing:

Design, develop, and optimize GEMM (General Matrix Multiply) kernels for NVIDIA's new architectures.

Implement and fine-tune kernels to achieve optimal performance on NVIDIA GPUs.

Conduct in-depth performance analysis of GPU kernels, including GEMM and other critical operations.

Identify bottlenecks, optimize resource utilization, and improve throughput, and power efficiency

Create and maintain workloads and micro-benchmark suites to evaluate kernel performance across various hardware and software configurations.

Generate performance projections, comparisons, and detailed analysis reports for internal and external stakeholders.

Collaborate with architecture, software, and product teams to guide the development of next-generation deep learning hardware and software.

What we need to see:

4+ years of industry experience in GPU programming or performance optimization for DL applications.

Hands-on experience in developing and optimizing GEMM (General Matrix Multiply) kernels.

Demonstrated experience in analyzing and improving the performance of GPU kernels, with measurable results (e.g., performance improvements, efficiency gains).

Expertise in CUDA programming for GPU acceleration.

Experience with performance profiling tools (e.g., NVIDIA Nsight).

Excellent communication skills, both written and verbal.

Strong organizational and time management abilities, with the ability to prioritize tasks effectively.