Performance skills

C

cuTile Kernel Performance Optimization

nvidia

Optimize cuTile kernel performance iteratively and systematically.

C

CuTile Autotuning

nvidia

Optimize CuTile kernels with automated tuning techniques.

RAG-Perf

nvidia

Benchmark performance of NVIDIA RAG Blueprint servers.

O

Omniverse USD Performance Tuning

nvidia

Optimize USD performance for better loading and rendering.

M

Megatron Bridge Resiliency

nvidia

Enhance fault tolerance and performance in distributed training.

S

Sequence Packing

nvidia

Optimize sequence packing for LLMs and VLMs in Megatron-Bridge.

P

Parallelism Strategy Selection

nvidia

Optimize parallelism for Megatron Bridge models effectively.

MoE VLM Training

nvidia

Optimize your MoE VLM training with practical guidance.

M

MoE Hardware Configurations

nvidia

Optimize your MoE training across hardware platforms.

M

MoE Dispatcher Selection

nvidia

Optimize your MoE token dispatcher for peak performance.

Memory Tuning

nvidia

Optimize GPU memory usage during training runs.

H

Hierarchical Context Parallel

nvidia

Optimize Megatron-Bridge for hierarchical context parallelism.

MoE Expert-Parallel Overlap

nvidia

Optimize MoE model performance with expert-parallel communication.

CUDA Graphs

nvidia

Optimize GPU performance with CUDA graph capture.

C

CPU Offloading

nvidia

Optimize memory usage by offloading CPU tasks in Megatron Bridge.

Activation Recompute

nvidia

Optimize GPU memory usage with activation recompute.

NeMo Evaluator Plugin

nvidia

Evaluate models and datasets efficiently with NeMo.

J

Jetson Memory Optimizer

nvidia

Optimize DRAM usage for Jetson devices.

J

Jetson Inference Memory Tuning

nvidia

Optimize memory settings for LLM/VLM on NVIDIA Jetson.

Customize Clocks

nvidia

Control CPU, GPU, and EMC clock settings for Jetson devices.

DeepStream Profiling

nvidia

Efficiently profile and tune DeepStream pipelines.

Accelerated Computing cuDF

nvidia

Efficient GPU DataFrame operations for pandas users.

A

Adaptive Tuning for NeMo Relay

nvidia

Optimize adaptive plugin behavior for NeMo Relay.

T

TP DP PP Communication Overlap

nvidia

Optimize Megatron-Bridge for efficient communication overlap.