/device-hardware/load-store-unit
Load/Store Unit
LSU
The Load/Store Units (LSUs) dispatch requests to load or store data to the memory subsystems of the GPU.
The internal architecture of an H100 SM. Load/Store Units are shown in pink, along with the Special Function Units . Modified from NVIDIA's H100 white paper .
Most importantly for CUDA programmers they interact with the Streaming Multiprocessor 's on-chip SRAM L1 data cache and the off-chip, on-device global RAM that respectively implement the lowest and highest levels of the memory hierarchy in the CUDA programming model .