/device-hardware/register-file
What is a Register File?
The register file of the Streaming Multiprocessor stores bits in between their manipulation by the cores .
The internal architecture of an H100 SM. The register file is depicted in blue. Modified from NVIDIA's H100 white paper .
The register file is split into 32 bit registers that can be dynamically reallocated between different data types, like 32 bit integers, 64 bit floating point numbers, and (pairs of) 16 bit floating point numbers.
Allocation of registers in a Streaming Multiprocessor to threads is therefore generally managed by a compiler like nvcc , which optimizes register usage by thread blocks .