/device-hardware/special-function-unit
What is a Special Function Unit?
SFU
The Special Function Units (SFUs) in Streaming Multiprocessors (SMs) accelerate certain arithmetic operations.
The internal architecture of an H100 SM. Special Function Units are shown in maroon, along with the Load/Store Units . Modified from NVIDIA's H100 white paper .
Notable for neural network workloads are transcendental mathematical operations,
like exp, sin, and cos.