GPU Glossary
GPU Glossary
/device-hardware/special-function-unit

What is a Special Function Unit?

SFU

The Special Function Units (SFUs) in Streaming Multiprocessors (SMs) accelerate certain arithmetic operations.

The internal architecture of an H100 SM. Special Function Units are shown in maroon, along with the Load/Store Units . Modified from NVIDIA's H100 white paper .

Notable for neural network workloads are transcendental mathematical operations, like exp, sin, and cos.

Something seem wrong?
Or want to contribute?

Click this button to
let us know on GitHub.