GPU Glossary
GPU Glossary
/device-hardware
?
Something seem wrong?
Or want to contribute?

Click this button to
let us know on GitHub.

Device Hardware

These terms and technologies are physical components of the GPU — the "device" in NVIDIA's lingo.

CUDA (Device Architecture)
Streaming Multiprocessor
SM
Core
Special Function Unit
SFU
Load/Store Unit
LSU
Warp Scheduler
CUDA Core
Tensor Core
Tensor Memory Accelerator
TMA
Streaming Multiprocessor Architecture
Texture Processing Cluster
TPC
Graphics/GPU Processing Cluster
GPC
Register File
L1 Data Cache
Tensor Memory
GPU RAM

Modal LogoBuilding on GPUs? We know a thing or two about it.

Modal is an ergonomic Python SDK wrapped around a global GPU fleet. Deploy serverless AI workloads instantly without worrying about quota requests, driver compatibility issues, or managing bulky ML dependencies.

Deploy on GPUs