GPU Glossary

TABLE OF CONTENTS

Device Hardware

CUDA (Device Architecture)

Streaming Multiprocessor

Special Function Unit

Load/Store Unit

Tensor Memory Accelerator

Streaming Multiprocessor Architecture

Texture Processing Cluster

Graphics/GPU Processing Cluster

Device Software

CUDA (Programming Model)

Streaming ASSembler

Parallel Thread eXecution

Compute Capability

Cooperative Thread Array

Thread Block Grid

Thread Hierarchy

Memory Hierarchy

CUDA (Software Platform)

CUDA C++ (programming language)

NVIDIA GPU Drivers

CUDA Driver API

NVIDIA Management Library

CUDA Runtime API

NVIDIA CUDA Compiler Driver

NVIDIA Runtime Compiler

NVIDIA CUDA Profiling Tools Interface

NVIDIA Nsight Systems

CUDA Binary Utilities

Performance Bottleneck

Arithmetic Intensity

Memory Bandwidth

Arithmetic Bandwidth

Warp Execution State

Pipe Utilization

Issue Efficiency

Streaming Multiprocessor Utilization

Warp Divergence

Branch Efficiency

Memory Coalescing

Register Pressure

/device-hardware/load-store-unit

What is a Load/Store Unit?

LSU

The Load/Store Units (LSUs) dispatch requests to load or store data to the memory subsystems of the GPU.

Most importantly for CUDA programmers , they interact directly with the Streaming Multiprocessor 's on-chip SRAM L1 data cache and indirectly with the off-chip, on-device global RAM that respectively implement the lowest and highest levels of the memory hierarchy in the CUDA programming model .

Building on GPUs? We know a thing or two about it.

Modal is an ergonomic Python SDK wrapped around a global GPU fleet. Deploy serverless AI workloads instantly without worrying about quota requests, driver compatibility issues, or managing bulky ML dependencies. Deploy on GPUs

Special Function Unit

Something seem wrong?
Or want to contribute?

Click this button to
let us know on GitHub.

Warp Scheduler ?