GPU Glossary

TABLE OF CONTENTS

Device Hardware

CUDA (Device Architecture)

Streaming Multiprocessor

Special Function Unit

Load/Store Unit

Tensor Memory Accelerator

Streaming Multiprocessor Architecture

Texture Processing Cluster

Graphics/GPU Processing Cluster

Device Software

CUDA (Programming Model)

Streaming ASSembler

Parallel Thread eXecution

Compute Capability

Cooperative Thread Array

Thread Block Grid

Thread Hierarchy

Memory Hierarchy

CUDA (Software Platform)

CUDA C++ (programming language)

NVIDIA GPU Drivers

CUDA Driver API

NVIDIA Management Library

CUDA Runtime API

NVIDIA CUDA Compiler Driver

NVIDIA Runtime Compiler

NVIDIA CUDA Profiling Tools Interface

NVIDIA Nsight Systems

CUDA Binary Utilities

Performance Bottleneck

Arithmetic Intensity

Memory Bandwidth

Arithmetic Bandwidth

Warp Execution State

Pipe Utilization

Issue Efficiency

Streaming Multiprocessor Utilization

Warp Divergence

Branch Efficiency

Memory Coalescing

Register Pressure

/host-software/libcudart

?

Something seem wrong?
Or want to contribute?

Click this button to
let us know on GitHub.

What is libcudart.so?

The typical name for the binary shared object file that implements the CUDA Runtime API on Linux systems. Deployed CUDA binaries often statically link this file, but libraries and frameworks built on the CUDA Toolkit, like PyTorch, typically load it dynamically.

Building on GPUs? We know a thing or two about it.

Modal is an ergonomic Python SDK wrapped around a global GPU fleet. Deploy serverless AI workloads instantly without worrying about quota requests, driver compatibility issues, or managing bulky ML dependencies. Deploy on GPUs

CUDA Runtime API NVIDIA CUDA Compiler Driver