GPU Glossary

TABLE OF CONTENTS

Device Hardware

CUDA (Device Architecture)

Streaming Multiprocessor

Special Function Unit

Load/Store Unit

Tensor Memory Accelerator

Streaming Multiprocessor Architecture

Texture Processing Cluster

Graphics/GPU Processing Cluster

Device Software

CUDA (Programming Model)

Streaming ASSembler

Parallel Thread eXecution

Compute Capability

Cooperative Thread Array

Thread Block Grid

Thread Hierarchy

Memory Hierarchy

CUDA (Software Platform)

CUDA C++ (programming language)

NVIDIA GPU Drivers

CUDA Driver API

NVIDIA Management Library

CUDA Runtime API

NVIDIA CUDA Compiler Driver

NVIDIA Runtime Compiler

NVIDIA CUDA Profiling Tools Interface

NVIDIA Nsight Systems

CUDA Binary Utilities

Performance Bottleneck

Arithmetic Intensity

Memory Bandwidth

Arithmetic Bandwidth

Warp Execution State

Pipe Utilization

Issue Efficiency

Streaming Multiprocessor Utilization

Warp Divergence

Branch Efficiency

Memory Coalescing

Register Pressure

/host-software/nvidia-ko

What is nvidia.ko?

nvidia.ko is a binary kernel module file at the core of the NVIDIA GPU drivers for Linux.

Like other kernel modules, it executes in privileged mode and communicates directly with hardware on behalf of the user -- in this case, the GPU.

The Linux Open GPU Kernel Module is open source .

Building on GPUs? We know a thing or two about it.

Modal is an ergonomic Python SDK wrapped around a global GPU fleet. Deploy serverless AI workloads instantly without worrying about quota requests, driver compatibility issues, or managing bulky ML dependencies. Deploy on GPUs

NVIDIA GPU Drivers

Something seem wrong?
Or want to contribute?

Click this button to
let us know on GitHub.

CUDA Driver API ?