Skip to main content

Category

NVIDIA, GPUs and AI chips: architecture, CUDA, the company and the industry from primary sources

Choosing AI infrastructure means reading a spec sheet correctly: sparse versus dense figures, compute versus memory bandwidth, theoretical peak versus measurement. This category uses NVIDIA whitepapers, SEC filings and peer-reviewed papers as primary sources to cover why GPUs are good at AI, how the company is governed and how the industry fits together. Values derived by calculation are labelled as theoretical, and vendor figures are kept apart from independent measurements.

9 articles in total

Foundational guide

Foundational guide (start here)

AI
インフラ
パフォーマンス
技術選定
コスト最適化

Why NVIDIA GPUs are so strong at AI — Tensor Cores, low precision, HBM and NVLink, read from formulas and published specs

Why NVIDIA GPUs are strong at AI, in four layers: Tensor Cores, low-precision formats (FP8/FP4), HBM and NVLink. Why the H100's 3,958 FP8 TFLOPS assumes sparsity, and why LLM decode is set by memory bandwidth, not compute — derived as theory from specs.

31 min read

Related practical articles