Inside a CUDA kernel launch: the hidden CPU and GPU steps that make it work
Running a CUDA kernel triggers an intricate chain: driver calls, PTX compilation, command submission, grid scheduling, and warp execution. This walkthrough dissects each step on an RTX 4090, exposing the hidden CPU instructions and hardware registers that make a simple vector add work. Understanding the pipeline helps debug performance and avoid costly launch errors.