Module ml::cuda_ffi
Internal: included by the CUDA backend sources (gpu_cuda.sc, gpu_cuda_attention.sc, gpu_cudnn.sc, device_cuda.sc, dsp/fft_cuda.sc), not a public header. The CUDA driver API, NVRTC and cuBLAS / cuBLASLt declarations they share, and the opaque handle types of those libraries and cuDNN for their 'extern' declarations: each C handle (CUcontext, CUevent, cublasHandle_t, ...) is a pointer to its own marker struct here, so one kind of handle can't be passed where another is expected. None is ever constructed or read; only the libraries they come from look behind them.
Functions
| cublasGemmEx | alpha / beta: float (computeType CUBLAS_COMPUTE_32F*) |
| cublasLtMatmulDescSetAttribute | buf: the attribute's value, 'size' bytes |
| cublasLtMatmulAlgoGetHeuristic | results: 'requested' cublasLtMatmulHeuristicResult_t (LT_RESULT_WORDS words each) |
| cublasLtMatmul | algo: a heuristic result's leading cublasLtMatmulAlgo_t |