std1.0.0-beta-7 SafeC docs

Module ml::cuda_ffi

#include <std/ml/cuda_ffi.h> source

Internal: included by the CUDA backend sources (gpu_cuda.sc, gpu_cuda_attention.sc, gpu_cudnn.sc, device_cuda.sc, dsp/fft_cuda.sc), not a public header. The CUDA driver API, NVRTC and cuBLAS / cuBLASLt declarations they share, and the opaque handle types of those libraries and cuDNN for their 'extern' declarations: each C handle (CUcontext, CUevent, cublasHandle_t, ...) is a pointer to its own marker struct here, so one kind of handle can't be passed where another is expected. None is ever constructed or read; only the libraries they come from look behind them.

Functions

cublasGemmExalpha / beta: float (computeType CUBLAS_COMPUTE_32F*)
cublasLtMatmulDescSetAttributebuf: the attribute's value, 'size' bytes
cublasLtMatmulAlgoGetHeuristicresults: 'requested' cublasLtMatmulHeuristicResult_t (LT_RESULT_WORDS words each)
cublasLtMatmulalgo: a heuristic result's leading cublasLtMatmulAlgo_t