std1.0.0-beta-7 SafeC docs

std :: ml::gpu_cuda

Function std::cuda_load_module

#include <std/ml/gpu_cuda.h> source · definition

?&CudaNativeModule cuda_load_module(const &char source, const &char name)

Compiles CUDA C++ source with NVRTC for the selected GPU (-arch=sm_<cc>, -std=c++17) and loads it as a CUmodule, for libraries that bring their own kernels (gpu_cuda_attention.h). Null on failure, after printing the compile log. Look kernels up with cuModuleGetFunction and launch them on cuda_stream_handle().