std1.0.0-beta-7 SafeC docs

std :: ml::gpu_cuda

Function std::cuda_set_tf32

#include <std/ml/gpu_cuda.h> source ยท definition

int cuda_set_tf32(int on)

TF32 tensor cores for every later cuda_gemm / cuda_gemm_relu (sm_80 and newer): inputs are rounded to a 10-bit mantissa, accumulation stays fp32. Several times the matmul throughput, ~1e-3 relative error. Off by default. Returns 1 if the setting was applied.