std :: ml::gpu_cuda
Function std::cuda_set_tf32
int cuda_set_tf32(int on)TF32 tensor cores for every later cuda_gemm / cuda_gemm_relu (sm_80 and newer): inputs are rounded to a 10-bit mantissa, accumulation stays fp32. Several times the matmul throughput, ~1e-3 relative error. Off by default. Returns 1 if the setting was applied.