Struct std::CudaHalfBuf

#include <std/ml/gpu_cuda.h> source

struct CudaHalfBuf {
    unsigned long dev;
    unsigned long len;
    int dtype;
}

'len' fp16 or bf16 values ('dtype') in GPU memory; dev == 0 if invalid.

Fields

§unsigned long devsource

§unsigned long lensource

§int dtypesource

§static struct CudaHalfBuf alloc(unsigned long n, int dtype)source · definition

uninitialized

§static struct CudaHalfBuf upload([]const float host, int dtype)source · definition