std1.0.0-beta-7 SafeC docs

std :: ml::gpu_cuda_attention

Function std::cuda_flash_attention_f32

#include <std/ml/gpu_cuda_attention.h> source ยท definition

int cuda_flash_attention_f32(
    const &float q,
    const &float k,
    const &float v,
    &float out,
    unsigned long heads,
    unsigned long seqLen,
    unsigned long kvLen,
    unsigned long headDim,
    float scale,
    int causal,
)

The two fp32 ops on host arrays (upload, compute, read back), with the rocm_*_f32 arguments.