std1.0.0-beta-7 SafeC docs

std :: ml::gpu_mps

Function std::mps_flash_attn_bf16_chained

#include <std/ml/gpu_mps.h> source · definition

int mps_flash_attn_bf16_chained(
    struct MpsBuf bufQ,
    struct MpsBuf bufK,
    struct MpsBuf bufV,
    &unsigned short out,
    unsigned long seqLen,
    unsigned long kvLen,
    unsigned long numHeads,
    unsigned long numKvHeads,
    unsigned long headDim,
    float scale,
    int causal,
    int isSliding,
    unsigned long slidingWindow,
)

Chained variant: 'bufQ'/'bufK'/'bufV' are device buffers (pending or persistent), must run inside an open batch, and leaves its output as MpsBuf::batch_last_output() -- 'out' is throwaway scratch, same contract as every other chained op.