std1.0.0-beta-7 SafeC docs

std :: ml::attention

Function std::attention_set_fused

#include <std/ml/attention.h> source · definition

int attention_set_fused(int on)

Whether the multi-head ops on a GPU run as the fused kernels (1, the default) or as composed device ops (0: transpose, matmul, masked softmax per head -- for comparison and testing). Head dims over 128 always compose. Returns the previous setting.