std :: ml::attention
Function std::attention_set_fused
int attention_set_fused(int on)Whether the multi-head ops on a GPU run as the fused kernels (1, the default) or as composed device ops (0: transpose, matmul, masked softmax per head -- for comparison and testing). Head dims over 128 always compose. Returns the previous setting.