std1.0.0-beta-7 SafeC docs

std :: ml::convnet

Function std::tensor_group_norm

#include <std/ml/convnet.h> source · definition

&FloatTensor tensor_group_norm(
    const &FloatTensor x,
    const &FloatTensor gamma,
    const &FloatTensor beta,
    unsigned long channels,
    unsigned long plane,
    unsigned long groups,
    float eps,
)

Group normalization (Wu & He 2018): each image's channels split into 'groups' groups, each normalized over its channels and planes, then gamma / beta per channel. Batch-independent, the same in training and inference. groups 1 is layer norm over (C, H, W); groups == channels is instance norm.