std :: ml::nn
#include <std/ml/nn.h> source
#include <std/ml/nn.h>
#define OPT_LION 7
sign of the interpolated momentum (Chen et al. 2023); 'beta1' 0.9, 'beta2' 0.99, decoupled 'weightDecay'; use ~3-10x smaller lr than Adam