std1.0.0-beta-7 SafeC docs

std :: ml::device

Struct std::DeviceStats

#include <std/ml/device.h> source

struct DeviceStats {
    unsigned long launches;
    unsigned long gemms;
    unsigned long uploads;
    unsigned long downloads;
    unsigned long uploadBytes;
    unsigned long downloadBytes;
    unsigned long cpuLaunches;
}

Counters since the program started (or the last device_stats_reset): what moved between host and device, and how many kernels and GEMMs ran. A training step that keeps everything on the device shows no downloads besides the loss it reads, and no uploads besides its batch. cpuLaunches counts the kernels and GEMMs a backend ran on the CPU (device_ref.sc) for want of a GPU version: 0 when the GPU ran them all.

Fields

§unsigned long launchessource
§unsigned long gemmssource
§unsigned long uploadssource
§unsigned long downloadssource
§unsigned long uploadBytessource
§unsigned long downloadBytessource
§unsigned long cpuLaunchessource