Skip to content

CrossEntropy

Source: loss/CrossEntropy.luau

Numerically stable mean cross-entropy. logits: [N, vocab]; targets: N token ids (1-based). Returns a scalar Tensor (shape {}), ready for backward(). Optional label smoothing.

Methods

crossEntropy(logits: any, targets: { number }, smooth: number?)