← Walkthroughsrc/speech_decoding/models/v14_converged_v3/objective.py
Selected training excerpt · lines 604–610 · source SHA-256 5718458b537d
604 pred = self._mae_pred(h, grid) # (B, total, F_MAX); pad slot = 0605 target = target.to(pred.dtype)606 w = in_loss.to(pred.dtype) # (B, total) masked weight607 fv = feat_valid[None].to(pred.dtype) # (1, total, F_MAX)608 # per-token MSE over that token's own valid bins (pad excluded), then masked-mean.609 se_tok = (((pred - target) ** 2) * fv).sum(-1) / feat_count[None].to(pred.dtype)610 mae_loss = (se_tok * w).sum() / w.sum().clamp(min=1.0)