src/speech_decoding/models/v14_converged_v3/towers.py

Selected training excerpt · lines 317–324 · source SHA-256 5610fc7e8fc4

317        depth_b = depth_bm.reshape(B * M)318        time_b = time_bm.reshape(B * M)319        # shared L1 rope table: build once over the flattened per-clip coords, reused by every block.320        first_l1 = next((blk for blk in self.blocks if isinstance(blk, L1Block)), None)321        rope_cs = None322        if first_l1 is not None:323            cos, sin = first_l1.rope.cos_sin(depth_b, time_b)  # (B·M, head_dim)324            rope_cs = (cos, sin)