ITADN

refactor causal attention masking to support block masks

#31Pull Requestbghira 创建于 2025-09-14
B
bghiracommented
this change takes the causal masking work from yesterday and generalises it toward block sparse attention, aka FlexAttention, by making the causal or custom mask merely one of the supported sparsity patterns.
合并状态:未合并 关闭于 2025-09-14 1 条评论