版本发布 3
v1.0.1
? · 2023-07-28
Added fused biases to GEMM.
v1.0.0
? · 2023-07-27
FlashAttention, dense and block-sparse. The dense version consistently outperforms MPSGraph by one order of magnitude (3-5x). In some edge cases, that grows to two orders of magnitude (20x). MPSGraph is the modern API that Apple recommends for using Metal in machine learning applications. The block-sparse version indirectly supports (and accelerates) triangular causal masks, but work distribution is sub-optimal. It is sometimes 60% faster than theoretically possible with dense, sometimes as slow as dense; performance is nondeterministic. This makes it the same as FlashAttention-2 from https://github.com/Dao-AILab/flash-attention.
v0.2.0-alpha预发布
? · 2023-07-08
Added support for fused transposes and batched GEMM.