add: gaudi2 benchmark v2 results
MAMF results for gaudi2.
| | bf16 | fp8 |
| --: | :-- | :-- |
| MAMF | 418.7 TFLOPS @ 14336x15360x2048 | 826.5 TLOPS @ 6144x11264x5120 |
| spec | 432 TFLOPS | 865 TFLOPS |
| util | 96.9% | 95.5% |
- [full logs for bf16](https://github.com/user-attachments/files/22056639/gaudi2_bf16_mnk_0_16384_1024.txt)
- [full logs for fp8](https://github.com/user-attachments/files/22056641/gaudi2_fp8_mnk_0_16384_1024.txt)
Note that results are obtained from MNK (0, 16384, 1024) sweep, better results might exist.
Log contains some anomaly such as TFLOPS far over the spec, this appears to stem from occasional instability in the Synapse event API. However, for the MAMF figure I verified correctness by analyzing the device trace for the given workload, and it looked legitimate.
Please refer to #115 for more details.
合并状态:未合并 关闭于 2025-08-30 1 条评论