ITADN

Refactor interactive scenario to not be a benchmark

#2442Opennvzhihanj 创建于 2026-01-14
N
nvzhihanjcommented
[6.0 post-mortem] Follow-up of #2191 We are having many more interactive scenarios in the suite, and each will add a new "benchmark" to the loadgen mlperf.conf as in `gpt-oss-120b-interactive` instead of an optional scenarios. E.g.: https://github.com/mlcommons/inference/blob/7651400aadb765f2183047203aaa1381f4a0f9d5/loadgen/mlperf.conf#L143 This is inconsistent with the submission checker, where the interactive is treated as a scenario. We should unify the logic cc: @v-shobhit @pgmpablo157321
0 条评论