Refactor interactive scenario to not be a benchmark
[6.0 post-mortem] Follow-up of #2191
We are having many more interactive scenarios in the suite, and each will add a new "benchmark" to the loadgen mlperf.conf as in `gpt-oss-120b-interactive` instead of an optional scenarios.
E.g.: https://github.com/mlcommons/inference/blob/7651400aadb765f2183047203aaa1381f4a0f9d5/loadgen/mlperf.conf#L143
This is inconsistent with the submission checker, where the interactive is treated as a scenario. We should unify the logic
cc: @v-shobhit @pgmpablo157321
0 条评论