ITADN

Build a labeled baseline dataset of interesting real pipeline failures

#16201Opendanieljurek 创建于 2026-06-26
D
danieljurekcommented
Part of the Pipeline Analysis · Azure SDK Tools Agent internship project. - **Area:** Evaluation - **Sequence:** 9 - **Estimate:** 5 implementation days - **Assignee:** @ReilleyMilne ## Depends on: - #16195 (Build a standardized artifact discovery and retrieval layer for pipeline runs) - #16196 (Add shared regression fixtures from real pipeline failures) ## Definition of done A scripted collection process identifies representative real failures, gathers the needed artifacts and metadata, and produces a curated dataset with expected diagnoses and scoring criteria, using approved stored inputs where needed for evaluation.
0 条评论