ITADN

Project Request: skill-optimizer

#398Closeddamienen 创建于 2026-04-16
needs-priorityneeds-triage
D
damienencommented
## Project Request - **Project name:** skill-optimizer - **GitHub URL:** https://github.com/fastxyz/skill-optimizer - **Category:** Training > Benchmark **Description:** CLI that benchmarks SDK, CLI, and MCP guidance docs (SKILL.md) across multiple LLMs using static action + argument matching; iteratively rewrites docs until every configured model passes a score floor; CI-friendly. skill-optimizer measures whether LLMs pick the right SDK methods, CLI commands, or MCP tools from guidance docs and task prompts. It produces per-model PASS/FAIL scores and runs an iterative optimizer that rewrites your docs until all configured models meet a score threshold. Fits under Training > Benchmark alongside other evaluation frameworks. Repo: https://github.com/fastxyz/skill-optimizer
关闭于 2026-04-16 2 条评论