Project Request: skill-optimizer
needs-priorityneeds-triage
## Project Request
- **Project name:** skill-optimizer
- **GitHub URL:** https://github.com/fastxyz/skill-optimizer
- **Category:** Training > Benchmark
**Description:**
CLI that benchmarks SDK, CLI, and MCP guidance docs (SKILL.md) across multiple LLMs using static action + argument matching; iteratively rewrites docs until every configured model passes a score floor; CI-friendly.
skill-optimizer measures whether LLMs pick the right SDK methods, CLI commands, or MCP tools from guidance docs and task prompts. It produces per-model PASS/FAIL scores and runs an iterative optimizer that rewrites your docs until all configured models meet a score threshold.
Fits under Training > Benchmark alongside other evaluation frameworks.
Repo: https://github.com/fastxyz/skill-optimizer
关闭于 2026-04-16 2 条评论