The performance tests are still flapping
bug
### Describe the bug
https://github.com/aio-libs/aiohttp/pull/12551/checks?check_run_id=76275612180
```
<h2 class="f3" style="box-sizing: border-box; margin-top: 0px !important; margin-bottom: 16px; font-size: 1.5em; font-weight: 600; line-height: 1.25; border-bottom: 1px solid rgba(61, 68, 77, 0.7); padding-bottom: 0.3em; color: rgb(240, 246, 252); font-family: "Mona Sans VF", -apple-system, "system-ui", "Segoe UI", "Noto Sans", Helvetica, Arial, sans-serif, "Apple Color Emoji", "Segoe UI Emoji"; font-style: normal; font-variant-ligatures: normal; font-variant-caps: normal; letter-spacing: normal; orphans: 2; text-align: start; text-indent: 0px; text-transform: none; widows: 2; word-spacing: 0px; -webkit-text-stroke-width: 0px; white-space: normal; background-color: rgb(13, 17, 23); text-decoration-thickness: initial; text-decoration-style: initial; text-decoration-color: initial;">Performance Regression: -22.06%</h2><div class="ml-0" style="box-sizing: border-box; margin-left: 0px !important; margin-bottom: 0px !important; color: rgb(240, 246, 252); font-family: "Mona Sans VF", -apple-system, "system-ui", "Segoe UI", "Noto Sans", Helvetica, Arial, sans-serif, "Apple Color Emoji", "Segoe UI Emoji"; font-size: 14px; font-style: normal; font-variant-ligatures: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; orphans: 2; text-align: start; text-indent: 0px; text-transform: none; widows: 2; word-spacing: 0px; -webkit-text-stroke-width: 0px; white-space: normal; background-color: rgb(13, 17, 23); text-decoration-thickness: initial; text-decoration-style: initial; text-decoration-color: initial;"><p dir="auto" style="box-sizing: border-box; margin-top: 0px; margin-bottom: 16px;"><code class="notranslate rgh-seen--12550978944" style="box-sizing: border-box; font-family: "Monaspace Neon", ui-monospace, SFMono-Regular, "SF Mono", Menlo, Consolas, "Liberation Mono", monospace; font-size: 11.9px; tab-size: 4; white-space: break-spaces; background-color: rgba(101, 108, 118, 0.2); border-radius: 6px; margin: 0px; padding: 0.2em 0.4em;">❌<span data-rgh-whitespace="space" style="box-sizing: border-box; background-position: 0px center; background-repeat: repeat-x; background-clip: border-box; line-height: 1em; background-image: url("data:image/svg+xml,%3Csvg preserveAspectRatio=\"xMinYMid meet\" viewBox=\"0 0 12 24\" xmlns=\"http://www.w3.org/2000/svg\"%3E%3Cpath d=\"M4.5 11C4.5 10.1716 5.17157 9.5 6 9.5C6.82843 9.5 7.5 10.1716 7.5 11C7.5 11.8284 6.82843 12.5 6 12.5C5.17157 12.5 4.5 11.8284 4.5 11Z\" fill=\"rgba(128, 128, 128, 50%25)\"/%3E%3C/svg%3E"); background-size: 1ch 1.25em;"> </span>1</code><span> </span>regressed benchmark<br style="box-sizing: border-box;"><code class="notranslate rgh-seen--12550978944" style="box-sizing: border-box; font-family: "Monaspace Neon", ui-monospace, SFMono-Regular, "SF Mono", Menlo, Consolas, "Liberation Mono", monospace; font-size: 11.9px; tab-size: 4; white-space: break-spaces; background-color: rgba(101, 108, 118, 0.2); border-radius: 6px; margin: 0px; padding: 0.2em 0.4em;">✅<span data-rgh-whitespace="space" style="box-sizing: border-box; background-position: 0px center; background-repeat: repeat-x; background-clip: border-box; line-height: 1em; background-image: url("data:image/svg+xml,%3Csvg preserveAspectRatio=\"xMinYMid meet\" viewBox=\"0 0 12 24\" xmlns=\"http://www.w3.org/2000/svg\"%3E%3Cpath d=\"M4.5 11C4.5 10.1716 5.17157 9.5 6 9.5C6.82843 9.5 7.5 10.1716 7.5 11C7.5 11.8284 6.82843 12.5 6 12.5C5.17157 12.5 4.5 11.8284 4.5 11Z\" fill=\"rgba(128, 128, 128, 50%25)\"/%3E%3C/svg%3E"); background-size: 1ch 1.25em;"> </span>71</code><span> </span>untouched benchmarks<br style="box-sizing: border-box;"><code class="notranslate rgh-seen--12550978944" style="box-sizing: border-box; font-family: "Monaspace Neon", ui-monospace, SFMono-Regular, "SF Mono", Menlo, Consolas, "Liberation Mono", monospace; font-size: 11.9px; tab-size: 4; white-space: break-spaces; background-color: rgba(101, 108, 118, 0.2); border-radius: 6px; margin: 0px; padding: 0.2em 0.4em;">⏩<span data-rgh-whitespace="space" style="box-sizing: border-box; background-position: 0px center; background-repeat: repeat-x; background-clip: border-box; line-height: 1em; background-image: url("data:image/svg+xml,%3Csvg preserveAspectRatio=\"xMinYMid meet\" viewBox=\"0 0 12 24\" xmlns=\"http://www.w3.org/2000/svg\"%3E%3Cpath d=\"M4.5 11C4.5 10.1716 5.17157 9.5 6 9.5C6.82843 9.5 7.5 10.1716 7.5 11C7.5 11.8284 6.82843 12.5 6 12.5C5.17157 12.5 4.5 11.8284 4.5 11Z\" fill=\"rgba(128, 128, 128, 50%25)\"/%3E%3C/svg%3E"); background-size: 1ch 1.25em;"> </span>69</code><span> </span>skipped benchmarks<sup style="box-sizing: border-box; vertical-align: baseline; font-size: 10.5px; line-height: 0; position: relative; top: -0.5em;"><a href="https://github.com/aio-libs/aiohttp/pull/12551/checks?check_run_id=76275612180#user-content-fn-skipped-9569d8768e3bb22f1320f2c12e380481" id="user-content-fnref-skipped-9569d8768e3bb22f1320f2c12e380481" data-footnote-ref="" aria-describedby="footnote-label" style="box-sizing: border-box; background-color: rgba(0, 0, 0, 0); color: rgb(68, 147, 248); text-decoration: underline; text-underline-offset: 0.2rem;">1</a></sup></p><div class="markdown-alert markdown-alert-warning" dir="auto" style="box-sizing: border-box; padding: 8px 16px; margin-bottom: 16px; color: inherit; border-left: 3.5px solid rgb(158, 106, 3);"><p class="markdown-alert-title" dir="auto" style="box-sizing: border-box; margin-top: 0px; margin-bottom: 16px; font-weight: 500; align-items: center; line-height: 1; display: flex; color: rgb(210, 153, 34);"><svg data-component="Octicon" class="octicon octicon-alert mr-2" viewBox="0 0 16 16" version="1.1" width="16" height="16" aria-hidden="true"><path d="M6.457 1.047c.659-1.234 2.427-1.234 3.086 0l6.082 11.378A1.75 1.75 0 0 1 14.082 15H1.918a1.75 1.75 0 0 1-1.543-2.575Zm1.763.707a.25.25 0 0 0-.44 0L1.698 13.132a.25.25 0 0 0 .22.368h12.164a.25.25 0 0 0 .22-.368Zm.53 3.996v2.5a.75.75 0 0 1-1.5 0v-2.5a.75.75 0 0 1 1.5 0ZM9 11a1 1 0 1 1-2 0 1 1 0 0 1 2 0Z"></path></svg>Warning</p><p dir="auto" style="box-sizing: border-box; margin-top: 0px; margin-bottom: 0px;">Please fix the performance issues or<span> </span><a href="https://codspeed.io/aio-libs/aiohttp/branches/threat-model2?utm_source=github&utm_medium=check&utm_content=acknowledge" rel="nofollow" style="box-sizing: border-box; background-color: rgba(0, 0, 0, 0); color: rgb(68, 147, 248); text-decoration: underline; text-underline-offset: 0.2rem;">acknowledge them on CodSpeed</a>.</p></div><h3 dir="auto" style="box-sizing: border-box; margin-top: 24px; margin-bottom: 16px; font-size: 1.25em; font-weight: 600; line-height: 1.25;">Performance Changes</h3><markdown-accessiblity-table data-catalyst="" style="box-sizing: border-box; display: block;">
| Benchmark | BASE | HEAD | Efficiency
-- | -- | -- | -- | --
❌ | test_ten_streamed_responses_iter_chunks | 119.8 ms | 153.7 ms | -22.06%
</markdown-accessiblity-table><div class="markdown-alert markdown-alert-tip" dir="auto" style="box-sizing: border-box; padding: 8px 16px; margin-bottom: 16px; color: inherit; border-left: 3.5px solid rgb(35, 134, 54);"><p class="markdown-alert-title" dir="auto" style="box-sizing: border-box; margin-top: 0px; margin-bottom: 16px; font-weight: 500; align-items: center; line-height: 1; display: flex; color: rgb(63, 185, 80);"><svg data-component="Octicon" class="octicon octicon-light-bulb mr-2" viewBox="0 0 16 16" version="1.1" width="16" height="16" aria-hidden="true"><path d="M8 1.5c-2.363 0-4 1.69-4 3.75 0 .984.424 1.625.984 2.304l.214.253c.223.264.47.556.673.848.284.411.537.896.621 1.49a.75.75 0 0 1-1.484.211c-.04-.282-.163-.547-.37-.847a8.456 8.456 0 0 0-.542-.68c-.084-.1-.173-.205-.268-.32C3.201 7.75 2.5 6.766 2.5 5.25 2.5 2.31 4.863 0 8 0s5.5 2.31 5.5 5.25c0 1.516-.701 2.5-1.328 3.259-.095.115-.184.22-.268.319-.207.245-.383.453-.541.681-.208.3-.33.565-.37.847a.751.751 0 0 1-1.485-.212c.084-.593.337-1.078.621-1.489.203-.292.45-.584.673-.848.075-.088.147-.173.213-.253.561-.679.985-1.32.985-2.304 0-2.06-1.637-3.75-4-3.75ZM5.75 12h4.5a.75.75 0 0 1 0 1.5h-4.5a.75.75 0 0 1 0-1.5ZM6 15.25a.75.75 0 0 1 .75-.75h2.5a.75.75 0 0 1 0 1.5h-2.5a.75.75 0 0 1-.75-.75Z"></path></svg>Tip</p><p dir="auto" style="box-sizing: border-box; margin-top: 0px; margin-bottom: 0px;">Investigate this regression by commenting<span> </span><code class="notranslate rgh-seen--12550978944" style="box-sizing: border-box; font-family: "Monaspace Neon", ui-monospace, SFMono-Regular, "SF Mono", Menlo, Consolas, "Liberation Mono", monospace; font-size: 11.9px; tab-size: 4; white-space: break-spaces; background-color: rgba(101, 108, 118, 0.2); border-radius: 6px; margin: 0px; padding: 0.2em 0.4em;">@codspeedbot<span data-rgh-whitespace="space" style="box-sizing: border-box; background-position: 0px center; background-repeat: repeat-x; background-clip: border-box; line-height: 1em; background-image: url("data:image/svg+xml,%3Csvg preserveAspectRatio=\"xMinYMid meet\" viewBox=\"0 0 12 24\" xmlns=\"http://www.w3.org/2000/svg\"%3E%3Cpath d=\"M4.5 11C4.5 10.1716 5.17157 9.5 6 9.5C6.82843 9.5 7.5 10.1716 7.5 11C7.5 11.8284 6.82843 12.5 6 12.5C5.17157 12.5 4.5 11.8284 4.5 11Z\" fill=\"rgba(128, 128, 128, 50%25)\"/%3E%3C/svg%3E"); background-size: 1ch 1.25em;"> </span>fix<span data-rgh-whitespace="space" style="box-sizing: border-box; background-position: 0px center; background-repeat: repeat-x; background-clip: border-box; line-height: 1em; background-image: url("data:image/svg+xml,%3Csvg preserveAspectRatio=\"xMinYMid meet\" viewBox=\"0 0 12 24\" xmlns=\"http://www.w3.org/2000/svg\"%3E%3Cpath d=\"M4.5 11C4.5 10.1716 5.17157 9.5 6 9.5C6.82843 9.5 7.5 10.1716 7.5 11C7.5 11.8284 6.82843 12.5 6 12.5C5.17157 12.5 4.5 11.8284 4.5 11Z\" fill=\"rgba(128, 128, 128, 50%25)\"/%3E%3C/svg%3E"); background-size: 1ch 1.25em;"> </span>this<span data-rgh-whitespace="space" style="box-sizing: border-box; background-position: 0px center; background-repeat: repeat-x; background-clip: border-box; line-height: 1em; background-image: url("data:image/svg+xml,%3Csvg preserveAspectRatio=\"xMinYMid meet\" viewBox=\"0 0 12 24\" xmlns=\"http://www.w3.org/2000/svg\"%3E%3Cpath d=\"M4.5 11C4.5 10.1716 5.17157 9.5 6 9.5C6.82843 9.5 7.5 10.1716 7.5 11C7.5 11.8284 6.82843 12.5 6 12.5C5.17157 12.5 4.5 11.8284 4.5 11Z\" fill=\"rgba(128, 128, 128, 50%25)\"/%3E%3C/svg%3E"); background-size: 1ch 1.25em;"> </span>regression</code><span> </span>on this PR, or directly use the<span> </span><a href="https://docs.codspeed.io/ai/mcp?utm_source=github&utm_medium=check&utm_content=mcp_tip_regression" rel="nofollow" style="box-sizing: border-box; background-color: rgba(0, 0, 0, 0); color: rgb(68, 147, 248); text-decoration: underline; text-underline-offset: 0.2rem;">CodSpeed MCP</a><span> </span>with your agent.</p></div></div><br class="Apple-interchange-newline">Performance Regression: -22.06%
❌ 1 regressed benchmark
✅ 71 untouched benchmarks
⏩ 69 skipped benchmarks[1](https://github.com/aio-libs/aiohttp/pull/12551/checks?check_run_id=76275612180#user-content-fn-skipped-9569d8768e3bb22f1320f2c12e380481)
Warning
Please fix the performance issues or [acknowledge them on CodSpeed](https://codspeed.io/aio-libs/aiohttp/branches/threat-model2?utm_source=github&utm_medium=check&utm_content=acknowledge).
Performance Changes
Benchmark BASE HEAD Efficiency
❌ [test_ten_streamed_responses_iter_chunks](https://codspeed.io/aio-libs/aiohttp/branches/threat-model2?uri=tests%2Ftest_benchmarks_client.py%3A%3Atest_ten_streamed_responses_iter_chunks&runnerMode=Simulation&utm_source=github&utm_medium=check&utm_content=benchmark) 119.8 ms 153.7 ms -22.06%
Tip
Investigate this regression by commenting @codspeedbot fix this regression on this PR, or directly use the [CodSpeed MCP](https://docs.codspeed.io/ai/mcp?utm_source=github&utm_medium=check&utm_content=mcp_tip_regression) with your agent.
```
### To Reproduce
n/a
### Expected behavior
n/a
### Logs/tracebacks
```python-traceback
n/a
```
### Python Version
```console
$ python --version
```
### aiohttp Version
```console
$ python -m pip show aiohttp
```
### multidict Version
```console
$ python -m pip show multidict
```
### propcache Version
```console
$ python -m pip show propcache
```
### yarl Version
```console
$ python -m pip show yarl
```
### OS
n/a
### Related component
Client
### Additional context
_No response_
### Code of Conduct
- [x] I agree to follow the aio-libs Code of Conduct
1 条评论