- https://github.com/microsoft/onnxruntime-genai/pull/1988 - https://github.com/microsoft/onnxruntime-genai/pull/1984

## What's Changed * Cherry pick guidance fix into 0.11.1 release by @kunal-vaishnavi in https://github.com/microsoft/onnxruntime-genai/pull/1872 * Set version as 0.11.1 by @kunal-vaishnavi in https://github.com/microsoft/onnxruntime-genai/pull/1873 * Fix regex by @apsonawane in https://github.com/microsoft/onnxruntime-genai/pull/1876 **Full Changelog**: https://github.com/microsoft/onnxruntime-genai/compare/v0.11.0...v0.11.1

## What's Changed * ADO - Update WinML build pipeline by @chrisdMSFT in https://github.com/microsoft/onnxruntime-genai/pull/1768 * Fix CMakeLists.txt auto-detection of library directory by @anujj in https://github.com/microsoft/onnxruntime-genai/pull/1774 * Fix new/delete override and Enable cuda kernel test in Windows by @tianleiwu in https://github.com/microsoft/onnxruntime-genai/pull/1772 * Use abbreviation for TensorRT RTX EP by @kunal-vaishnavi in https://github.com/microsoft/onnxruntime-genai/pull/1763 * Add trust remote code option to model builder by @kunal-vaishnavi in https://github.com/microsoft/onnxruntime-genai/pull/1766 * Support block-wise quant in qmoe op by @apsonawane in https://github.com/microsoft/onnxruntime-genai/pull/1746 * Change the status for TRT-RTX EP by @gaugarg-nv in https://github.com/microsoft/onnxruntime-genai/pull/1780 * Cherry-Pick changes from rel 0.10.0 back to main. by @chrisdMSFT in https://github.com/microsoft/onnxruntime-genai/pull/1782 * Fix /CETCOMPAT Usage for Cross-Compiling by @sayanshaw24 in https://github.com/microsoft/onnxruntime-genai/pull/1779 * Provide distributed version of improved TopK kernel by @hariharans29 in https://github.com/microsoft/onnxruntime-genai/pull/1710 * [TRT-RTX] Disable KV cache re-computation for Phi models by @gaugarg-nv in https://github.com/microsoft/onnxruntime-genai/pull/1787 * [CUDA] Add high-performance Top-K kernels and online benchmarking by @tianleiwu in https://github.com/microsoft/onnxruntime-genai/pull/1748 * Change shared indices array type from float to int by @hariharans29 in https://github.com/microsoft/onnxruntime-genai/pull/1789 * Enable bfloat16 multi-modal models by @kunal-vaishnavi in https://github.com/microsoft/onnxruntime-genai/pull/1786 * Disable lmhead while prompt processing by @qti-ashimaj in https://github.com/microsoft/onnxruntime-genai/pull/1762 * Introduce support for dynamic batching by @baijumeswani in https://github.com/microsoft/onnxruntime-genai/pull/1662 * Generate pyd type info by @chemwolf6922 in https://github.com/microsoft/onnxruntime-genai/pull/1742 * Add trt-rtx c packages in c example by @anujj in https://github.com/microsoft/onnxruntime-genai/pull/1794 * [CUDA] Fix build with CUDA >= 12.9 by @tianleiwu in https://github.com/microsoft/onnxruntime-genai/pull/1802 * [CUDA] topk kernels v2 by @tianleiwu in https://github.com/microsoft/onnxruntime-genai/pull/1798 * Add prefill Chunking Support for NvTensorRtRtx and Cuda Providers by @anujj in https://github.com/microsoft/onnxruntime-genai/pull/1765 * Add TRT-RTX EP support, keep NvTensorRtRtx as user facing name, and force QDQ by @anujj in https://github.com/microsoft/onnxruntime-genai/pull/1791 * [CUDA] Add static assert to suppress windows build warnings by @tianleiwu in https://github.com/microsoft/onnxruntime-genai/pull/1804 * Revert "Generate pyd type info" by @baijumeswani in https://github.com/microsoft/onnxruntime-genai/pull/1805 * [QNN] Support continuous decoding by @baijumeswani in https://github.com/microsoft/onnxruntime-genai/pull/1808 * ADO Pipeline - nuget_winml_package_reference_version is configured at build time. by @chrisdMSFT in https://github.com/microsoft/onnxruntime-genai/pull/1811 * Update version to 0.11.0-dev by @baijumeswani in https://github.com/microsoft/onnxruntime-genai/pull/1815 * Add Support For Tokenizer Options by @sayanshaw24 in https://github.com/microsoft/onnxruntime-genai/pull/1785 * Fix exit call in README example by @justinchuby in https://github.com/microsoft/onnxruntime-genai/pull/1823 * Add tokenizer APIs for accessing important ids by @kunal-vaishnavi in https://github.com/microsoft/onnxruntime-genai/pull/1822 * Use correct classes for config-only usage in model builder by @kunal-vaishnavi in https://github.com/microsoft/onnxruntime-genai/pull/1828 * Fix packaging pipeline by @baijumeswani in https://github.com/microsoft/onnxruntime-genai/pull/1829 * Add missing tokenizer methods in java by @baijumeswani in https://github.com/microsoft/onnxruntime-genai/pull/1833 * Add run options to ONNX Runtime GenAI by @kunal-vaishnavi in https://github.com/microsoft/onnxruntime-genai/pull/1795 * Avoid Processing EOS Token During Continuous Decoding by @baijumeswani in https://github.com/microsoft/onnxruntime-genai/pull/1814 * Fix nuget packaging pipeline for dev builds by @baijumeswani in https://github.com/microsoft/onnxruntime-genai/pull/1837 * Add tool normalization for tool calling by @kunal-vaishnavi in https://github.com/microsoft/onnxruntime-genai/pull/1838 * Refactor past_present_share_buffer logic into reusable function by @anujj in https://github.com/microsoft/onnxruntime-genai/pull/1839 * Fix nuget packaging pipeline by @baijumeswani in https://github.com/microsoft/onnxruntime-genai/pull/1841 * Add enable_webgpu_graph in extra_options by @qjia7 in https://github.com/microsoft/onnxruntime-genai/pull/1788 * Update tool normalization in ORT GenAI by @kunal-vaishnavi in https://github.com/microsoft/onnxruntime-genai/pull/1842 * Support RotaryEmbedding in GQA for webgpu ep by @xiaofeihan1 in https://github.com/microsoft/onnxruntime-genai/pull/1847 * Enable guidance ff tokens for faster inference by @JC1DA in https://github.com/microsoft/onnxruntime-genai/pull/1803 * Support pre-registered plug-in cuda execution provider library by @baijumeswani in https://github.com/microsoft/onnxruntime-genai/pull/1850 * ADO: Update pipeline to publish onnxruntime-genai. for relwithdebinfo builds. by @chrisdMSFT in https://github.com/microsoft/onnxruntime-genai/pull/1855 * Layer-wise KV Cache Allocation for Models with Alternating Attention Patterns by @anujj in https://github.com/microsoft/onnxruntime-genai/pull/1832 * Mpasumarthi/nvtrt test suite by @mpasumarthi-git in https://github.com/microsoft/onnxruntime-genai/pull/1756 * bugfix: fix a memory issue in Whisper by @fs-eire in https://github.com/microsoft/onnxruntime-genai/pull/1859 * Add disable cuda graph when num_beams > 1 and fix set_provider_option bug by @anujj in https://github.com/microsoft/onnxruntime-genai/pull/1846 * Mixed precision export support for gptq quantized model by @rM-planet in https://github.com/microsoft/onnxruntime-genai/pull/1853 * Enable If Node Support for TRT-RTX in Phi-3.5/Phi-4 LongRoPE Models by @anujj in https://github.com/microsoft/onnxruntime-genai/pull/1851 * Fix handling EOS token id detection by @kunal-vaishnavi in https://github.com/microsoft/onnxruntime-genai/pull/1849 * Ensure Consistent Tool Calling JSON Serialization and Deserialization by @sayanshaw24 in https://github.com/microsoft/onnxruntime-genai/pull/1863 * Add C# binding for GetNextTokens by @kunal-vaishnavi in https://github.com/microsoft/onnxruntime-genai/pull/1865 * Set version as 0.11.0 by @kunal-vaishnavi in https://github.com/microsoft/onnxruntime-genai/pull/1866 ## New Contributors * @hariharans29 made their first contribution in https://github.com/microsoft/onnxruntime-genai/pull/1710 * @qti-ashimaj made their first contribution in https://github.com/microsoft/onnxruntime-genai/pull/1762 * @chemwolf6922 made their first contribution in https://github.com/microsoft/onnxruntime-genai/pull/1742 * @qjia7 made their first contribution in https://github.com/microsoft/onnxruntime-genai/pull/1788 * @xiaofeihan1 made their first contribution in https://github.com/microsoft/onnxruntime-genai/pull/1847 * @JC1DA made their first contribution in https://github.com/microsoft/onnxruntime-genai/pull/1803 * @mpasumarthi-git made their first contribution in https://github.com/microsoft/onnxruntime-genai/pull/1756 * @rM-planet made their first contribution in https://github.com/microsoft/onnxruntime-genai/pull/1853 **Full Changelog**: https://github.com/microsoft/onnxruntime-genai/compare/v0.10.0...v0.11.0

🚀 Features Support for Continuous Batching (#1580) by @baijumeswani RegisterExecutionProviderLibrary (#1628) by @vortex-captain Enable CUDA graph for LLMs for NvTensorRtRtx EP (#1645) by @anujj Add support for smollm3 (#1666) by @xenova Add OpenAI's gpt-oss to ONNX Runtime GenAI (#1678) by @kunal-vaishnavi Add custom ops library path resolution using EP metadata (#1707) by @psakhamoori Use OnnxRuntime API wrapper for EP device operations (#1719) by @psakhamoori 🛠 Improvements Update Extensions Commit to Support Strft Custom Function for Chat Template (#1670) by @sayanshaw24 Add parameters to chat template in chat example (#1673) by @kunal-vaishnavi Update how Hugging Face's config files are processed (#1693) by @kunal-vaishnavi Tie embedding weight sharing (#1690) by @jiafatom Improve top-k sampling CUDA kernel (#1708) by @gaugarg-nv 🐛 Bug Fixes Fix accessing final norm for Gemma-3 models (#1687) by @kunal-vaishnavi Fix runtime bugs with multi-modal models (#1701) by @kunal-vaishnavi Fix BF16 CUDA version of OpenAI's gpt-oss (#1706) by @kunal-vaishnavi Fix benchmark_e2e (#1702) by @jiafatom Fix benchmark_multimodal (#1714) by @jiafatom Fix pad vs. eos token misidentification (#1694) by @aciddelgado ⚡ Performance & EP Enhancements NvTensorRtRtx: Support num_beam > 1 (#1688) by @anujj NvTensorRtRtx: Skip if node of Phi4 models (#1696) by @anujj Remove QDQ and Opset Coupling for TRT RTX EP (#1692) by @xiaoyu-work 🔒 Build & CI Enable Security Protocols in MSVC for BinSkim (#1672) by @sayanshaw24 Explicitly specify setup-java architecture in win-cpu-arm64-build.yml (#1685) by @edgchen1 Use dotnet instead of nuget in mac build (#1717) by @natke 📦 Versioning & Release Update version to 0.10.0 (#1676) by @ajindal1 Cherrypick 0: Forgot to change versions (#1721) by @aciddelgado Cherrypick 1... Becomes RC1 (#1726) by @aciddelgado Cherrypick 2 (#1743) by @aciddelgado 🙌 New Contributors @xiaoyu-work (#1692) @psakhamoori (#1707) ✅ Full Changelog: v0.9.0...v0.9.1

## What's changed ### New features * Use Accuracy level 4 for webgpu by default by [@guschmue](https://github.com/guschmue) ([#1474](https://github.com/microsoft/onnxruntime-genai/pull/1474)) * Enable guidance by default on macos by [@ajindal1](https://github.com/ajindal1) ([#1514](https://github.com/microsoft/onnxruntime-genai/pull/1514)) ### Bug fixes * Remove position_id and fix context phase KV shapes for in-place cache buffer support by [@anujj](https://github.com/anujj) ([#1505](https://github.com/microsoft/onnxruntime-genai/pull/1505)) * Update Extensions Commit for 0.8.2 by [@sayanshaw24](https://github.com/sayanshaw24) ([#1519](https://github.com/microsoft/onnxruntime-genai/pull/1519)) * Update Extensions Commit for another DeepSeek Fix by [@sayanshaw24](https://github.com/sayanshaw24) ([#1521](https://github.com/microsoft/onnxruntime-genai/pull/1521)) ### Packaging and testing * Update triggers by [@snnn](https://github.com/snnn) ([#1490](https://github.com/microsoft/onnxruntime-genai/pull/1490)) **Full Changelog**: https://github.com/microsoft/onnxruntime-genai/compare/v0.8.1...v0.8.2

## What's Changed * Introduced support for chat templates * Support for NVTensorRtRtx EP * Move to stable Microsoft.Extensions.AI.Abstractions release

## Release Notes - Add AMD Quark Quantizer Support #1207 - Added Gemma 3 to model builder #1359 - Updated Phi-3 Python Q&A example to be consistent with C++ example #1392 - Updated Microsoft.Extensions.AI.Abstractions to 9.4.0-preview.1.25207.5 #1388 - Added OnnxRuntimeGenAIChatClient constructor with Config #1364 - Improve and Fix TopKTopP #1363 - Switch the order of softmax on CPU Top K #1354 - Updated custom nuget packaging logic #1377 - Updated pybind and fix rpath for macos and check for nullptr #1367 - Convert tokens to list for concat to accommodate breaking API change in tokenizer #1358