## What's Changed 🚀 **Major Features**: * Add open-webui as the default chatbot by @kerthcet in https://github.com/InftyAI/llmaz/pull/357 * Add enovy ai gateway (helm dependencies + doc) by @pacoxu in https://github.com/InftyAI/llmaz/pull/360 ✨ **Features**: * feature: install lws controller in llmaz-system namespace by @googs1025 in https://github.com/InftyAI/llmaz/pull/354 ♻️ **Cleanups**: * Add default to configName by @kerthcet in https://github.com/InftyAI/llmaz/pull/349 * feat: move lws controller replicas to global values by @Whitea029 in https://github.com/InftyAI/llmaz/pull/358 * kubectl apply using `--server-side` to avoid apply failure by @pacoxu in https://github.com/InftyAI/llmaz/pull/363 ## New Contributors * @Whitea029 made their first contribution in https://github.com/InftyAI/llmaz/pull/358 **Full Changelog**: https://github.com/InftyAI/llmaz/compare/v0.1.2...v0.1.3

## What's Changed ✨ **Features**: * feat: spread container env to initContianers by @nayihz in https://github.com/InftyAI/llmaz/pull/294 * feature(BackendRuntime): support lifecycle hook fields for BackendRuntime by @googs1025 in https://github.com/InftyAI/llmaz/pull/303 * feat: add e2e test to verify service is avaliable by @nayihz in https://github.com/InftyAI/llmaz/pull/310 * feat: make elasticConfig.maxReplicas to a required parameter by @nayihz in https://github.com/InftyAI/llmaz/pull/331 * feat: metrics support for llmaz by @googs1025 in https://github.com/InftyAI/llmaz/pull/316 ♻️ **Cleanups**: * build(deps): bump github.com/google/go-cmp from 0.6.0 to 0.7.0 by @dependabot in https://github.com/InftyAI/llmaz/pull/283 * API refactor by @kerthcet in https://github.com/InftyAI/llmaz/pull/285 * Refactor multi-host example by @kerthcet in https://github.com/InftyAI/llmaz/pull/286 * cleanup: upgrade vllm version to v0.7.3 by @nayihz in https://github.com/InftyAI/llmaz/pull/289 * Enable debug mode in workflow by @kerthcet in https://github.com/InftyAI/llmaz/pull/290 * fix: fix some warnings when building images by @nayihz in https://github.com/InftyAI/llmaz/pull/295 * build(deps): bump sigs.k8s.io/structured-merge-diff/v4 from 4.5.0 to 4.6.0 by @dependabot in https://github.com/InftyAI/llmaz/pull/298 * build(deps): bump sigs.k8s.io/controller-runtime from 0.20.2 to 0.20.3 by @dependabot in https://github.com/InftyAI/llmaz/pull/299 * build(deps): bump github.com/onsi/ginkgo/v2 from 2.22.2 to 2.23.0 by @dependabot in https://github.com/InftyAI/llmaz/pull/297 * cleanup: upgrade e2e test tools by @nayihz in https://github.com/InftyAI/llmaz/pull/296 * chore: fix BackendRuntime crds field Commands -> Command by @googs1025 in https://github.com/InftyAI/llmaz/pull/315 * feature: add in-tree vllm BackendRuntime for preStop Hook by @googs1025 in https://github.com/InftyAI/llmaz/pull/319 * cleanup: remove kube-rbac-proxy by @nayihz in https://github.com/InftyAI/llmaz/pull/321 * use local GOPROXY by @pacoxu in https://github.com/InftyAI/llmaz/pull/322 * add image repo for lws and all backend runtime, like llama.cpp by @pacoxu in https://github.com/InftyAI/llmaz/pull/328 * build(deps): bump github.com/onsi/gomega from 1.36.3 to 1.37.0 by @dependabot in https://github.com/InftyAI/llmaz/pull/337 * build(deps): bump github.com/onsi/ginkgo/v2 from 2.23.3 to 2.23.4 by @dependabot in https://github.com/InftyAI/llmaz/pull/336 * build(deps): bump sigs.k8s.io/structured-merge-diff/v4 from 4.6.0 to 4.7.0 by @dependabot in https://github.com/InftyAI/llmaz/pull/338 * chore: refactor handleUnexpectedCondition func by @googs1025 in https://github.com/InftyAI/llmaz/pull/344 * fix(env): ensure BackendRuntimeConfig.Envs overrides base Envs by @googs1025 in https://github.com/InftyAI/llmaz/pull/341 ## New Contributors * @nayihz made their first contribution in https://github.com/InftyAI/llmaz/pull/289 * @pacoxu made their first contribution in https://github.com/InftyAI/llmaz/pull/322 **Full Changelog**: https://github.com/InftyAI/llmaz/compare/v0.1.1...v0.1.2

## What's Changed 🚀 **Major Features**: * Add recommendedConfigs to backendRuntime by @kerthcet in https://github.com/InftyAI/llmaz/pull/276 ✨ **Features**: * Add api reference by @kerthcet in https://github.com/InftyAI/llmaz/pull/263 * Create a clusterIP service for load balancing by @kerthcet in https://github.com/InftyAI/llmaz/pull/267 * Support shared memory size by @kerthcet in https://github.com/InftyAI/llmaz/pull/269 ♻️ **Cleanups**: * Rename request to limits in Flavor by @kerthcet in https://github.com/InftyAI/llmaz/pull/271 **Full Changelog**: https://github.com/InftyAI/llmaz/compare/v0.1.0...v0.1.1

## What's Changed 🚀 **Major Features**: * Support HPA with Playground by @kerthcet in https://github.com/InftyAI/llmaz/pull/252 ✨ **Features**: * Support multi-host inference with Playground by @kerthcet in https://github.com/InftyAI/llmaz/pull/235 * Support multi probes in backendRuntime by @kerthcet in https://github.com/InftyAI/llmaz/pull/242 * Support hostpath models by @kerthcet in https://github.com/InftyAI/llmaz/pull/247 🐛 **Bugs**: * Fix: golangci-lint slow by @kerthcet in https://github.com/InftyAI/llmaz/pull/236 ♻️ **Cleanups**: * Add inferenceConfig to Playground by @kerthcet in https://github.com/InftyAI/llmaz/pull/245 **Full Changelog**: https://github.com/InftyAI/llmaz/compare/v0.0.9...v0.1.0

## What's Changed ✨ **Features**: * Support ollama by @qinguoyi in https://github.com/InftyAI/llmaz/pull/193 * Feat: add argName to specify server arguments by @kerthcet in https://github.com/InftyAI/llmaz/pull/226 🐛 **Bugs**: * fix: helm INSTALLATION FAILED by @googs1025 in https://github.com/InftyAI/llmaz/pull/203 * Fix: model-loader will not load any files by @kerthcet in https://github.com/InftyAI/llmaz/pull/228 ♻️ **Cleanups**: * Update Features of Overview by @kerthcet in https://github.com/InftyAI/llmaz/pull/214 * Remove ElasticConfig from Service by @kerthcet in https://github.com/InftyAI/llmaz/pull/224 **Full Changelog**: https://github.com/InftyAI/llmaz/compare/v0.0.8...v0.0.9

## What's Changed 🚀 **Major Features**: * Support TGI as another backendRuntime by @kerthcet in https://github.com/InftyAI/llmaz/pull/182 ✨ **Features**: * feat:support apply llmaz to any ns by @qinguoyi in https://github.com/InftyAI/llmaz/pull/172 * feat:update model loader by @qinguoyi in https://github.com/InftyAI/llmaz/pull/178 🐛 **Bugs**: * fix:catch os error by @qinguoyi in https://github.com/InftyAI/llmaz/pull/174 * Make field Command optional by @kerthcet in https://github.com/InftyAI/llmaz/pull/181 ♻️ **Cleanups**: * Add release checklist by @kerthcet in https://github.com/InftyAI/llmaz/pull/159 * chore: bump LWS version to v0.4.0 by @googs1025 in https://github.com/InftyAI/llmaz/pull/162 * Bump sigs.k8s.io/lws from 0.4.0 to 0.4.1 by @dependabot in https://github.com/InftyAI/llmaz/pull/185 * feature(webhook): add BackendRuntimeConfig resources validation by @googs1025 in https://github.com/InftyAI/llmaz/pull/170 * fix:load models cost seconds by @qinguoyi in https://github.com/InftyAI/llmaz/pull/175 * Update Revision default to main by @kerthcet in https://github.com/InftyAI/llmaz/pull/176 * Downsize model-loader image by @qinguoyi in https://github.com/InftyAI/llmaz/pull/179 ## New Contributors * @googs1025 made their first contribution in https://github.com/InftyAI/llmaz/pull/162 * @qinguoyi made their first contribution in https://github.com/InftyAI/llmaz/pull/168 **Full Changelog**: https://github.com/InftyAI/llmaz/compare/v0.0.7...v0.0.8

## What's Changed 🚀 **Major Features**: * [1/N] Add backendRuntime CRD by @kerthcet in https://github.com/InftyAI/llmaz/pull/138 * [2/N] Add backendRuntime implementation by @kerthcet in https://github.com/InftyAI/llmaz/pull/139 * Add helm chart support by @kerthcet in https://github.com/InftyAI/llmaz/pull/142 ✨ **Features**: * Add Architecture diagram by @kerthcet in https://github.com/InftyAI/llmaz/pull/129 🐛 **Bugs**: * Fix resource limits could be small than requests by @kerthcet in https://github.com/InftyAI/llmaz/pull/136 * Fix filename error by @kerthcet in https://github.com/InftyAI/llmaz/pull/147 ♻️ **Cleanups**: * Update installation doc by @kerthcet in https://github.com/InftyAI/llmaz/pull/149 * Refactor backendRuntime by @kerthcet in https://github.com/InftyAI/llmaz/pull/157 **Full Changelog**: https://github.com/InftyAI/llmaz/compare/v0.0.6...v0.0.7

## What's Changed **Major Features 🚀**: * Add project logo by @kerthcet in https://github.com/InftyAI/llmaz/pull/112 * [1/N] Add SpeculativeDecoding support by @kerthcet in https://github.com/InftyAI/llmaz/pull/118 **Features ✨**: * Add model label to Playground by @kerthcet in https://github.com/InftyAI/llmaz/pull/111 * Add new conditions to Playground by @kerthcet in https://github.com/InftyAI/llmaz/pull/120 * Change ModelClaims API by @kerthcet in https://github.com/InftyAI/llmaz/pull/125 **Bugs 🐛**: * fix wrong field path in the openmodel webhook by @carlory in https://github.com/InftyAI/llmaz/pull/107 * Playground should be triggered to create Services and then Pods once the model is created by @carlory in https://github.com/InftyAI/llmaz/pull/109 * Fix watch for changes to LeaderWorkerSet created by llmaz and trigger a Reconcile for the owner by @carlory in https://github.com/InftyAI/llmaz/pull/108 **Cleanups 🎨**: * Add verbose log to modelLoader by @kerthcet in https://github.com/InftyAI/llmaz/pull/124 ## New Contributors * @carlory made their first contribution in https://github.com/InftyAI/llmaz/pull/107 **Full Changelog**: https://github.com/InftyAI/llmaz/compare/v0.0.5...v0.0.6