// Module included in the following assemblies:
//
// * microshift_ai/microshift-rhoai.adoc

:_mod-docs-content-type: REFERENCE
[id="microshift-rhoai-supported-models_{context}"]
= Supported {rhoai} model-serving runtimes

[role="_abstract"]
You can review the following information to learn about the {rhoai} model-serving runtimes that are verified for {microshift-short} deployments.

The following {rhoai} model-serving runtimes that are verified for {microshift-short} deployments:

* vLLM ServingRuntime for KServe
* {ovms}
+
[IMPORTANT]
====
The {ovms} does not support the IPv6 networking protocol. Check each model server before use to ensure that it supports your networking configuration.
====

The following runtimes are available for development purposes with {microshift-short}:

* Caikit Text Generation Inference Server (Caikit-TGIS) ServingRuntime for KServe
* Caikit Standalone ServingRuntime for KServe
* Text Generation Inference Server (TGIS) Standalone ServingRuntime for KServe
* vLLM ServingRuntime with Gaudi accelerators support for KServe
* vLLM ROCm ServingRuntime for KServe
* Custom runtimes that you create and test
