# SOME DESCRIPTIVE TITLE.
# Copyright (C) 2023, Xorbits Inc.
# This file is distributed under the same license as the Xinference package.
# FIRST AUTHOR <EMAIL@ADDRESS>, 2024.
#
#, fuzzy
msgid ""
msgstr ""
"Project-Id-Version: Xinference\n"
"Report-Msgid-Bugs-To: \n"
"POT-Creation-Date: 2025-05-27 19:02+0800\n"
"PO-Revision-Date: YEAR-MO-DA HO:MI+ZONE\n"
"Last-Translator: FULL NAME <EMAIL@ADDRESS>\n"
"Language-Team: zh_TW <LL@li.org>\n"
"Language: zh_TW\n"
"MIME-Version: 1.0\n"
"Content-Type: text/plain; charset=utf-8\n"
"Content-Transfer-Encoding: 8bit\n"
"Plural-Forms: nplurals=1; plural=0;\n"
"Generated-By: Babel 2.18.0\n"

#: ../../source/user_guide/continuous_batching.rst:5
msgid "Continuous Batching"
msgstr "連續批次處理"

#: ../../source/user_guide/continuous_batching.rst:7
msgid ""
"Continuous batching, as a means to improve throughput during model serving, "
"has already been implemented in inference engines like ``VLLM``. Xinference "
"aims to provide this optimization capability when using the transformers "
"engine as well."
msgstr ""
"連續批次處理是諸如 ``VLLM`` 這樣的推理引擎中提升吞吐量的重要技術。Xinference 旨在透過這項技術提升 ``transformers``"
" 推理引擎的吞吐量。"

#: ../../source/user_guide/continuous_batching.rst:11
msgid "Usage"
msgstr "使用方式"

#: ../../source/user_guide/continuous_batching.rst:14
msgid "LLM"
msgstr "大語言模型"

#: ../../source/user_guide/continuous_batching.rst:15
msgid "Currently, this feature can be enabled under the following conditions:"
msgstr "目前，此功能在滿足以下條件時啟用："

#: ../../source/user_guide/continuous_batching.rst:17
msgid ""
"First, set the environment variable "
"``XINFERENCE_TRANSFORMERS_ENABLE_BATCHING`` to ``1`` when starting "
"xinference. For example:"
msgstr ""
"首先，啟動 Xinference 時需要將環境變數 ``XINFERENCE_TRANSFORMERS_ENABLE_BATCHING`` 設為 "
"``1``。"

#: ../../source/user_guide/continuous_batching.rst:25
msgid ""
"Since ``v0.16.0``, this feature is turned on by default and is no longer "
"required to set the ``XINFERENCE_TRANSFORMERS_ENABLE_BATCHING`` environment "
"variable. This environment variable has been removed."
msgstr ""
"從 ``v0.16.0`` 開始，此功能預設開啟，不再需要設定 ``XINFERENCE_TRANSFORMERS_ENABLE_BATCHING`` "
"環境變數，且該環境變數已被移除。"

#: ../../source/user_guide/continuous_batching.rst:30
msgid ""
"Then, ensure that the ``transformers`` engine is selected when launching the"
" model. For example:"
msgstr "然後，啟動 LLM 模型時選擇 ``transformers`` 推理引擎。例如："

#: ../../source/user_guide/continuous_batching.rst:66
msgid ""
"Once this feature is enabled, all requests for LLMs will be managed by "
"continuous batching, and the average throughput of requests made to a single"
" model will increase. The usage of the LLM interface remains exactly the "
"same as before, with no differences."
msgstr "一旦此功能開啟，LLM 模型的所有接口將被此功能接管。所有接口的使用方式沒有任何變化。"

#: ../../source/user_guide/continuous_batching.rst:71
msgid "Image Model"
msgstr "圖像模型"

#: ../../source/user_guide/continuous_batching.rst:72
msgid ""
"Currently, for image models, only the ``text_to_image`` interface is "
"supported for ``FLUX.1`` series models."
msgstr "目前只有 ``FLUX.1`` 系列模型的 ``text_to_image`` （文生圖）介面支援此功能。"

#: ../../source/user_guide/continuous_batching.rst:74
msgid ""
"Enabling this feature requires setting the environment variable "
"``XINFERENCE_TEXT_TO_IMAGE_BATCHING_SIZE``, which indicates the ``size`` of "
"the generated images."
msgstr ""
"啟用此功能前，需在啟動 xinference 時指定 ``XINFERENCE_TEXT_TO_IMAGE_BATCHING_SIZE`` "
"環境變數，該變數代表生成的圖片尺寸。"

#: ../../source/user_guide/continuous_batching.rst:76
msgid "For example, starting xinference like this:"
msgstr "例如，像這樣啟動 xinference："

#: ../../source/user_guide/continuous_batching.rst:83
msgid ""
"Then just use the ``text_to_image`` interface as before, and nothing else "
"needs to be changed."
msgstr "接下來正常使用 ``text_to_image`` 介面即可，其他什麼都不需要改變。"

#: ../../source/user_guide/continuous_batching.rst:86
msgid "Abort your request"
msgstr "中止請求"

#: ../../source/user_guide/continuous_batching.rst:87
msgid ""
"In this mode, you can abort requests that are in the process of inference."
msgstr "在此功能中，你可以優雅地中止正在推理中的請求。"

#: ../../source/user_guide/continuous_batching.rst:89
msgid "First, add ``request_id`` option in ``generate_config``. For example:"
msgstr "首先，在推理請求的 ``generate_config`` 中指定 ``request_id`` 選項。例如："

#: ../../source/user_guide/continuous_batching.rst:98
msgid ""
"Then, abort the request using the ``request_id`` you have set. For example:"
msgstr "接著，帶著你指定的 ``request_id`` 去中止該請求。例如："

#: ../../source/user_guide/continuous_batching.rst:106
msgid ""
"Note that if your request has already finished, aborting the request will be"
" a no-op. Image models also support this feature."
msgstr "注意，如果你的請求已經結束，那麼此操作將什麼都不做。"

#: ../../source/user_guide/continuous_batching.rst:110
msgid "Note"
msgstr "注意事項"

#: ../../source/user_guide/continuous_batching.rst:112
msgid ""
"Currently, for ``LLM`` models, this feature only supports the ``generate``, "
"``chat``, ``tool call`` and ``vision`` tasks."
msgstr ""
"當前，此功能僅支援 LLM 模型的 ``generate``, ``chat``, ``tool call`` （工具呼叫）和 ``vision`` "
"（多模態）功能。"

#: ../../source/user_guide/continuous_batching.rst:114
msgid ""
"Currently, for ``image`` models, this feature only supports the "
"``text_to_image`` tasks. Only ``FLUX.1`` series models are supported."
msgstr "目前，對於圖像模型，僅支援 `FLUX.1`` 系列模型的 ``text_to_image`` （文生圖）功能。"

#: ../../source/user_guide/continuous_batching.rst:116
msgid ""
"For ``vision`` tasks, currently only ``qwen2-vl-instruct``, ``qwen2.5-vl-"
"instruct``, ``QvQ-72B-Preview``, ``glm-4v`` and ``MiniCPM-V-2.6`` (only for "
"image tasks) models are supported. More models will be supported in the "
"future. Please let us know your requirements."
msgstr ""
"對於多模態任務，當前支援 ``qwen2-vl-instruct``，``qwen2.5-vl-"
"instruct``，``QvQ-72B-Preview``，``glm-4v`` 和 "
"``MiniCPM-V-2.6``。未來將加入更多模型，敬請期待。"

#: ../../source/user_guide/continuous_batching.rst:118
msgid ""
"If using GPU inference, this method will consume more GPU memory. Please be "
"cautious when increasing the number of concurrent requests to the same "
"model. The ``launch_model`` interface provides the ``max_num_seqs`` "
"parameter to adjust the concurrency level, with a default value of ``16``."
msgstr ""
"如果使用 GPU 推理，此功能對顯存要求較高。因此請謹慎提高對同一個模型的並發請求量。``launch_model`` 介面提供可選參數 "
"``max_num_seqs`` 用於調整並發度，預設值為 ``16`` 。"
