# SOME DESCRIPTIVE TITLE.
# Copyright (C) 2023, Xorbits Inc.
# This file is distributed under the same license as the Xinference package.
# FIRST AUTHOR <EMAIL@ADDRESS>, 2025.
#
#, fuzzy
msgid ""
msgstr ""
"Project-Id-Version: Xinference\n"
"Report-Msgid-Bugs-To: \n"
"POT-Creation-Date: 2026-01-29 11:03+0800\n"
"PO-Revision-Date: YEAR-MO-DA HO:MI+ZONE\n"
"Last-Translator: FULL NAME <EMAIL@ADDRESS>\n"
"Language-Team: zh_TW <LL@li.org>\n"
"Language: zh_TW\n"
"MIME-Version: 1.0\n"
"Content-Type: text/plain; charset=utf-8\n"
"Content-Transfer-Encoding: 8bit\n"
"Plural-Forms: nplurals=1; plural=0;\n"
"Generated-By: Babel 2.18.0\n"

#: ../../source/user_guide/distributed_inference.rst:5
msgid "Distributed Inference"
msgstr "分散式推理"

#: ../../source/user_guide/distributed_inference.rst:6
msgid ""
"Some language models including **DeepSeek V3**, **DeepSeek R1**, etc are too"
" large to fit into GPus on a single machine, Xinference supported running "
"these models across multiple machines."
msgstr ""
"一些語言模型，包括 **DeepSeek V3**、**DeepSeek R1** 等，體積過大，無法適配單台機器上的 GPU，Xinference "
"支援在多台機器上運行這些模型。"

#: ../../source/user_guide/distributed_inference.rst:13
msgid "Supported Engines"
msgstr "支援的引擎"

#: ../../source/user_guide/distributed_inference.rst:14
msgid "Now, Xinference supported below engines to run models across workers."
msgstr "現在，Xinference 支援以下引擎在多台 worker 上執行模型。"

#: ../../source/user_guide/distributed_inference.rst:16
msgid ":ref:`SGLang <sglang_backend>` (supported in v1.3.0)"
msgstr ":ref:`SGLang <sglang_backend>` （在 v1.3.0 中支援）"

#: ../../source/user_guide/distributed_inference.rst:17
msgid ":ref:`vLLM <vllm_backend>` (supported in v1.4.1)"
msgstr ":ref:`vLLM <vllm_backend>` （在 v1.4.1 中支援）"

#: ../../source/user_guide/distributed_inference.rst:18
msgid ""
":ref:`MLX <mlx_backend>` (supported in v1.7.1), MLX distributed currently "
"does not support all models. The following model types are supported at this"
" time. If you have additional requirements, feel free to submit a GitHub "
"issue at `https://github.com/xorbitsai/inference/issues "
"<https://github.com/xorbitsai/inference/issues>`_ to request support."
msgstr ""
":ref:`MLX <mlx_backend>`（自 v1.7.1 "
"起支援）目前在分散式模式下並不支援所有模型。目前支援以下幾種模型類型。如果你有其他需求，歡迎在 "
"`https://github.com/xorbitsai/inference/issues "
"<https://github.com/xorbitsai/inference/issues>`_ 提交 GitHub issue 來請求支援。"

#: ../../source/user_guide/distributed_inference.rst:22
msgid "DeepSeek v3 and R1"
msgstr "DeepSeek v3 和 R1"

#: ../../source/user_guide/distributed_inference.rst:23
msgid "Qwen2.5-instruct and the models have the same model architectures."
msgstr "Qwen2.5-instruct 及其他具有相同模型架構的模型。"

#: ../../source/user_guide/distributed_inference.rst:24
msgid "Qwen3 and the models have the same model architectures."
msgstr "Qwen3 及其他具有相同模型架構的模型。"

#: ../../source/user_guide/distributed_inference.rst:25
msgid "Qwen3-moe and the models have the same model architectures."
msgstr "Qwen3-moe 及其他具有相同模型架構的模型。"

#: ../../source/user_guide/distributed_inference.rst:30
msgid "Usage"
msgstr "使用"

#: ../../source/user_guide/distributed_inference.rst:31
msgid ""
"First you need at least 2 workers to support distributed inference. Refer to"
" :ref:`running Xinference in cluster <distributed_getting_started>` to "
"create a Xinference cluster including supervisor and workers."
msgstr ""
"首先，您需要至少 2 個工作節點來支援分散式推理。請參考 :ref:`在叢集中執行 Xinference "
"<distributed_getting_started>` 以建立包含 supervisor 節點和 worker 節點的 Xinference "
"叢集。"

#: ../../source/user_guide/distributed_inference.rst:35
msgid ""
"vLLM (v0.11.0+) note: Starting from vLLM v0.11.0, distributed deployment "
"with vLLM requires Xinference >= v1.17.1. In addition to setting "
"``--n-worker`` as before, you must also set ``tensor_parallel_size`` (set it"
" to the **GPU count**) and ``pipeline_parallel_size=1`` when launching the "
"model."
msgstr ""
"vLLM（v0.11.0+）注意事項：從vLLM v0.11.0版本開始，使用vLLM進行分散式佈署需要Xinference >= "
"v1.17.1版本。除原有的 ``--n-worker`` 參數設定外，啟動模型時還必須同時設定 ``tensor_parallel_size`` "
"（將其設定為 **GPU數量** ）  和 ``pipeline_parallel_size=1`` 參數。"

#: ../../source/user_guide/distributed_inference.rst:40
msgid ""
"Then if are using web UI, choose expected machines for ``worker count`` in "
"the optional configurations, if you are using command line, add ``--n-worker"
" <machine number>`` when launching a model. The model will be launched "
"across multiple workers accordingly."
msgstr ""
"然後，如果您使用的是 Web UI，請在可選配置中選擇期望的機器數量作為 ``worker count``；如果您使用的是命令列，啟動模型時請加上 "
"``--n-worker <機器數量>``。模型將會在多個工作節點上啟動。"

#: ../../source/user_guide/distributed_inference.rst:48
msgid ""
"``GPU count`` on web UI, or ``--n-gpu`` for command line now mean GPUs count"
" per worker if you are using distributed inference."
msgstr ""
"使用分散式推理時，在 Web UI 中的 ``GPU count`` 或命令列中的 ``--n-gpu`` 現在表示每個工作節點的 GPU 數量。"
