# SOME DESCRIPTIVE TITLE.
# Copyright (C) 2025, Xorbits Inc.
# This file is distributed under the same license as the Xinference package.
# FIRST AUTHOR <EMAIL@ADDRESS>, 2025.
#
#, fuzzy
msgid ""
msgstr ""
"Project-Id-Version: Xinference \n"
"Report-Msgid-Bugs-To: \n"
"POT-Creation-Date: 2026-01-28 11:54+0800\n"
"PO-Revision-Date: YEAR-MO-DA HO:MI+ZONE\n"
"Last-Translator: FULL NAME <EMAIL@ADDRESS>\n"
"Language: zh_CN\n"
"Language-Team: zh_CN <LL@li.org>\n"
"Plural-Forms: nplurals=1; plural=0;\n"
"MIME-Version: 1.0\n"
"Content-Type: text/plain; charset=utf-8\n"
"Content-Transfer-Encoding: 8bit\n"
"Generated-By: Babel 2.17.0\n"

#: ../../source/user_guide/launch.rst:5
msgid "Model Launching Instructions"
msgstr "模型加载指南"

#: ../../source/user_guide/launch.rst:7
msgid "This document aims to provide a functional overview of model launching."
msgstr "本文档旨在提供模型加载的功能说明。"

#: ../../source/user_guide/launch.rst:10
msgid "Replica"
msgstr "副本"

#: ../../source/user_guide/launch.rst:12
msgid ""
"Replicas specify the number of model instances to load. For example, if "
"you have two GPUs and each can host one replica of the model, you can set"
" the replica count to 2. This way, two identical instances of the model "
"will be distributed across the two GPUs. Xinference automatically load-"
"balances requests to ensure even distribution across multiple GPUs. "
"Meanwhile, users see it as a single model, which greatly improves overall"
" resource utilization."
msgstr ""
"副本用来指定模型加载的实例份数。比如，你有两张 GPU，每张卡可以放下模型的一个副本，你可以设置副本数为 "
"2。这样，两个完全相同的模型实例将分布在这两张 GPU 上。Xinference "
"会自动进行负载均衡，确保请求均匀分配到多张卡上。用户看到的仍是一个模型，这大大提升了整体资源利用率。"

#: ../../source/user_guide/launch.rst:17
msgid "Traditional Multi-Instance Deployment："
msgstr "旧版本多实例部署："

#: ../../source/user_guide/launch.rst:19
msgid ""
"When you have multiple GPU cards, each capable of hosting one model "
"instance, you can set the number of instances equal to the number of "
"GPUs. For example:"
msgstr "当您拥有多张GPU显卡时，每张显卡可承载一个模型实例，此时可将实例数量设置为等于GPU数量。例如:"

#: ../../source/user_guide/launch.rst:21
msgid "2 GPUs, 2 instances: Each GPU runs one model instance"
msgstr "2张GPU，2个实例：每张GPU运行一个模型实例"

#: ../../source/user_guide/launch.rst:22
msgid "4 GPUs, 4 instances: Each GPU runs one model instance"
msgstr "4张GPU，4个实例：每张GPU运行一个模型实例"

#: ../../source/user_guide/launch.rst:26
msgid "Introduce a new environment variable:"
msgstr "引入一个新的环境变量:"

#: ../../source/user_guide/launch.rst:32
msgid ""
"Control whether to enable the single GPU multi-copy feature Default "
"value: 1"
msgstr "控制是否启用单GPU多副本功能，默认值：1"

#: ../../source/user_guide/launch.rst:35
msgid "New Feature: Smart Replica Deployment"
msgstr "新功能：智能副本部署"

#: ../../source/user_guide/launch.rst:37
msgid "Single GPU Multi-Replica"
msgstr "单GPU多副本"

#: ../../source/user_guide/launch.rst:39
msgid "New Support: Run multiple model replicas even with just one GPU."
msgstr "新增支持：即使仅有一块GPU，也能运行多个模型副本。"

#: ../../source/user_guide/launch.rst:41
msgid "Scenario: You have 1 GPU with sufficient VRAM"
msgstr "场景：您拥有1个GPU且显存充足"

#: ../../source/user_guide/launch.rst:42
msgid "Configuration: Replica Count = 3, GPU Count = 1"
msgstr "配置：副本数量=3，GPU数量=1"

#: ../../source/user_guide/launch.rst:43
msgid "Result: 3 model instances running on the same GPU, sharing GPU resources"
msgstr "结果：3个模型实例，在同一GPU上运行，共享GPU资源"

#: ../../source/user_guide/launch.rst:45
msgid "Hybrid GPU Allocation"
msgstr "混合GPU分配"

#: ../../source/user_guide/launch.rst:47
msgid ""
"Smart Allocation: Number of replicas may differ from GPU count; system "
"intelligently distributes"
msgstr "智能分配: 副本数可以不等于GPU数量，系统会智能分配"

#: ../../source/user_guide/launch.rst:49
msgid "Scenario: You have 2 GPUs and need 3 replicas"
msgstr "场景: 你有2张GPU，需要3个副本"

#: ../../source/user_guide/launch.rst:50
msgid "Configuration: Replicas=3, GPUs=2"
msgstr "配置: 副本数=3，GPU数量=2"

#: ../../source/user_guide/launch.rst:51
msgid "Result: GPU0 runs 2 instances, GPU1 runs 1 instance"
msgstr "结果: GPU0运行2个实例，GPU1运行1个实例"

#: ../../source/user_guide/launch.rst:54
msgid "GPU Allocation Strategy"
msgstr "混合分配策略"

#: ../../source/user_guide/launch.rst:56
msgid ""
"The current policy is *Idle First*: The scheduler always attempts to "
"assign replicas to the least utilized GPU. Use the "
"``XINFERENCE_LAUNCH_STRATEGY`` parameter to choose launch strategy."
msgstr ""
"当前策略为 *空闲优先* ：调度器始终尝试将副本分配至最空闲的GPU。使用 ``XINFERENCE_LAUNCH_STRATEGY`` "
"参数选择启动策略。"

#: ../../source/user_guide/launch.rst:59
msgid "Set Environment Variables"
msgstr "设置环境变量"

#: ../../source/user_guide/launch.rst:63
msgid ""
"Sometimes, we want to specify environment variables for a particular "
"model at runtime. Since v1.8.1, Xinference provides the capability to "
"configure these individually without needing to set them before starting "
"Xinference."
msgstr ""
"有时我们希望在运行时为特定模型指定环境变量。从 v1.8.1 开始，Xinference 提供了单独配置环境变量的功能，无需在启动 "
"Xinference 前设置。"

#: ../../source/user_guide/launch.rst:66
msgid "For Web UI."
msgstr "针对 Web UI。"

#: ../../source/user_guide/launch.rst:72
msgid ""
"When using the command line, use ``--env`` to specify an environment "
"variable."
msgstr "命令行使用时，使用 ``--env`` 指定环境变量。"

#: ../../source/user_guide/launch.rst:74 ../../source/user_guide/launch.rst:123
msgid "Example usage:"
msgstr "示例用法："

#: ../../source/user_guide/launch.rst:80
msgid ""
"Take vLLM as an example: it has versions V1 and V0, and by default, it "
"automatically determines which version to use. If you want to force the "
"use of V0 by setting ``VLLM_USE_V1=0`` when launching a model, you can "
"specify this during model launching."
msgstr ""
"以 vLLM 为例，它有 V1 和 V0 两个版本，默认会自动判定使用哪个版本。如果想在加载模型时强制通过设置 ``VLLM_USE_V1=0``"
" 来使用 V0，可以指定该环境变量。"

#: ../../source/user_guide/launch.rst:84
msgid "Configuring Model Virtual Environment"
msgstr "配置模型虚拟空间"

#: ../../source/user_guide/launch.rst:88
msgid ""
"For this part, please refer to :ref:`toggling virtual environments and "
"customizing dependencies <model_launching_virtualenv>`."
msgstr "对于这部分，请参考 :ref:`开关虚拟空间和定制依赖 <model_launching_virtualenv>`。"

#: ../../source/user_guide/launch.rst:91
msgid "Batching / Continuous Batching"
msgstr "批处理 / 连续批处理"

#: ../../source/user_guide/launch.rst:93
msgid ""
"Xinference supports batching for higher throughput. For LLMs on the "
"``transformers`` engine, continuous batching is available and can be "
"enabled via environment variables at launch time."
msgstr ""
"Xinference支持批处理以提升吞吐量。对于基于 ``transformers`` "
"引擎的大型语言模型，可启用连续批处理功能，该功能可在启动时通过环境变量进行配置。"

#: ../../source/user_guide/launch.rst:96
msgid "Key settings:"
msgstr "关键设置："

#: ../../source/user_guide/launch.rst:98
msgid ""
"``XINFERENCE_BATCH_SIZE`` and ``XINFERENCE_BATCH_INTERVAL`` for general "
"batching behavior."
msgstr " ``XINFERENCE_BATCH_SIZE`` 和 ``XINFERENCE_BATCH_INTERVAL`` 用于控制常规的批处理行为。"

#: ../../source/user_guide/launch.rst:99
msgid ""
"``XINFERENCE_TEXT_TO_IMAGE_BATCHING_SIZE`` for text-to-image models (when"
" supported)."
msgstr " ``XINFERENCE_TEXT_TO_IMAGE_BATCHING_SIZE``（文本转图像模型，当支持时）。"

#: ../../source/user_guide/launch.rst:101
msgid "Example (LLM, transformers):"
msgstr "示例（大型语言模型，Transformers）："

#: ../../source/user_guide/launch.rst:108
msgid "Example (text-to-image):"
msgstr "示例（文生图）："

#: ../../source/user_guide/launch.rst:114
msgid ""
"For detailed behavior, supported models, and aborting requests, see "
":ref:`Continuous Batching <user_guide_continuous_batching>`."
msgstr ""
"有关详细行为、支持的模型以及中止请求的信息，请参阅"
" :ref:`连续批处理 <user_guide_continuous_batching>` 。"

#: ../../source/user_guide/launch.rst:118
msgid "Thinking Mode"
msgstr "思考模式"

#: ../../source/user_guide/launch.rst:120
msgid ""
"Some hybrid reasoning models (for example, Qwen3) support an optional "
"*thinking mode*. You can enable this at launch time via ``--enable-"
"thinking``."
msgstr "某些混合推理模型（例如Qwen3）支持可选的 *思考模式* 。您可在启动时通过 ``--enable-thinking`` 参数启用该功能。"

