# SOME DESCRIPTIVE TITLE.
# Copyright (C) 2023, Xorbits Inc.
# This file is distributed under the same license as the Xinference package.
# FIRST AUTHOR <EMAIL@ADDRESS>, 2024.
#
#, fuzzy
msgid ""
msgstr ""
"Project-Id-Version: Xinference\n"
"Report-Msgid-Bugs-To: \n"
"POT-Creation-Date: 2025-05-27 19:02+0800\n"
"PO-Revision-Date: YEAR-MO-DA HO:MI+ZONE\n"
"Last-Translator: FULL NAME <EMAIL@ADDRESS>\n"
"Language-Team: ko <LL@li.org>\n"
"Language: ko\n"
"MIME-Version: 1.0\n"
"Content-Type: text/plain; charset=utf-8\n"
"Content-Transfer-Encoding: 8bit\n"
"Plural-Forms: nplurals=1; plural=0;\n"
"Generated-By: Babel 2.18.0\n"

#: ../../source/user_guide/continuous_batching.rst:5
msgid "Continuous Batching"
msgstr "연속 배치 처리"

#: ../../source/user_guide/continuous_batching.rst:7
msgid ""
"Continuous batching, as a means to improve throughput during model serving, "
"has already been implemented in inference engines like ``VLLM``. Xinference "
"aims to provide this optimization capability when using the transformers "
"engine as well."
msgstr ""
"연속 배치 처리는 ``VLLM``과 같은 추론 엔진에서 처리량을 향상시키는 중요한 기술입니다. Xinference는 이 기술을 통해 "
"``transformers`` 추론 엔진의 처리량을 향상시키는 것을 목표로 합니다."

#: ../../source/user_guide/continuous_batching.rst:11
msgid "Usage"
msgstr "사용 방법"

#: ../../source/user_guide/continuous_batching.rst:14
msgid "LLM"
msgstr "대규모 언어 모델"

#: ../../source/user_guide/continuous_batching.rst:15
msgid "Currently, this feature can be enabled under the following conditions:"
msgstr "현재, 이 기능은 다음 조건이 충족될 때 활성화됩니다:"

#: ../../source/user_guide/continuous_batching.rst:17
msgid ""
"First, set the environment variable "
"``XINFERENCE_TRANSFORMERS_ENABLE_BATCHING`` to ``1`` when starting "
"xinference. For example:"
msgstr ""
"먼저, Xinference를 시작할 때 환경 변수 ``XINFERENCE_TRANSFORMERS_ENABLE_BATCHING``를 "
"``1``로 설정해야 합니다."

#: ../../source/user_guide/continuous_batching.rst:25
msgid ""
"Since ``v0.16.0``, this feature is turned on by default and is no longer "
"required to set the ``XINFERENCE_TRANSFORMERS_ENABLE_BATCHING`` environment "
"variable. This environment variable has been removed."
msgstr ""
"``v0.16.0``부터 이 기능은 기본적으로 활성화되며, 더 이상 "
"``XINFERENCE_TRANSFORMERS_ENABLE_BATCHING`` 환경 변수를 설정할 필요가 없으며, 해당 환경 변수는 "
"제거되었습니다."

#: ../../source/user_guide/continuous_batching.rst:30
msgid ""
"Then, ensure that the ``transformers`` engine is selected when launching the"
" model. For example:"
msgstr "그런 다음, LLM 모델을 시작할 때 ``transformers`` 추론 엔진을 선택합니다. 예시:"

#: ../../source/user_guide/continuous_batching.rst:66
msgid ""
"Once this feature is enabled, all requests for LLMs will be managed by "
"continuous batching, and the average throughput of requests made to a single"
" model will increase. The usage of the LLM interface remains exactly the "
"same as before, with no differences."
msgstr ""
"이 기능이 활성화되면, LLM 모델의 모든 인터페이스가 이 기능에 의해 관리됩니다. 모든 인터페이스의 사용 방식에는 변화가 없습니다."

#: ../../source/user_guide/continuous_batching.rst:71
msgid "Image Model"
msgstr "Image model"

#: ../../source/user_guide/continuous_batching.rst:72
msgid ""
"Currently, for image models, only the ``text_to_image`` interface is "
"supported for ``FLUX.1`` series models."
msgstr "현재 ``FLUX.1`` 시리즈 모델의 ``text_to_image`` (텍스트-이미지) 인터페이스만 이 기능을 지원합니다."

#: ../../source/user_guide/continuous_batching.rst:74
msgid ""
"Enabling this feature requires setting the environment variable "
"``XINFERENCE_TEXT_TO_IMAGE_BATCHING_SIZE``, which indicates the ``size`` of "
"the generated images."
msgstr ""
"이미지 모델에서 이 기능을 활성화하려면 xinference를 시작할 때 "
"``XINFERENCE_TEXT_TO_IMAGE_BATCHING_SIZE`` 환경 변수를 지정해야 하며, 이는 생성되는 이미지의 크기를 "
"나타냅니다."

#: ../../source/user_guide/continuous_batching.rst:76
msgid "For example, starting xinference like this:"
msgstr "예를 들어, 다음과 같이 xinference를 시작합니다:"

#: ../../source/user_guide/continuous_batching.rst:83
msgid ""
"Then just use the ``text_to_image`` interface as before, and nothing else "
"needs to be changed."
msgstr ""
"이후에는 ``text_to_image`` 인터페이스를 정상적으로 사용하기만 하면 되며, 다른 것은 전혀 변경할 필요가 없습니다."

#: ../../source/user_guide/continuous_batching.rst:86
msgid "Abort your request"
msgstr "요청 중단"

#: ../../source/user_guide/continuous_batching.rst:87
msgid ""
"In this mode, you can abort requests that are in the process of inference."
msgstr "이 기능에서는 추론 중인 요청을 우아하게 중단할 수 있습니다."

#: ../../source/user_guide/continuous_batching.rst:89
msgid "First, add ``request_id`` option in ``generate_config``. For example:"
msgstr "먼저, 추론 요청의 ``generate_config``에서 ``request_id`` 옵션을 지정합니다. 예를 들어:"

#: ../../source/user_guide/continuous_batching.rst:98
msgid ""
"Then, abort the request using the ``request_id`` you have set. For example:"
msgstr "그런 다음, 당신이 지정한 ``request_id``를 가지고 해당 요청을 중단하십시오. 예를 들어:"

#: ../../source/user_guide/continuous_batching.rst:106
msgid ""
"Note that if your request has already finished, aborting the request will be"
" a no-op. Image models also support this feature."
msgstr "주의, 만약 당신의 요청이 이미 종료되었다면, 이 작업은 아무것도 수행하지 않습니다."

#: ../../source/user_guide/continuous_batching.rst:110
msgid "Note"
msgstr "주의 사항"

#: ../../source/user_guide/continuous_batching.rst:112
msgid ""
"Currently, for ``LLM`` models, this feature only supports the ``generate``, "
"``chat``, ``tool call`` and ``vision`` tasks."
msgstr ""
"현재 이 기능은 LLM 모델의 ``generate``, ``chat``, ``tool call`` 및 ``vision`` (다중 모드) "
"기능만 지원합니다."

#: ../../source/user_guide/continuous_batching.rst:114
msgid ""
"Currently, for ``image`` models, this feature only supports the "
"``text_to_image`` tasks. Only ``FLUX.1`` series models are supported."
msgstr ""
"현재 이미지 모델의 경우 `FLUX.1` 시리즈 모델의 `text_to_image` (텍스트-이미지 생성) 기능만 지원됩니다."

#: ../../source/user_guide/continuous_batching.rst:116
msgid ""
"For ``vision`` tasks, currently only ``qwen2-vl-instruct``, ``qwen2.5-vl-"
"instruct``, ``QvQ-72B-Preview``, ``glm-4v`` and ``MiniCPM-V-2.6`` (only for "
"image tasks) models are supported. More models will be supported in the "
"future. Please let us know your requirements."
msgstr ""
"멀티모달 작업의 경우, 현재 ``qwen2-vl-instruct``, ``qwen2.5-vl-instruct``, "
"``QvQ-72B-Preview``, ``glm-4v``, ``MiniCPM-V-2.6``을 지원합니다. 향후 더 많은 모델이 추가될 "
"예정이니 기대해 주세요."

#: ../../source/user_guide/continuous_batching.rst:118
msgid ""
"If using GPU inference, this method will consume more GPU memory. Please be "
"cautious when increasing the number of concurrent requests to the same "
"model. The ``launch_model`` interface provides the ``max_num_seqs`` "
"parameter to adjust the concurrency level, with a default value of ``16``."
msgstr ""
"GPU 추론을 사용하는 경우, 이 기능은 비디오 메모리 요구 사항이 높습니다. 따라서 동일한 모델에 대한 동시 요청 수를 신중하게 "
"늘리십시오. ``launch_model`` 인터페이스는 선택적 매개변수 ``max_num_seqs``를 제공하여 동시성을 조정할 수 "
"있으며, 기본값은 ``16``입니다."
