ITADN

BetterTransformer requires transformers<4.49 but found 4.51.3.

#42Openlinengcs 创建于 2025-07-24
L
linengcscommented
通过sh gpt_server/script/start.sh启动服务时,却报错下面信息,是通过install.sh安装环境的,请问这是什么原因,需要我降级transformers吗 ```bash INFO: Started server process [129357] INFO: Waiting for application startup. 2025-07-24 08:11:38.345 | WARNING | __main__:__init__:38 - 使用cuda加载... ERROR: Traceback (most recent call last): File "/opt/conda/envs/gpt_server/lib/python3.10/site-packages/starlette/routing.py", line 693, in lifespan async with self.lifespan_context(app) as maybe_state: File "/opt/conda/envs/gpt_server/lib/python3.10/site-packages/starlette/routing.py", line 569, in __aenter__ await self._router.startup() File "/opt/conda/envs/gpt_server/lib/python3.10/site-packages/starlette/routing.py", line 670, in startup await handler() File "/inspire/hdd/ws-f4d69b29-e0a5-44e6-bd92-acf4de9990f0/public-project/xieyuan-24039/llf/gpt_server/gpt_server/model_worker/base/model_worker_base.py", line 304, in startup worker = cls.get_worker( File "/inspire/hdd/ws-f4d69b29-e0a5-44e6-bd92-acf4de9990f0/public-project/xieyuan-24039/llf/gpt_server/gpt_server/model_worker/base/model_worker_base.py", line 209, in get_worker worker = cls( File "/inspire/hdd/ws-f4d69b29-e0a5-44e6-bd92-acf4de9990f0/public-project/xieyuan-24039/llf/gpt_server/gpt_server/model_worker/embedding.py", line 43, in __init__ self.mode = get_embedding_mode(model_path=model_path) File "/inspire/hdd/ws-f4d69b29-e0a5-44e6-bd92-acf4de9990f0/public-project/xieyuan-24039/llf/gpt_server/gpt_server/model_worker/utils.py", line 52, in get_embedding_mode from infinity_emb import EngineArgs File "/opt/conda/envs/gpt_server/lib/python3.10/site-packages/infinity_emb/__init__.py", line 27, in <module> from infinity_emb.engine import AsyncEmbeddingEngine, AsyncEngineArray # noqa: E402 File "/opt/conda/envs/gpt_server/lib/python3.10/site-packages/infinity_emb/engine.py", line 11, in <module> from infinity_emb.inference import ( File "/opt/conda/envs/gpt_server/lib/python3.10/site-packages/infinity_emb/inference/__init__.py", line 4, in <module> from infinity_emb.inference.batch_handler import BatchHandler File "/opt/conda/envs/gpt_server/lib/python3.10/site-packages/infinity_emb/inference/batch_handler.py", line 39, in <module> from infinity_emb.transformer.utils import get_lengths_with_tokenize File "/opt/conda/envs/gpt_server/lib/python3.10/site-packages/infinity_emb/transformer/utils.py", line 9, in <module> from infinity_emb.transformer.classifier.torch import SentenceClassifier File "/opt/conda/envs/gpt_server/lib/python3.10/site-packages/infinity_emb/transformer/classifier/torch.py", line 8, in <module> from infinity_emb.transformer.acceleration import ( File "/opt/conda/envs/gpt_server/lib/python3.10/site-packages/infinity_emb/transformer/acceleration.py", line 11, in <module> from optimum.bettertransformer import ( # type: ignore[import-untyped] File "/opt/conda/envs/gpt_server/lib/python3.10/site-packages/optimum/bettertransformer/__init__.py", line 20, in <module> raise RuntimeError( RuntimeError: BetterTransformer requires transformers<4.49 but found 4.51.3. `optimum.bettertransformer` is deprecated and will be removed in optimum v2.0. ERROR: Application startup failed. Exiting. ```
2 条评论