ITADN

Optimum 2.0.0: Bettertransformer deprecated

#649OpennoobHappylife 创建于 2025-10-30
N
noobHappylifecommented
### System Info When install with pip install infinity[all] it will install optimum 2.0.0. Resulting in the following error when using the infinity cli. ``` infinity_emb v2 --help Traceback (most recent call last): File "/media/data4/yh/uvenv/infinity077/bin/infinity_emb", line 4, in <module> from infinity_emb.cli import cli File "/media/data4/yh/uvenv/infinity077/lib/python3.12/site-packages/infinity_emb/__init__.py", line 7, in <module> from infinity_emb.engine import AsyncEmbeddingEngine, AsyncEngineArray # noqa: E402 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/media/data4/yh/uvenv/infinity077/lib/python3.12/site-packages/infinity_emb/engine.py", line 11, in <module> from infinity_emb.inference import ( File "/media/data4/yh/uvenv/infinity077/lib/python3.12/site-packages/infinity_emb/inference/__init__.py", line 4, in <module> from infinity_emb.inference.batch_handler import BatchHandler File "/media/data4/yh/uvenv/infinity077/lib/python3.12/site-packages/infinity_emb/inference/batch_handler.py", line 39, in <module> from infinity_emb.transformer.utils import get_lengths_with_tokenize File "/media/data4/yh/uvenv/infinity077/lib/python3.12/site-packages/infinity_emb/transformer/utils.py", line 9, in <module> from infinity_emb.transformer.classifier.torch import SentenceClassifier File "/media/data4/yh/uvenv/infinity077/lib/python3.12/site-packages/infinity_emb/transformer/classifier/torch.py", line 8, in <module> from infinity_emb.transformer.acceleration import ( File "/media/data4/yh/uvenv/infinity077/lib/python3.12/site-packages/infinity_emb/transformer/acceleration.py", line 11, in <module> from optimum.bettertransformer import ( # type: ignore[import-untyped] ModuleNotFoundError: No module named 'optimum.bettertransformer' ``` Optimum installed: ``` pip freeze | grep optimum optimum==2.0.0 ``` Checking the optimum released notes, https://github.com/huggingface/optimum/releases/tag/v2.0.0 bettertransformer has been deprecated and removed. ### Information - [ ] Docker + cli - [x] pip + cli - [ ] pip + usage of Python interface ### Tasks - [ ] An officially supported CLI command - [ ] My own modifications ### Reproduction Installed with > pip install infinity-emb[all] Failed to run cli as mentioned above.
3 条评论