ITADN

Trying to download a model with a local disk mounted to the container

#793ClosedJxKim 创建于 2025-12-31
J
JxKimcommented
### System Info Hi, there, why is that I have mounted a local path(with models already downloaded in the path) to the container ,,but when I start running a container with the model, it still tried to download models weights from huggingface? <img width="3800" height="482" alt="Image" src="https://github.com/user-attachments/assets/d645084f-a64c-4374-b959-99dc7d9db6b1" /> <img width="1456" height="266" alt="Image" src="https://github.com/user-attachments/assets/a94f83bc-98bc-4d18-8f45-a3a7c15efaef" /> The image I used is a image which supported BlackWell architecture GPU(I am using Nvidia RTX 5070 Ti), which I think is not the cause for the issue. ### Information - [x] Docker - [ ] The CLI directly ### Tasks - [ ] An officially supported command - [ ] My own modifications ### Reproduction 1、Download model using huggingface_hub.snapshot_download with cache_dir configured 2、Mount the cache_dir to `/data` path in container 3、Start the container. ### Expected behavior The TEI just load the model weight from my local path and It won't take that long waiting for the service to be ready.
关闭于 2025-12-31 1 条评论