Trying to download a model with a local disk mounted to the container
### System Info
Hi, there, why is that I have mounted a local path(with models already downloaded in the path) to the container ,,but when I start running a container with the model, it still tried to download models weights from huggingface?
<img width="3800" height="482" alt="Image" src="https://github.com/user-attachments/assets/d645084f-a64c-4374-b959-99dc7d9db6b1" />
<img width="1456" height="266" alt="Image" src="https://github.com/user-attachments/assets/a94f83bc-98bc-4d18-8f45-a3a7c15efaef" />
The image I used is a image which supported BlackWell architecture GPU(I am using Nvidia RTX 5070 Ti), which I think is not the cause for the issue.
### Information
- [x] Docker
- [ ] The CLI directly
### Tasks
- [ ] An officially supported command
- [ ] My own modifications
### Reproduction
1、Download model using huggingface_hub.snapshot_download with cache_dir configured
2、Mount the cache_dir to `/data` path in container
3、Start the container.
### Expected behavior
The TEI just load the model weight from my local path and It won't take that long waiting for the service to be ready.
关闭于 2025-12-31 1 条评论