增加docker 命令
docker run -d \
--name gpt_server \
--shm-size 32g \
--restart always \
-p 8010:8082 \
-p 21001:21001 \
-e TZ=Asia/Shanghai \
-v "$(pwd)/gpt_server:/gpt_server/gpt_server" \
-v "/data3/llm_model/:/home/dev/model/" \
-v "/data3/embeddings_model/:/home/dev/embeddings_model/" \
--gpus all \
docker.1ms.run/506610466/gpt_server:latest \
python gpt_server/serving/main.py
关闭于 2025-09-21 2 条评论