NotImplementedError
File "/gpt_server/gpt_server/model_worker/embedding.py", line 60, in __init__
self.client.to("cuda") # or 'cpu' if no GPU is available
启动rerank模型时出现如下问题,有相关的解决经验吗?
NotImplementedError: Cannot copy out of meta tensor; no data! Please use torch.nn.Module.to_empty() instead of torch.nn.Module.to() when moving module from meta to a different device.
关闭于 2025-06-22 2 条评论