ITADN

twnlp/ChineseErrorCorrector3-4B调用出错

#580Opennjfanxun 创建于 2025-12-18
question
N
njfanxuncommented
### Describe the Question 调用代码: m3=GptCorrector(model_name_or_path=model_path) corrected_dict = m3.correct_batch(error_sentences,prefix_prompt='你是一个文本纠错专家,纠正输入句子中的语法错误,并输出正确的句子,输入句子为:') 输出: Generating outputs: 0%| | 0/1 [00:00<?, ?it/s]The attention mask is not set and cannot be inferred from input because pad token is same as eos token. As a consequence, you may observe unexpected behavior. Please pass your input's `attention_mask` to obtain reliable results. 然后程序就卡着不动,造成服务器卡死,只能重启。是因为模型没有生成结束,在一直重试吗?耗尽服务器资源? https://huggingface.co/twnlp/ChineseErrorCorrector3-4B中,使用的方法 text = tokenizer.apply_chat_template( messages, tokenize=False, add_generation_prompt=True, enable_thinking=False # Switches between thinking and non-thinking modes. Default is True. ) 而gpt_model.py参数有差别,这个有问题吗?
1 条评论