ITADN

Loading the model with quantized weights , two times corrupts the model

#18Closedbrappier 创建于 2023-12-09
B
brappiercommented
to reproduce call the load weights function two times and run the model . you get NaNs. Does not happen with normal fp16/32 weights ``` graph.openStore(sdxl_model_path) { $0.read("unet", model: unet , codec: [.q6p, .q8p, .jit, .ezm7] ) } graph.openStore(sdxl_model_path) { $0.read("unet", model: unet , codec: [.q6p, .q8p, .jit, .ezm7] ) } ```
关闭于 2023-12-13 5 条评论