ITADN

Some questions regarding the 6-8 bit models?

#53Closedbrappier 创建于 2023-11-21
B
brappiercommented
I had a few questions: I am getting a huge difference in performance when i load sd_xl_base_1.0_f16.ckpt vs sd_xl_base_1.0_q6p_q8p.ckpt. The codec in openStore is not set in both cased. The memory used is also the same in both cases. But when i load sd_xl_base_1.0_q6p_q8p, its much faster. Why is the case? I thought if i dont use any `codec` then it would just cast all the weights in fp16 format
关闭于 2023-11-22 2 条评论