Loading the model with quantized weights , two times corrupts the model
to reproduce
call the load weights function two times and run the model . you get NaNs.
Does not happen with normal fp16/32 weights
```
graph.openStore(sdxl_model_path) {
$0.read("unet", model: unet , codec: [.q6p, .q8p, .jit, .ezm7] )
}
graph.openStore(sdxl_model_path) {
$0.read("unet", model: unet , codec: [.q6p, .q8p, .jit, .ezm7] )
}
```
关闭于 2023-12-13 5 条评论