[Bug] Compiling Qwen3-Embedding model fails

## 🐛 Bug I have been trying to compile **[Qwen/Qwen3-Embedding-0.6B*](https://huggingface.co/Qwen/Qwen3-Embedding-0.6B)* I've installed mlc-llm and trying to run this command: python -m mlc_llm convert_weight "/path/Qwen3-Embedding-0.6B" --quantization q4f16_1 --output "/path/Qwen3-Embedding-0.6B-MLC" It failed and returned this error: ``` [2025-12-31 19:38:50] INFO auto_config.py:116: Found model configuration: /path/Qwen3-Embedding-0.6B/config.json [2025-12-31 19:38:53] INFO auto_device.py:93: Not found device: cuda:0 [2025-12-31 19:38:55] INFO auto_device.py:93: Not found device: rocm:0 [2025-12-31 19:38:57] INFO auto_device.py:93: Not found device: metal:0 [2025-12-31 19:39:00] INFO auto_device.py:93: Not found device: vulkan:0 [2025-12-31 19:39:02] INFO auto_device.py:93: Not found device: opencl:0 [2025-12-31 19:39:04] INFO auto_device.py:82: Found device: cpu:0 [2025-12-31 19:39:04] INFO auto_device.py:36: Using device: cpu:0 [2025-12-31 19:39:04] INFO auto_weight.py:71: Finding weights in: /path/Qwen3-Embedding-0.6B [2025-12-31 19:39:04] INFO auto_weight.py:137: Not found Huggingface PyTorch [2025-12-31 19:39:04] INFO auto_weight.py:144: Found source weight format: huggingface-safetensor. Source configuration: /path/Qwen3-Embedding-0.6B/model.safetensors.index.json [2025-12-31 19:39:04] INFO auto_weight.py:107: Using source weight configuration: /path/Qwen3-Embedding-0.6B/model.safetensors.index.json. Use `--source` to override. [2025-12-31 19:39:04] INFO auto_weight.py:111: Using source weight format: huggingface-safetensor. Use `--source-format` to override. [2025-12-31 19:39:04] INFO auto_config.py:154: Found model type: qwen3. Use `--model-type` to override. Weight conversion with arguments: --config /path/Qwen3-Embedding-0.6B/config.json --quantization GroupQuantize(name='q4f16_1', kind='group-quant', group_size=32, quantize_dtype='int4', storage_dtype='uint32', model_dtype='float16', linear_weight_layout='NK', quantize_embedding=True, quantize_final_fc=True, num_elem_per_storage=8, num_storage_per_group=4, max_int_value=7, tensor_parallel_shards=0) --model-type qwen3 --device cpu:0 --source /path/Qwen3-Embedding-0.6B/model.safetensors.index.json --source-format huggingface-safetensor --output /path/Qwen3-Embedding-0.6B-MLC [2025-12-31 19:39:04] INFO qwen3_model.py:76: context_window_size not found in config.json. Falling back to max_position_embeddings (32768) [2025-12-31 19:39:04] INFO qwen3_model.py:90: prefill_chunk_size defaults to 2048 Start storing to cache /path/Qwen3-Embedding-0.6B-MLC [2025-12-31 19:39:05] WARNING utils.py:26: Unused extern parameters: embed_tokens.weight, layers.0.input_layernorm.weight, layers.0.mlp.down_proj.weight, layers.0.mlp.gate_proj.weight, layers.0.mlp.up_proj.weight, layers.0.post_attention_layernorm.weight, layers.0.self_attn.k_norm.weight, layers.0.self_attn.k_proj.weight, layers.0.self_attn.o_proj.weight, layers.0.self_attn.q_norm.weight, layers.0.self_attn.q_proj.weight, layers.0.self_attn.v_proj.weight, layers.1.input_layernorm.weight, layers.1.mlp.down_proj.weight, layers.1.mlp.gate_proj.weight, layers.1.mlp.up_proj.weight, layers.1.post_attention_layernorm.weight, layers.1.self_attn.k_norm.weight, layers.1.self_attn.k_proj.weight, layers.1.self_attn.o_proj.weight, layers.1.self_attn.q_norm.weight, layers.1.self_attn.q_proj.weight, layers.1.self_attn.v_proj.weight, layers.10.input_layernorm.weight, layers.10.mlp.down_proj.weight, layers.10.mlp.gate_proj.weight, layers.10.mlp.up_proj.weight, layers.10.post_attention_layernorm.weight, layers.10.self_attn.k_norm.weight, layers.10.self_attn.k_proj.weight, layers.10.self_attn.o_proj.weight, layers.10.self_attn.q_norm.weight, layers.10.self_attn.q_proj.weight, layers.10.self_attn.v_proj.weight, layers.11.input_layernorm.weight, layers.11.mlp.down_proj.weight, layers.11.mlp.gate_proj.weight, layers.11.mlp.up_proj.weight, layers.11.post_attention_layernorm.weight, layers.11.self_attn.k_norm.weight, layers.11.self_attn.k_proj.weight, layers.11.self_attn.o_proj.weight, layers.11.self_attn.q_norm.weight, layers.11.self_attn.q_proj.weight, layers.11.self_attn.v_proj.weight, layers.12.input_layernorm.weight, layers.12.mlp.down_proj.weight, layers.12.mlp.gate_proj.weight, layers.12.mlp.up_proj.weight, layers.12.post_attention_layernorm.weight, layers.12.self_attn.k_norm.weight, layers.12.self_attn.k_proj.weight, layers.12.self_attn.o_proj.weight, layers.12.self_attn.q_norm.weight, layers.12.self_attn.q_proj.weight, layers.12.self_attn.v_proj.weight, layers.13.input_layernorm.weight, layers.13.mlp.down_proj.weight, layers.13.mlp.gate_proj.weight, layers.13.mlp.up_proj.weight, layers.13.post_attention_layernorm.weight, layers.13.self_attn.k_norm.weight, layers.13.self_attn.k_proj.weight, layers.13.self_attn.o_proj.weight, layers.13.self_attn.q_norm.weight, layers.13.self_attn.q_proj.weight, layers.13.self_attn.v_proj.weight, layers.14.input_layernorm.weight, layers.14.mlp.down_proj.weight, layers.14.mlp.gate_proj.weight, layers.14.mlp.up_proj.weight, layers.14.post_attention_layernorm.weight, layers.14.self_attn.k_norm.weight, layers.14.self_attn.k_proj.weight, layers.14.self_attn.o_proj.weight, layers.14.self_attn.q_norm.weight, layers.14.self_attn.q_proj.weight, layers.14.self_attn.v_proj.weight, layers.15.input_layernorm.weight, layers.15.mlp.down_proj.weight, layers.15.mlp.gate_proj.weight, layers.15.mlp.up_proj.weight, layers.15.post_attention_layernorm.weight, layers.15.self_attn.k_norm.weight, layers.15.self_attn.k_proj.weight, layers.15.self_attn.o_proj.weight, layers.15.self_attn.q_norm.weight, layers.15.self_attn.q_proj.weight, layers.15.self_attn.v_proj.weight, layers.16.input_layernorm.weight, layers.16.mlp.down_proj.weight, layers.16.mlp.gate_proj.weight, layers.16.mlp.up_proj.weight, layers.16.post_attention_layernorm.weight, layers.16.self_attn.k_norm.weight, layers.16.self_attn.k_proj.weight, layers.16.self_attn.o_proj.weight, layers.16.self_attn.q_norm.weight, layers.16.self_attn.q_proj.weight, layers.16.self_attn.v_proj.weight, layers.17.input_layernorm.weight, layers.17.mlp.down_proj.weight, layers.17.mlp.gate_proj.weight, layers.17.mlp.up_proj.weight, layers.17.post_attention_layernorm.weight, layers.17.self_attn.k_norm.weight, layers.17.self_attn.k_proj.weight, layers.17.self_attn.o_proj.weight, layers.17.self_attn.q_norm.weight, layers.17.self_attn.q_proj.weight, layers.17.self_attn.v_proj.weight, layers.18.input_layernorm.weight, layers.18.mlp.down_proj.weight, layers.18.mlp.gate_proj.weight, layers.18.mlp.up_proj.weight, layers.18.post_attention_layernorm.weight, layers.18.self_attn.k_norm.weight, layers.18.self_attn.k_proj.weight, layers.18.self_attn.o_proj.weight, layers.18.self_attn.q_norm.weight, layers.18.self_attn.q_proj.weight, layers.18.self_attn.v_proj.weight, layers.19.input_layernorm.weight, layers.19.mlp.down_proj.weight, layers.19.mlp.gate_proj.weight, layers.19.mlp.up_proj.weight, layers.19.post_attention_layernorm.weight, layers.19.self_attn.k_norm.weight, layers.19.self_attn.k_proj.weight, layers.19.self_attn.o_proj.weight, layers.19.self_attn.q_norm.weight, layers.19.self_attn.q_proj.weight, layers.19.self_attn.v_proj.weight, layers.2.input_layernorm.weight, layers.2.mlp.down_proj.weight, layers.2.mlp.gate_proj.weight, layers.2.mlp.up_proj.weight, layers.2.post_attention_layernorm.weight, layers.2.self_attn.k_norm.weight, layers.2.self_attn.k_proj.weight, layers.2.self_attn.o_proj.weight, layers.2.self_attn.q_norm.weight, layers.2.self_attn.q_proj.weight, layers.2.self_attn.v_proj.weight, layers.20.input_layernorm.weight, layers.20.mlp.down_proj.weight, layers.20.mlp.gate_proj.weight, layers.20.mlp.up_proj.weight, layers.20.post_attention_layernorm.weight, layers.20.self_attn.k_norm.weight, layers.20.self_attn.k_proj.weight, layers.20.self_attn.o_proj.weight, layers.20.self_attn.q_norm.weight, layers.20.self_attn.q_proj.weight, layers.20.self_attn.v_proj.weight, layers.21.input_layernorm.weight, layers.21.mlp.down_proj.weight, layers.21.mlp.gate_proj.weight, layers.21.mlp.up_proj.weight, layers.21.post_attention_layernorm.weight, layers.21.self_attn.k_norm.weight, layers.21.self_attn.k_proj.weight, layers.21.self_attn.o_proj.weight, layers.21.self_attn.q_norm.weight, layers.21.self_attn.q_proj.weight, layers.21.self_attn.v_proj.weight, layers.22.input_layernorm.weight, layers.22.mlp.down_proj.weight, layers.22.mlp.gate_proj.weight, layers.22.mlp.up_proj.weight, layers.22.post_attention_layernorm.weight, layers.22.self_attn.k_norm.weight, layers.22.self_attn.k_proj.weight, layers.22.self_attn.o_proj.weight, layers.22.self_attn.q_norm.weight, layers.22.self_attn.q_proj.weight, layers.22.self_attn.v_proj.weight, layers.23.input_layernorm.weight, layers.23.mlp.down_proj.weight, layers.23.mlp.gate_proj.weight, layers.23.mlp.up_proj.weight, layers.23.post_attention_layernorm.weight, layers.23.self_attn.k_norm.weight, layers.23.self_attn.k_proj.weight, layers.23.self_attn.o_proj.weight, layers.23.self_attn.q_norm.weight, layers.23.self_attn.q_proj.weight, layers.23.self_attn.v_proj.weight, layers.24.input_layernorm.weight, layers.24.mlp.down_proj.weight, layers.24.mlp.gate_proj.weight, layers.24.mlp.up_proj.weight, layers.24.post_attention_layernorm.weight, layers.24.self_attn.k_norm.weight, layers.24.self_attn.k_proj.weight, layers.24.self_attn.o_proj.weight, layers.24.self_attn.q_norm.weight, layers.24.self_attn.q_proj.weight, layers.24.self_attn.v_proj.weight, layers.25.input_layernorm.weight, layers.25.mlp.down_proj.weight, layers.25.mlp.gate_proj.weight, layers.25.mlp.up_proj.weight, layers.25.post_attention_layernorm.weight, layers.25.self_attn.k_norm.weight, layers.25.self_attn.k_proj.weight, layers.25.self_attn.o_proj.weight, layers.25.self_attn.q_norm.weight, layers.25.self_attn.q_proj.weight, layers.25.self_attn.v_proj.weight, layers.26.input_layernorm.weight, layers.26.mlp.down_proj.weight, layers.26.mlp.gate_proj.weight, layers.26.mlp.up_proj.weight, layers.26.post_attention_layernorm.weight, layers.26.self_attn.k_norm.weight, layers.26.self_attn.k_proj.weight, layers.26.self_attn.o_proj.weight, layers.26.self_attn.q_norm.weight, layers.26.self_attn.q_proj.weight, layers.26.self_attn.v_proj.weight, layers.27.input_layernorm.weight, layers.27.mlp.down_proj.weight, layers.27.mlp.gate_proj.weight, layers.27.mlp.up_proj.weight, layers.27.post_attention_layernorm.weight, layers.27.self_attn.k_norm.weight, layers.27.self_attn.k_proj.weight, layers.27.self_attn.o_proj.weight, layers.27.self_attn.q_norm.weight, layers.27.self_attn.q_proj.weight, layers.27.self_attn.v_proj.weight, layers.3.input_layernorm.weight, layers.3.mlp.down_proj.weight, layers.3.mlp.gate_proj.weight, layers.3.mlp.up_proj.weight, layers.3.post_attention_layernorm.weight, layers.3.self_attn.k_norm.weight, layers.3.self_attn.k_proj.weight, layers.3.self_attn.o_proj.weight, layers.3.self_attn.q_norm.weight, layers.3.self_attn.q_proj.weight, layers.3.self_attn.v_proj.weight, layers.4.input_layernorm.weight, layers.4.mlp.down_proj.weight, layers.4.mlp.gate_proj.weight, layers.4.mlp.up_proj.weight, layers.4.post_attention_layernorm.weight, layers.4.self_attn.k_norm.weight, layers.4.self_attn.k_proj.weight, layers.4.self_attn.o_proj.weight, layers.4.self_attn.q_norm.weight, layers.4.self_attn.q_proj.weight, layers.4.self_attn.v_proj.weight, layers.5.input_layernorm.weight, layers.5.mlp.down_proj.weight, layers.5.mlp.gate_proj.weight, layers.5.mlp.up_proj.weight, layers.5.post_attention_layernorm.weight, layers.5.self_attn.k_norm.weight, layers.5.self_attn.k_proj.weight, layers.5.self_attn.o_proj.weight, layers.5.self_attn.q_norm.weight, layers.5.self_attn.q_proj.weight, layers.5.self_attn.v_proj.weight, layers.6.input_layernorm.weight, layers.6.mlp.down_proj.weight, layers.6.mlp.gate_proj.weight, layers.6.mlp.up_proj.weight, layers.6.post_attention_layernorm.weight, layers.6.self_attn.k_norm.weight, layers.6.self_attn.k_proj.weight, layers.6.self_attn.o_proj.weight, layers.6.self_attn.q_norm.weight, layers.6.self_attn.q_proj.weight, layers.6.self_attn.v_proj.weight, layers.7.input_layernorm.weight, layers.7.mlp.down_proj.weight, layers.7.mlp.gate_proj.weight, layers.7.mlp.up_proj.weight, layers.7.post_attention_layernorm.weight, layers.7.self_attn.k_norm.weight, layers.7.self_attn.k_proj.weight, layers.7.self_attn.o_proj.weight, layers.7.self_attn.q_norm.weight, layers.7.self_attn.q_proj.weight, layers.7.self_attn.v_proj.weight, layers.8.input_layernorm.weight, layers.8.mlp.down_proj.weight, layers.8.mlp.gate_proj.weight, layers.8.mlp.up_proj.weight, layers.8.post_attention_layernorm.weight, layers.8.self_attn.k_norm.weight, layers.8.self_attn.k_proj.weight, layers.8.self_attn.o_proj.weight, layers.8.self_attn.q_norm.weight, layers.8.self_attn.q_proj.weight, layers.8.self_attn.v_proj.weight, layers.9.input_layernorm.weight, layers.9.mlp.down_proj.weight, layers.9.mlp.gate_proj.weight, layers.9.mlp.up_proj.weight, layers.9.post_attention_layernorm.weight, layers.9.self_attn.k_norm.weight, layers.9.self_attn.k_proj.weight, layers.9.self_attn.o_proj.weight, layers.9.self_attn.q_norm.weight, layers.9.self_attn.q_proj.weight, layers.9.self_attn.v_proj.weight, norm.weight Traceback (most recent call last): File "/usr/lib/python3.10/runpy.py", line 196, in _run_module_as_main return _run_code(code, main_globals, None, File "/usr/lib/python3.10/runpy.py", line 86, in _run_code exec(code, run_globals) File "/home/daniq/envs/mlc_llm_test/lib/python3.10/site-packages/mlc_llm/__main__.py", line 69, in <module> main() File "/home/daniq/envs/mlc_llm_test/lib/python3.10/site-packages/mlc_llm/__main__.py", line 38, in main cli.main(sys.argv[2:]) File "/home/daniq/envs/mlc_llm_test/lib/python3.10/site-packages/mlc_llm/cli/convert_weight.py", line 88, in main convert_weight( File "/home/daniq/envs/mlc_llm_test/lib/python3.10/site-packages/mlc_llm/interface/convert_weight.py", line 181, in convert_weight _convert_args(args) File "/home/daniq/envs/mlc_llm_test/lib/python3.10/site-packages/mlc_llm/interface/convert_weight.py", line 145, in _convert_args tvmjs.dump_tensor_cache( File "/home/daniq/envs/mlc_llm_test/lib/python3.10/site-packages/tvm/contrib/tvmjs.py", line 273, in dump_tensor_cache for k, origin_v in param_generator: File "/home/daniq/envs/mlc_llm_test/lib/python3.10/site-packages/mlc_llm/interface/convert_weight.py", line 122, in _param_generator loader = LOADER[args.source_format]( File "/home/daniq/envs/mlc_llm_test/lib/python3.10/site-packages/mlc_llm/loader/huggingface_loader.py", line 99, in __init__ check_parameter_usage(extern_param_map, set(self.torch_to_path.keys())) File "/home/daniq/envs/mlc_llm_test/lib/python3.10/site-packages/mlc_llm/loader/utils.py", line 33, in check_parameter_usage raise ValueError( ValueError: The following extern parameters do not exist in the weight files: model.embed_tokens.weight model.layers.0.input_layernorm.weight model.layers.0.mlp.down_proj.weight model.layers.0.mlp.gate_proj.weight model.layers.0.mlp.up_proj.weight model.layers.0.post_attention_layernorm.weight model.layers.0.self_attn.k_norm.weight model.layers.0.self_attn.k_proj.weight model.layers.0.self_attn.o_proj.weight model.layers.0.self_attn.q_norm.weight model.layers.0.self_attn.q_proj.weight model.layers.0.self_attn.v_proj.weight model.layers.1.input_layernorm.weight model.layers.1.mlp.down_proj.weight model.layers.1.mlp.gate_proj.weight model.layers.1.mlp.up_proj.weight model.layers.1.post_attention_layernorm.weight model.layers.1.self_attn.k_norm.weight model.layers.1.self_attn.k_proj.weight model.layers.1.self_attn.o_proj.weight model.layers.1.self_attn.q_norm.weight model.layers.1.self_attn.q_proj.weight model.layers.1.self_attn.v_proj.weight model.layers.10.input_layernorm.weight model.layers.10.mlp.down_proj.weight model.layers.10.mlp.gate_proj.weight model.layers.10.mlp.up_proj.weight model.layers.10.post_attention_layernorm.weight model.layers.10.self_attn.k_norm.weight model.layers.10.self_attn.k_proj.weight model.layers.10.self_attn.o_proj.weight model.layers.10.self_attn.q_norm.weight model.layers.10.self_attn.q_proj.weight model.layers.10.self_attn.v_proj.weight model.layers.11.input_layernorm.weight model.layers.11.mlp.down_proj.weight model.layers.11.mlp.gate_proj.weight model.layers.11.mlp.up_proj.weight model.layers.11.post_attention_layernorm.weight model.layers.11.self_attn.k_norm.weight model.layers.11.self_attn.k_proj.weight model.layers.11.self_attn.o_proj.weight model.layers.11.self_attn.q_norm.weight model.layers.11.self_attn.q_proj.weight model.layers.11.self_attn.v_proj.weight model.layers.12.input_layernorm.weight model.layers.12.mlp.down_proj.weight model.layers.12.mlp.gate_proj.weight model.layers.12.mlp.up_proj.weight model.layers.12.post_attention_layernorm.weight model.layers.12.self_attn.k_norm.weight model.layers.12.self_attn.k_proj.weight model.layers.12.self_attn.o_proj.weight model.layers.12.self_attn.q_norm.weight model.layers.12.self_attn.q_proj.weight model.layers.12.self_attn.v_proj.weight model.layers.13.input_layernorm.weight model.layers.13.mlp.down_proj.weight model.layers.13.mlp.gate_proj.weight model.layers.13.mlp.up_proj.weight model.layers.13.post_attention_layernorm.weight model.layers.13.self_attn.k_norm.weight model.layers.13.self_attn.k_proj.weight model.layers.13.self_attn.o_proj.weight model.layers.13.self_attn.q_norm.weight model.layers.13.self_attn.q_proj.weight model.layers.13.self_attn.v_proj.weight model.layers.14.input_layernorm.weight model.layers.14.mlp.down_proj.weight model.layers.14.mlp.gate_proj.weight model.layers.14.mlp.up_proj.weight model.layers.14.post_attention_layernorm.weight model.layers.14.self_attn.k_norm.weight model.layers.14.self_attn.k_proj.weight model.layers.14.self_attn.o_proj.weight model.layers.14.self_attn.q_norm.weight model.layers.14.self_attn.q_proj.weight model.layers.14.self_attn.v_proj.weight model.layers.15.input_layernorm.weight model.layers.15.mlp.down_proj.weight model.layers.15.mlp.gate_proj.weight model.layers.15.mlp.up_proj.weight model.layers.15.post_attention_layernorm.weight model.layers.15.self_attn.k_norm.weight model.layers.15.self_attn.k_proj.weight model.layers.15.self_attn.o_proj.weight model.layers.15.self_attn.q_norm.weight model.layers.15.self_attn.q_proj.weight model.layers.15.self_attn.v_proj.weight model.layers.16.input_layernorm.weight model.layers.16.mlp.down_proj.weight model.layers.16.mlp.gate_proj.weight model.layers.16.mlp.up_proj.weight model.layers.16.post_attention_layernorm.weight model.layers.16.self_attn.k_norm.weight model.layers.16.self_attn.k_proj.weight model.layers.16.self_attn.o_proj.weight model.layers.16.self_attn.q_norm.weight model.layers.16.self_attn.q_proj.weight model.layers.16.self_attn.v_proj.weight model.layers.17.input_layernorm.weight model.layers.17.mlp.down_proj.weight model.layers.17.mlp.gate_proj.weight model.layers.17.mlp.up_proj.weight model.layers.17.post_attention_layernorm.weight model.layers.17.self_attn.k_norm.weight model.layers.17.self_attn.k_proj.weight model.layers.17.self_attn.o_proj.weight model.layers.17.self_attn.q_norm.weight model.layers.17.self_attn.q_proj.weight model.layers.17.self_attn.v_proj.weight model.layers.18.input_layernorm.weight model.layers.18.mlp.down_proj.weight model.layers.18.mlp.gate_proj.weight model.layers.18.mlp.up_proj.weight model.layers.18.post_attention_layernorm.weight model.layers.18.self_attn.k_norm.weight model.layers.18.self_attn.k_proj.weight model.layers.18.self_attn.o_proj.weight model.layers.18.self_attn.q_norm.weight model.layers.18.self_attn.q_proj.weight model.layers.18.self_attn.v_proj.weight model.layers.19.input_layernorm.weight model.layers.19.mlp.down_proj.weight model.layers.19.mlp.gate_proj.weight model.layers.19.mlp.up_proj.weight model.layers.19.post_attention_layernorm.weight model.layers.19.self_attn.k_norm.weight model.layers.19.self_attn.k_proj.weight model.layers.19.self_attn.o_proj.weight model.layers.19.self_attn.q_norm.weight model.layers.19.self_attn.q_proj.weight model.layers.19.self_attn.v_proj.weight model.layers.2.input_layernorm.weight model.layers.2.mlp.down_proj.weight model.layers.2.mlp.gate_proj.weight model.layers.2.mlp.up_proj.weight model.layers.2.post_attention_layernorm.weight model.layers.2.self_attn.k_norm.weight model.layers.2.self_attn.k_proj.weight model.layers.2.self_attn.o_proj.weight model.layers.2.self_attn.q_norm.weight model.layers.2.self_attn.q_proj.weight model.layers.2.self_attn.v_proj.weight model.layers.20.input_layernorm.weight model.layers.20.mlp.down_proj.weight model.layers.20.mlp.gate_proj.weight model.layers.20.mlp.up_proj.weight model.layers.20.post_attention_layernorm.weight model.layers.20.self_attn.k_norm.weight model.layers.20.self_attn.k_proj.weight model.layers.20.self_attn.o_proj.weight model.layers.20.self_attn.q_norm.weight model.layers.20.self_attn.q_proj.weight model.layers.20.self_attn.v_proj.weight model.layers.21.input_layernorm.weight model.layers.21.mlp.down_proj.weight model.layers.21.mlp.gate_proj.weight model.layers.21.mlp.up_proj.weight model.layers.21.post_attention_layernorm.weight model.layers.21.self_attn.k_norm.weight model.layers.21.self_attn.k_proj.weight model.layers.21.self_attn.o_proj.weight model.layers.21.self_attn.q_norm.weight model.layers.21.self_attn.q_proj.weight model.layers.21.self_attn.v_proj.weight model.layers.22.input_layernorm.weight model.layers.22.mlp.down_proj.weight model.layers.22.mlp.gate_proj.weight model.layers.22.mlp.up_proj.weight model.layers.22.post_attention_layernorm.weight model.layers.22.self_attn.k_norm.weight model.layers.22.self_attn.k_proj.weight model.layers.22.self_attn.o_proj.weight model.layers.22.self_attn.q_norm.weight model.layers.22.self_attn.q_proj.weight model.layers.22.self_attn.v_proj.weight model.layers.23.input_layernorm.weight model.layers.23.mlp.down_proj.weight model.layers.23.mlp.gate_proj.weight model.layers.23.mlp.up_proj.weight model.layers.23.post_attention_layernorm.weight model.layers.23.self_attn.k_norm.weight model.layers.23.self_attn.k_proj.weight model.layers.23.self_attn.o_proj.weight model.layers.23.self_attn.q_norm.weight model.layers.23.self_attn.q_proj.weight model.layers.23.self_attn.v_proj.weight model.layers.24.input_layernorm.weight model.layers.24.mlp.down_proj.weight model.layers.24.mlp.gate_proj.weight model.layers.24.mlp.up_proj.weight model.layers.24.post_attention_layernorm.weight model.layers.24.self_attn.k_norm.weight model.layers.24.self_attn.k_proj.weight model.layers.24.self_attn.o_proj.weight model.layers.24.self_attn.q_norm.weight model.layers.24.self_attn.q_proj.weight model.layers.24.self_attn.v_proj.weight model.layers.25.input_layernorm.weight model.layers.25.mlp.down_proj.weight model.layers.25.mlp.gate_proj.weight model.layers.25.mlp.up_proj.weight model.layers.25.post_attention_layernorm.weight model.layers.25.self_attn.k_norm.weight model.layers.25.self_attn.k_proj.weight model.layers.25.self_attn.o_proj.weight model.layers.25.self_attn.q_norm.weight model.layers.25.self_attn.q_proj.weight model.layers.25.self_attn.v_proj.weight model.layers.26.input_layernorm.weight model.layers.26.mlp.down_proj.weight model.layers.26.mlp.gate_proj.weight model.layers.26.mlp.up_proj.weight model.layers.26.post_attention_layernorm.weight model.layers.26.self_attn.k_norm.weight model.layers.26.self_attn.k_proj.weight model.layers.26.self_attn.o_proj.weight model.layers.26.self_attn.q_norm.weight model.layers.26.self_attn.q_proj.weight model.layers.26.self_attn.v_proj.weight model.layers.27.input_layernorm.weight model.layers.27.mlp.down_proj.weight model.layers.27.mlp.gate_proj.weight model.layers.27.mlp.up_proj.weight model.layers.27.post_attention_layernorm.weight model.layers.27.self_attn.k_norm.weight model.layers.27.self_attn.k_proj.weight model.layers.27.self_attn.o_proj.weight model.layers.27.self_attn.q_norm.weight model.layers.27.self_attn.q_proj.weight model.layers.27.self_attn.v_proj.weight model.layers.3.input_layernorm.weight model.layers.3.mlp.down_proj.weight model.layers.3.mlp.gate_proj.weight model.layers.3.mlp.up_proj.weight model.layers.3.post_attention_layernorm.weight model.layers.3.self_attn.k_norm.weight model.layers.3.self_attn.k_proj.weight model.layers.3.self_attn.o_proj.weight model.layers.3.self_attn.q_norm.weight model.layers.3.self_attn.q_proj.weight model.layers.3.self_attn.v_proj.weight model.layers.4.input_layernorm.weight model.layers.4.mlp.down_proj.weight model.layers.4.mlp.gate_proj.weight model.layers.4.mlp.up_proj.weight model.layers.4.post_attention_layernorm.weight model.layers.4.self_attn.k_norm.weight model.layers.4.self_attn.k_proj.weight model.layers.4.self_attn.o_proj.weight model.layers.4.self_attn.q_norm.weight model.layers.4.self_attn.q_proj.weight model.layers.4.self_attn.v_proj.weight model.layers.5.input_layernorm.weight model.layers.5.mlp.down_proj.weight model.layers.5.mlp.gate_proj.weight model.layers.5.mlp.up_proj.weight model.layers.5.post_attention_layernorm.weight model.layers.5.self_attn.k_norm.weight model.layers.5.self_attn.k_proj.weight model.layers.5.self_attn.o_proj.weight model.layers.5.self_attn.q_norm.weight model.layers.5.self_attn.q_proj.weight model.layers.5.self_attn.v_proj.weight model.layers.6.input_layernorm.weight model.layers.6.mlp.down_proj.weight model.layers.6.mlp.gate_proj.weight model.layers.6.mlp.up_proj.weight model.layers.6.post_attention_layernorm.weight model.layers.6.self_attn.k_norm.weight model.layers.6.self_attn.k_proj.weight model.layers.6.self_attn.o_proj.weight model.layers.6.self_attn.q_norm.weight model.layers.6.self_attn.q_proj.weight model.layers.6.self_attn.v_proj.weight model.layers.7.input_layernorm.weight model.layers.7.mlp.down_proj.weight model.layers.7.mlp.gate_proj.weight model.layers.7.mlp.up_proj.weight model.layers.7.post_attention_layernorm.weight model.layers.7.self_attn.k_norm.weight model.layers.7.self_attn.k_proj.weight model.layers.7.self_attn.o_proj.weight model.layers.7.self_attn.q_norm.weight model.layers.7.self_attn.q_proj.weight model.layers.7.self_attn.v_proj.weight model.layers.8.input_layernorm.weight model.layers.8.mlp.down_proj.weight model.layers.8.mlp.gate_proj.weight model.layers.8.mlp.up_proj.weight model.layers.8.post_attention_layernorm.weight model.layers.8.self_attn.k_norm.weight model.layers.8.self_attn.k_proj.weight model.layers.8.self_attn.o_proj.weight model.layers.8.self_attn.q_norm.weight model.layers.8.self_attn.q_proj.weight model.layers.8.self_attn.v_proj.weight model.layers.9.input_layernorm.weight model.layers.9.mlp.down_proj.weight model.layers.9.mlp.gate_proj.weight model.layers.9.mlp.up_proj.weight model.layers.9.post_attention_layernorm.weight model.layers.9.self_attn.k_norm.weight model.layers.9.self_attn.k_proj.weight model.layers.9.self_attn.o_proj.weight model.layers.9.self_attn.q_norm.weight model.layers.9.self_attn.q_proj.weight model.layers.9.self_attn.v_proj.weight model.norm.weight ``` ## Environment - Platform CPU: - Operating system Windows 11, but using Ubuntu WSL: - Installed through pip - Python version 3.10: