Bug: can't detect graphics card
bughigh severity
### Contact Details
seaeye777@gmail.com
### What happened?
I'm using Windows 11 and llamafile, but it can't detect my graphics card.
### Version
llamafile v0.10.1
### What operating system are you seeing the problem on?
Windows
### Relevant log output
```shell
llamafile.exe --port 8172 --threads 8 --ctx-size 4096 --batch-size 512 --reasoning off --reasoning-format none --reasoning-budget 0 --server --jinja --host 127.0.0.1 --verbose --model D:\llm\models--unsloth--Qwen3.5-0.8B-GGUF\snapshots\6ab461498e2023f6e3c1baea90a8f0fe38ab64d0\Qwen3.5-0.8B-UD-Q6_K_XL.gguf --mmproj D:\llm\models--unsloth--Qwen3.5-0.8B-GGUF\snapshots\6ab461498e2023f6e3c1baea90a8f0fe38ab64d0\mmproj-BF16.gguf --n-gpu-layers 0
warning: no usable GPU found, --gpu-layers option will be ignored
warning: one possible reason is that llama.cpp was compiled without GPU support
warning: consult docs/build.md for compilation instructions
server_main: n_parallel is set to auto, using n_parallel = 4 and kv_unified = true
build_info: b1777559360-5e9c63546
system_info: n_threads = 8 (n_threads_batch = 8) / 12 | CPU : LLAMAFILE = 1 | OPENMP = 1 | REPACK = 1 |
init: using 11 threads for HTTP server
start: binding port with default address family
server_main: loading model
nvidia-smi
Sun May 3 13:17:05 2026
+-----------------------------------------------------------------------------------------+
| NVIDIA-SMI 591.86 Driver Version: 591.86 CUDA Version: 13.1 |
+-----------------------------------------+------------------------+----------------------+
| GPU Name Driver-Model | Bus-Id Disp.A | Volatile Uncorr. ECC |
| Fan Temp Perf Pwr:Usage/Cap | Memory-Usage | GPU-Util Compute M. |
| | | MIG M. |
|=========================================+========================+======================|
| 0 NVIDIA GeForce RTX 3060 WDDM | 00000000:01:00.0 On | N/A |
| 0% 50C P0 26W / 170W | 4388MiB / 12288MiB | 1% Default |
| | | N/A |
+-----------------------------------------+------------------------+----------------------+
+-----------------------------------------------------------------------------------------+
| Processes: |
| GPU GI CI PID Type Process name GPU Memory |
| ID ID Usage |
|=========================================================================================|
| 0 N/A N/A 2100 C+G ...0.3650.139\msedgewebview2.exe N/A |
| 0 N/A N/A 4140 C+G ...5n1h2txyewy\TextInputHost.exe N/A |
| 0 N/A N/A 4652 C+G ..._cw5n1h2txyewy\SearchHost.exe N/A |
| 0 N/A N/A 6616 C+G ...indows\System32\ShellHost.exe N/A |
| 0 N/A N/A 7888 C+G C:\Windows\explorer.exe N/A |
| 0 N/A N/A 8540 C+G ...s\TencentDocs\TencentDocs.exe N/A |
| 0 N/A N/A 9904 C+G ...s\Antigravity\Antigravity.exe N/A |
| 0 N/A N/A 12532 C+G ...yb3d8bbwe\WindowsTerminal.exe N/A |
| 0 N/A N/A 12644 C+G ...ao\Application\app\Doubao.exe N/A |
| 0 N/A N/A 21212 C+G ...y\StartMenuExperienceHost.exe N/A |
| 0 N/A N/A 21436 C+G ...em32\ApplicationFrameHost.exe N/A |
| 0 N/A N/A 25388 C+G ...yb3d8bbwe\Notepad\Notepad.exe N/A |
| 0 N/A N/A 26080 C+G ...xyewy\ShellExperienceHost.exe N/A |
| 0 N/A N/A 27512 C+G ...App_cw5n1h2txyewy\LockApp.exe N/A |
| 0 N/A N/A 27868 C+G ...les\Tencent\Weixin\Weixin.exe N/A |
| 0 N/A N/A 32148 C+G ...ram Files\FlClash\FlClash.exe N/A |
| 0 N/A N/A 33680 C+G ...ge-WebView\msedgewebview2.exe N/A |
| 0 N/A N/A 34476 C+G ...acted\runtime\WeChatAppEx.exe N/A |
| 0 N/A N/A 36360 C+G ...\Programs\Termius\Termius.exe N/A |
| 0 N/A N/A 38856 C+G ...Chrome\Application\chrome.exe N/A |
| 0 N/A N/A 43956 C+G ...Chrome\Application\chrome.exe N/A |
+-----------------------------------------------------------------------------------------+
```
0 条评论