Tracking issues for running Rust-CUDA project examples

Will get updated from time to time gemm example: - [ ] cuEventElapsedTime(pMilliseconds: 0, hStart: 0x555d9b7fda80, hEnd: 0x555d9b7ae470) -> CUDA_ERROR_NOT_SUPPORTED - [ ] cuCtxGetLimit(pvalue: 0, limit: CU_LIMIT_CIG_ENABLED) -> CUDA_ERROR_NOT_SUPPORTED disabling cuBLAS version of gemm actually works running the gemm program itself in release version and ZLUDA in release mode (without tracing) will sometimes segementation fault with this as some indicator: ``` (base) 📦[stevefan@rust-cuda2 rust-cuda]$ LD_LIBRARY_PATH="/var/home/stevefan/git/github.com/vosen/ZLUDA/target/release/trace:$LD_LIBRARY_PATH" RUST_BACKTRACE=full ZLUDA_LOG_DIR=log cargo run -p gemm --release warning: unused import: `std::error::Error` --> examples/cuda/gemm/src/main.rs:7:5 | 7 | use std::error::Error; | ^^^^^^^^^^^^^^^^^ | = note: `#[warn(unused_imports)]` on by default warning: `gemm` (bin "gemm") generated 1 warning (run `cargo fix --bin "gemm"` to apply 1 suggestion) Finished `release` profile [optimized] target(s) in 0.07s Running `target/release/gemm 2` target/release/gemm: /var/home/stevefan/git/github.com/vosen/ZLUDA/target/release/trace/libcublas.so.12: no version information available (required by target/release/gemm) [ZLUDA_TRACE] cuInit(Flags: 0) -> CUDA_SUCCESS .... Segmentation fault (core dumped) ``` EDIT: Sometimes it works, sometimes it doesn't. When it doesn't work, it seems like real cuBLAS was called? ``` [ZLUDA_TRACE] cuMemcpyHtoD_v2(dstDevice: 0x7ffee2425000, srcHost: 0x7fffffffb580, ByteCount: 4) -> CUDA_SUCCESS [ZLUDA_TRACE] cublasSetStream_v2(handle: 0x5555557a1e70, streamId: 0x555555786640) -> CUBLAS_STATUS_SUCCESS Thread 1 "gemm" received signal SIGSEGV, Segmentation fault. 0x0000000000000000 in ?? () (gdb) bt #0 0x0000000000000000 in ?? () #1 0x00007ffea457107f in ?? () from /usr/local/cuda/lib64/libcublasLt.so #2 0x00007ffea45713fe in ?? () from /usr/local/cuda/lib64/libcublasLt.so #3 0x00007ffea3b8da95 in ?? () from /usr/local/cuda/lib64/libcublasLt.so #4 0x00007ffea3b8de53 in ?? () from /usr/local/cuda/lib64/libcublasLt.so #5 0x00007ffea3beb913 in ?? () from /usr/local/cuda/lib64/libcublasLt.so #6 0x00007ffea3c93591 in ?? () from /usr/local/cuda/lib64/libcublasLt.so #7 0x00007ffea3c93963 in ?? () from /usr/local/cuda/lib64/libcublasLt.so #8 0x00007ffea3cd3237 in cublasLtSSSMatmulAlgoGetHeuristic () from /usr/local/cuda/lib64/libcublasLt.so #9 0x00007fffe9da2a62 in dark_api::cglue_fnffi::cglue_internal::cglue_wrapped_call () from /var/home/stevefan/git/github.com/vosen/ZLUDA/target/release/trace/libcublasLt.so.12 #10 0x00007ffff799263f in <zluda_trace::InternalTableImpl as dark_api::zluda_trace::CudaDarkApi>::logged_call () from /var/home/stevefan/git/github.com/vosen/ZLUDA/target/release/trace/libcuda.so.1 #11 0x00007fffe9daa458 in dark_api::zluda_trace::ZludaTraceInternal::logged_call () from /var/home/stevefan/git/github.com/vosen/ZLUDA/target/release/trace/libcublasLt.so.12 #12 0x00007fffe9d85b0d in cublasLtSSSMatmulAlgoGetHeuristic () from /var/home/stevefan/git/github.com/vosen/ZLUDA/target/release/trace/libcublasLt.so.12 #13 0x00007ffed50b0e3a in ?? () from /usr/local/cuda/lib64/libcublas.so #14 0x00007ffed50b18ca in ?? () from /usr/local/cuda/lib64/libcublas.so #15 0x00007ffed50b32e4 in ?? () from /usr/local/cuda/lib64/libcublas.so #16 0x00007ffed51d9fa5 in ?? () from /usr/local/cuda/lib64/libcublas.so #17 0x00007ffed5029046 in cublasSgemm_v2 () from /usr/local/cuda/lib64/libcublas.so --Type <RET> for more, q to quit, c to continue without paging-- #18 0x00007ffff77abd38 in dark_api::cglue_fnffi::cglue_internal::cglue_wrapped_call () from /var/home/stevefan/git/github.com/vosen/ZLUDA/target/release/trace/libcublas.so.12 #19 0x00007ffff799263f in <zluda_trace::InternalTableImpl as dark_api::zluda_trace::CudaDarkApi>::logged_call () from /var/home/stevefan/git/github.com/vosen/ZLUDA/target/release/trace/libcuda.so.1 #20 0x00007ffff77b8278 in dark_api::zluda_trace::ZludaTraceInternal::logged_call () from /var/home/stevefan/git/github.com/vosen/ZLUDA/target/release/trace/libcublas.so.12 #21 0x00007ffff776254f in cublasSgemm_v2 () from /var/home/stevefan/git/github.com/vosen/ZLUDA/target/release/trace/libcublas.so.12 #22 0x000055555559f3c9 in blastoff::level3::<impl blastoff::context::CublasContext>::gemm () #23 0x0000555555598f31 in gemm::main () #24 0x000055555559e0f3 in std::sys::backtrace::__rust_begin_short_backtrace () #25 0x000055555559e04d in std::rt::lang_start::{{closure}} () #26 0x000055555560fd50 in std::rt::lang_start_internal () #27 0x000055555559ae25 in main () ``` Also this: ``` (base) 📦[stevefan@rust-cuda2 rust-cuda]$ LD_LIBRARY_PATH="/var/home/stevefan/git/github.com/vosen/ZLUDA/target/release:$LD_LIBRARY_PATH" RUST_BACKTRACE=full ZLUDA_LOG_DIR=log cargo run -p gemm --release warning: unused import: `std::error::Error` --> examples/cuda/gemm/src/main.rs:7:5 | 7 | use std::error::Error; | ^^^^^^^^^^^^^^^^^ | = note: `#[warn(unused_imports)]` on by default warning: `gemm` (bin "gemm") generated 1 warning (run `cargo fix --bin "gemm"` to apply 1 suggestion) Finished `release` profile [optimized] target(s) in 0.05s Running `target/release/gemm` target/release/gemm: /var/home/stevefan/git/github.com/vosen/ZLUDA/target/release/libcublas.so.12: no version information available (required by target/release/gemm) Error: 0: cuBLAS error 1: CUBLAS_STATUS_NOT_SUPPORTED Location: examples/cuda/gemm/src/main.rs:69 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ BACKTRACE ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ ⋮ 3 frames hidden ⋮ 4: gemm::main::hdcf92e014a68443c at <unknown source file>:<unknown line> 5: std::sys::backtrace::__rust_begin_short_backtrace::h647250a3764fba1e at <unknown source file>:<unknown line> 6: std::rt::lang_start::{{closure}}::h09b612570f86ba9f at <unknown source file>:<unknown line> 7: std::rt::lang_start_internal::h65da7f911f7866c8 at <unknown source file>:<unknown line> 8: main<unknown> at <unknown source file>:<unknown line> 9: __libc_start_call_main<unknown> at <unknown source file>:<unknown line> 10: __libc_start_main@GLIBC_2.2.5<unknown> at <unknown source file>:<unknown line> 11: _start<unknown> at <unknown source file>:<unknown line> Run with COLORBT_SHOW_HIDDEN=1 environment variable to disable frame filtering. ``` sha2 example: Won't even run correctly, unknown error vecadd: works path tracer: didn't bother running it yet