ITADN

TensorRT 10.16 Myelin crash on Blackwell (sm_120) — Broadcast stride mismatch in SoVITS decoder

#4743Openyuchen-ya 创建于 2026-05-04
Module:Engine Build
Y
yuchen-yacommented
Environment - GPU: RTX 5080 (Blackwell, sm_120, 16GB) - Driver: 596.21 / CUDA 13.2 - TensorRT: 10.16.1.11 (pip + SDK) - ONNX exported from GPT-SoVITS v2ProPlus (opset 17) Error Building sovits.engine with trtexec --fp16 crashes with: Internal Error: MyelinCheckException: CHECK_EQ(dim_count(), stride_order().size()) failed. LHS: 4 RHS: 3 Could not find any implementation for node {ForeignNode[vq_model.ge_to512.bias + ONNXTRT_Broadcast_270.../dec/Tanh]} All 7 other engines build fine. Only sovits.onnx fails. Root Cause 8 Add nodes in the ONNX graph have 1D constant bias inputs (shape=[128], [512], [1024]) broadcast-added to higher-dimensional tensors. Myelin fuses these into ForeignNodes but infers stride as 3D when 4D is expected. Workaround Reshaping biases to [1,1,N] via ONNX GraphSurgeon allows compilation but adds inference overhead. Pure ONNX FP16 inference is faster than the TRT workaround (RTF 0.34 vs 0.47). Reproduction All scripts, patches, and models attached in repro.zip. See repro/README.md for step-by-step instructions. https://drive.google.com/file/d/1V-n3Xco_jBafDdaAmTsRQR_u1O3bawHP/view?usp=sharing
0 条评论