ITADN

Dynamic batch sizes are not supported in tiny-yolov3 model

#678Openrohitdavas 创建于 2025-03-19
bug
R
rohitdavascommented
# Bug Report ### Which model does this pertain to? Tiny-yolov3 ### Describe the bug Model does not support batch sizes > 1. error : ----------- testing start ---------- input data name : input_1, shape = (2, 3, 416, 416), type = <class 'numpy.ndarray'> input data name : image_shape, shape = (2, 2), type = <class 'numpy.ndarray'> 2025-03-19 23:19:18.958568678 [E:onnxruntime:, sequential_executor.cc:516 ExecuteKernel] Non-zero status code returned while running Squeeze node. Name:'TFNodes/yolo_evaluation_layer_1/Squeeze' Status Message: /onnxruntime_src/onnxruntime/core/providers/cpu/tensor/squeeze.h:52 static onnxruntime::TensorShapeVector onnxruntime::SqueezeBase::ComputeOutputShape(const onnxruntime::TensorShape&, const onnxruntime::TensorShapeVector&) input_shape[i] == 1 was false. Dimension of input 0 must be 1 instead of 2. shape={2,2} ### Reproduction instructions Run model inference on any batch size > 1. **System Information** OS Platform and Distribution (*e.g. Linux Ubuntu 16.04*): ONNX version (*e.g. 1.6*): Backend/Runtime version (*e.g. ONNX Runtime 1.1, PyTorch 1.2*): Provide a code snippet to reproduce your errors. ``` import numpy as np def test_call(self, ): for batch_size in [1, 2]: image = np.random.rand(batch_size, 3, 416, 416,).astype(np.float32) image_shape = np.array([[416, 416]], dtype=np.float32).reshape(1, 2) if batch_size != 1: image_shape = np.vstack([ image_shape for _ in range(batch_size)]) inputs = { self.input_names[0]: image, self.input_names[1]: image_shape } print(f"----------- testing start ----------") for key, value in inputs.items(): print(f"input data name : {key}, shape = {value.shape}, type = {type(value)}") # any forward wrapper that takes in the input and returns the output dict. output_dict = self.forward(inputs) for key, value in output_dict.items(): print(f"output data name : {key}, shape = {value.shape}, type = {type(value)}") ... ``` ### Notes 1. runs correct with batch size 1. 2. fails on any batch size > 1
0 条评论