ITADN

[PyTorch Backend] [2.67.0/container 26.03] Torch models log 'ModelInitialize' on each request

#8726Closedmkompanek 创建于 2026-04-08
M
mkompanekcommented
After updating our deployment container version to 26.03 we noticed lots of new logs (INFO) reporting model initialization (on every request) for models using pytorch backend. ``` I0407 13:11:47.653802 1 libtorch.cc:136] "TRITONBACKEND_ModelInitialize: ... I0407 13:11:47.653828 1 libtorch.cc:210] "TRITONBACKEND_ModelInstanceInitialize: ... I0407 13:11:47.766677 1 libtorch.cc:136] "TRITONBACKEND_ModelInitialize: ... I0407 13:11:47.766705 1 libtorch.cc:210] "TRITONBACKEND_ModelInstanceInitialize: ... I0407 13:11:47.884304 1 libtorch.cc:136] "TRITONBACKEND_ModelInitialize: ... I0407 13:11:47.884331 1 libtorch.cc:210] "TRITONBACKEND_ModelInstanceInitialize: ... ``` Looking at the code, it seems to [originate in code checking for PT2 format support](https://github.com/triton-inference-server/pytorch_backend/blob/8ffd6b20804956bd1fe990d3426e3cd1cc46721a/src/libtorch.cc#L137). So question - does it make sense to log this when it's just checking whether PT2 path should be run ? CC author: @whoisj
关闭于 2026-04-14 0 条评论