GPU inference on infer

### Checks - [x] This template is only for usage issues encountered. - [x] I have thoroughly reviewed the project documentation but couldn't find information to solve my problem. - [x] I have searched for existing issues, including closed ones, and couldn't find a solution. - [x] I am using English to submit this issue to facilitate community communication. ### Environment Details ubuntu 20.2, nvidia A5000 Ada, Pytoch 2.4.0 ### Steps to Reproduce 1. Created a simple api to run the inference using CLI based inference ### ✔️ Expected Behavior Should be able to specify device as input ### ❌ Actual Behavior Inference runs on CPU only, GPU remains is unutilized. A device parameter should be available in infer_cli