FIx device select and add mps device

- What to do when mps or cuda device does not work. - added mps to auto select (I used `PYTORCH_ENABLE_MPS_FALLBACK=1` and it worked).