Only impersonating if user has no Password

Just began using this package and have run into a weird scenario where if my users have a password set, then it will just log me out. But if the user doesn't have a password then it impersonates. I have tried the different solutions already listed, including event listeners (however, the way that are mentioned don't work in laravel 11 since there is not EventServiceProvider) Note: Laravel 11. Jetstream - PHP 8.2