Difficult to scroll list in widget without widget frame being selected for move

I have the Alexa app shopping list widget enabled and unless you drag really slowly to scroll, the widget shows a white outline and you can move it about. About half the time you do a bigger swipe it triggers this. Is there any way to disable this? I've positioned and sized the widget when I added it and I don't ever want to move it. Thanks