Tracking algorithm significantly slows down code execution such that it is unusable

When tracking using OpenCV is enabled on the Jetson Nano or on Windows, it significantly slows down the performance of the code. The execution rate of the program becomes so slow that it's unusable for real time flight. Currently the Tracker CSRT module is being used to track objects in frame given a starting bounding box. Some background information: Originally when I had tested this code it worked just fine on the jetson nano. I was using OpenCV 4.5.0 and had written some basic code to implement the CSRT tracker. It worked really well. Then out of the blue, without any code changes, it stopped being able to track me across my living room, and started losing me about halfway across the living room (about 6m is when it started to lose me). It could have been lighting conditions somehow differing on that day (but the room was the same so I'm not sure how that could've been the case). Then I decided to upgrade my opencv version to version 4.10.0 on the jetson nano b01 in order to match the version I have on windows. Then I tested the tracking code and it first cause the program to crash every time. Finally, with some changes to the tracking code, the program wouldn't crash, but it would be extremely slow. And that's where things are at today.