Improve faster inference speed by autocasting
Thanks for amazing node.
Currently some tensors are computed by CPU even though CUDA is enabled,
So this PR grants faster inference when using Nvidia GPU via autocasting.
I tested with 2 seconds of video and confirmed that it is faster by more than 50%.
| Inferencer | Before | After | Speed Improvement |
|------------------|------------|-----------|------------------------|
| ExpressionEditor | 0.26 s | 0.16 s | 62% |
| AdvancedLivePortrait | 8.14 s | 4.35 s | 87% |
合并状态:未合并 0 条评论