ITADN

Improve faster inference speed by autocasting

#66Pull Requestjhj0517 创建于 2024-11-09
J
jhj0517commented
Thanks for amazing node. Currently some tensors are computed by CPU even though CUDA is enabled, So this PR grants faster inference when using Nvidia GPU via autocasting. I tested with 2 seconds of video and confirmed that it is faster by more than 50%. | Inferencer | Before | After | Speed Improvement | |------------------|------------|-----------|------------------------| | ExpressionEditor | 0.26 s | 0.16 s | 62% | | AdvancedLivePortrait | 8.14 s | 4.35 s | 87% |
合并状态:未合并 0 条评论