ITADN

VIT Adapter

#1244Openaselimc 创建于 2025-09-21
A
aselimccommented
Hello, I propose adding ViT adapter option in `TimmUniversalEncoder` for ViTs that does not have multi-scale features, so that SMP can now support a whole new set of backbones. The following links can be used as a reference/starting point. [DINOv3_Adapter](https://github.com/facebookresearch/dinov3/blob/main/dinov3/eval/segmentation/models/backbone/dinov3_adapter.py) [DINOv2_Adapter](https://github.com/facebookresearch/dinov2/blob/main/dinov2/eval/segmentation_m2f/models/backbones/vit_adapter.py) [Original VIT Adapter Repo](https://github.com/czczup/ViT-Adapter) [AdaptersHub](https://github.com/adapter-hub/adapters) [Adapters HF Version](https://huggingface.co/docs/hub/en/adapters) Or perhaps these type of adapters might actually better be on `timm`? @rwightman @qubvel
4 条评论