| Title |
Deepfake detection via mitigating rank collapse in vision encoder |
| Authors |
손유을(Yueul Son) ; 엄태성(Tea Seong Eom) ; 송병철(Byung Cheol Song) |
| DOI |
https://doi.org/10.5573/ieie.2026.63.9.114 |
| Keywords |
Deepfake detection; Attention over-smoothing; Rank collapse |
| Abstract |
The recent increase in privacy violations using deepfakes has become a growing concern. Current approaches relying on ViT's global information processing face limitations in detecting localized forgery traces in deepfake images, highlighting the need for additional local feature learning. This issue is closely related to attention over-smoothing occurring within ViT. In this study, we introduce LocAt and FDAM on top of DeepShield ? a baseline model that leverages spatial tokens within ViT. Our approach demonstrates notable performance improvements on DF40, while showing limitations on DFDC and CDFv2. |