A dual-domain spatio-temporal and frequency framework for robust deepfake detection
- 1Faculty of Electrical & Computer Engineering, University of Tabriz
Abstract
The rapid proliferation of high-fidelity facial synthesis has made automated deepfake detection a core requirement in digital forensics. Existing detectors that rely exclusively on spatial or temporal cues can be sensitive to compression artifacts and variations among manipulation pipelines. This paper introduces DSTF-Net, a dual-domain spatio-temporal and temporal-frequency framework designed to combine complementary evidence from these two domains. DSTF-Net consists of two coordinated branches. The WaveFormer branch applies a three-level 2D Haar wavelet decomposition to face-aligned frames, generating multi-scale frequency representations that expose seams, resampling traces, and texture inconsistencies, and then aggregates these frame-level descriptors using a transformer-based temporal combiner with hybrid statistical pooling. In parallel, the SFormer branch utilizes a Swin-Transformer backbone combined with a temporal encoder to jointly model spatial structure and motion dynamics across sequences of 32 frames, capturing both local appearance distortions and long-range temporal irregularities. The 512-dimensional embeddings from the two branches are fused using an adapted MLP-Mixer that performs token- and channel-wise mixing to learn a compact, discriminative video-level representation. However, cross-dataset evaluation without target-domain fine-tuning reveals a substantial performance decline, with accuracy ranging from 50.41% to 62.21% and AUC ranging from 0.4776 to 0.7613, depending on the training–testing direction and manipulation category. These results indicate that generalization to unseen dataset and compression characteristics remains challenging. Overall, the results demonstrate the effectiveness of integrating spatio-temporal and frequency-domain cues for intra-dataset deepfake detection, while highlighting the need for additional domain-generalization and compression-invariant learning strategies before deployment in unconstrained environments.
Related
- Dual-domain self-supervised feature alignment via spectral–spatial representation learning for deepfake anomaly detection
- Ensemble signal detection reveals target-specific temporal risk of hypokalemia after immune checkpoint inhibition: a translational pharmacology framework
- Traffic surveillance video-based a unified road accident detection, classification, and vehicle tracking framework using an optimized spatio-temporal attention mechanism
- Frequency, causes, and duration of drug shortages in South Korea, 2018–2024: a nationwide descriptive analysis of regulatory reporting data and temporal patterns across the COVID-19 pandemic
- SpectralTrojan: psychoacoustically constrained frequency-domain backdoors for keyword spotting and speaker identification
BibTeX
@article{sajjadi2026dualdomain,
title = {{A dual-domain spatio-temporal and frequency framework for robust deepfake detection}},
author = {Arman Sajjadi and Sayna Sarvar and Mobin Nekou and Mahdi Fallah and Delaram Mehralizadeh and Mohammad Hossein Jabbarzadeh and Pedram Salehpour},
journal = {Scientific Reports},
year = {2026},
month = aug,
doi = {10.1038/s41598-026-65079-2},
url = {https://doi.org/10.1038/s41598-026-65079-2},
note = {CC BY},
}
RIS
TY - JOUR
TI - A dual-domain spatio-temporal and frequency framework for robust deepfake detection
AU - Arman Sajjadi
AU - Sayna Sarvar
AU - Mobin Nekou
AU - Mahdi Fallah
AU - Delaram Mehralizadeh
AU - Mohammad Hossein Jabbarzadeh
AU - Pedram Salehpour
PY - 2026
DA - 2026/08/01
JO - Scientific Reports
DO - 10.1038/s41598-026-65079-2
UR - https://doi.org/10.1038/s41598-026-65079-2
AB - The rapid proliferation of high-fidelity facial synthesis has made automated deepfake detection a core requirement in digital forensics. Existing detectors that rely exclusively on spatial or temporal cues can be sensitive to compression artifacts and variations among manipulation pipelines. This paper introduces DSTF-Net, a dual-domain spatio-temporal and temporal-frequency framework designed to combine complementary evidence from these two domains. DSTF-Net consists of two coordinated branches. The WaveFormer branch applies a three-level 2D Haar wavelet decomposition to face-aligned frames, generating multi-scale frequency representations that expose seams, resampling traces, and texture inconsistencies, and then aggregates these frame-level descriptors using a transformer-based temporal combiner with hybrid statistical pooling. In parallel, the SFormer branch utilizes a Swin-Transformer backbone combined with a temporal encoder to jointly model spatial structure and motion dynamics across sequences of 32 frames, capturing both local appearance distortions and long-range temporal irregularities. The 512-dimensional embeddings from the two branches are fused using an adapted MLP-Mixer that performs token- and channel-wise mixing to learn a compact, discriminative video-level representation. However, cross-dataset evaluation without target-domain fine-tuning reveals a substantial performance decline, with accuracy ranging from 50.41% to 62.21% and AUC ranging from 0.4776 to 0.7613, depending on the training–testing direction and manipulation category. These results indicate that generalization to unseen dataset and compression characteristics remains challenging. Overall, the results demonstrate the effectiveness of integrating spatio-temporal and frequency-domain cues for intra-dataset deepfake detection, while highlighting the need for additional domain-generalization and compression-invariant learning strategies before deployment in unconstrained environments.
SN - 2045-2322
ER -