Deepfake Image Detection with Transfer Learning Models

Abstract

Deepfake is a technology that employs artificial intelligence to generate fake images and videos that closely mimic real ones. The rapid growth and dissemination of digital modifications generate considerable concern in the media, politics, and social networking. Among the concerns faced include the dissemination of misinformation, reputational damage, and threats to physical security. Given these concerns, prompt and reliable identification of Deepfakes is crucial for protecting information security and mitigating its negative impacts. Therefore, the development of effective technologies for Deepfake detection is essential to counter this increasing threat. This study aims to identify Deepfake images and examine the efficiency of transfer learning algorithms in Deepfake identification. This study employed the most commonly utilized transfer learning models, including InceptionV3, EfficientNet, NASNet, ResNet, DenseNet, Xception and ConvNeXt, to perform the detection task. An extensive public dataset of 190,000 images, including both real and artificially generated, was utilized in the study. The performance of each model was assessed by using the metrics of accuracy, precision, recall, and F1-score. DenseNet was the most successful model with a test accuracy of 93%. The obtained results have shown that transfer learning models can effectively detect the Deepfake images, providing a practical approach to the challenge with reasonable performance scores.

Keywords

• Deepfake Detection
• Information Security
• Transfer Learning

Ethical Statement

The study is complied with research and publication ethics.

Thanks

We thank the anonymous reviewers for their valuable feedback and support.

References

1. M. S. Rana, M. N. Nobi, B. Murali, and A. H. Sung, "Deepfake detection: A Systematic Literature Review," IEEE Access, vol. 10, pp. 25494-25513, 2022.
2. D. Afchar, V. Nozick, J. Yamagishi, and I. Echizen, "Mesonet: A Compact Facial Video Forgery Detection Network," in 2018 IEEE International Workshop on Information Forensics and Security (WIFS), 2018: IEEE, pp. 1-7.
3. P. Prajapati and C. Pollett, "Mri-gan: A Generalized Approach to Detect Deepfakes Using Perceptual Image Assessment," arXiv preprint arXiv:2203.00108, 2022.
4. C. Miao, Q. Chu, W. Li, T. Gong, W. Zhuang, and N. Yu, "Towards Generalizable and Robust Face Manipulation Detection via Bag-Of-Local-Feature," arXiv preprint arXiv:2103.07915, 2021.
5. H. Zhao, W. Zhou, D. Chen, T. Wei, W. Zhang, and N. Yu, "Multi-attentional Deepfake Detection," in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2021, pp. 2185-2194.
6. S. Kanwal, S. Tehsin, and S. Saif, "Exposing AI Generated Deepfake Images Using Siamese Network With Triplet Loss," Computing and Informatics, vol. 41, no. 6, pp. 1541–1562, 2022.
7. R. Rafique, M. Nawaz, H. Kibriya, and M. Masood, "Deepfake Detection Using Error Level Analysis and Deep Learning," in 2021 4th International Conference on Computing & Information Sciences (ICCIS), 2021: IEEE, pp. 1-4.
8. N. Nida, A. Irtaza, and N. Ilyas, "Forged Face Detection Using ELA and Deep Learning Techniques," in 2021 International Bhurban Conference on Applied Sciences and Technologies (IBCAST), 2021: IEEE, pp. 271-275.

9. M. Patel, A. Gupta, S. Tanwar, and M. Obaidat, "Trans-DF: A Transfer Learning-Based End-To-End Deepfake Detector," in 2020 IEEE 5th International Conference on Computing Communication And Automation (ICCCA), 2020: IEEE, pp. 796-801.
10. P. Joshi and V. Nivethitha, "Deep Fake Image Detection using Xception Architecture," in 2024 5th International Conference on Recent Trends in Computer Science and Technology (ICRTCST), 2024: IEEE, pp. 533-537.
11. M. Liao and M. Chen, "A New Deepfake Detection Method by Vision Transformers," in International Conference on Algorithms, High Performance Computing, and Artificial Intelligence (AHPCAI 2024), 2024, vol. 13403: SPIE, pp. 953-957.
12. M. Karki. deepfake and real images: https://www.kaggle.com/datasets/manjilkarki/deepfake-and-real-images, (23.12.2024).
13. C. Szegedy, V. Vanhoucke, S. Ioffe, J. Shlens, and Z. Wojna, "Rethinking the Inception Architecture for Computer Vision," in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2016, pp. 2818-2826.
14. M. Tan and Q. Le, "Efficientnet: Rethinking Model Scaling for Convolutional Neural Networks," in International Conference on Machine Learning, 2019: PMLR, pp. 6105-6114.
15. K. He, X. Zhang, S. Ren, and J. Sun, "Deep Residual Learning For Image Recognition," in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2016, pp. 770-778.
16. G. Huang, Z. Liu, L. Van Der Maaten, and K. Q. Weinberger, "Densely Connected Convolutional Networks," in Proceedings of The IEEE Conference on Computer Vision and Pattern Recognition, 2017, pp. 4700-4708.
17. F. Chollet, "Xception: Deep Learning with Depthwise Separable Convolutions," in Proceedings of The IEEE Conference on Computer Vision and Pattern Recognition, 2017, pp. 1251-1258.
18. B. Zoph, V. Vasudevan, J. Shlens, and Q. V. Le, "Learning Transferable Architectures for Scalable Image Recognition," in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2018, pp. 8697-8710.
19. Z. Liu, H. Mao, C.-Y. Wu, C. Feichtenhofer, T. Darrell, and S. Xie, "A Convnet for the 2020s," in Proceedings of the Ieee/Cvf Conference On Computer Vision and Pattern Recognition, 2022, pp. 11976-11986.
20. D. M. Powers, "Evaluation: From Precision, Recall and F-Measure to Roc, Informedness, Markedness and Correlation," Arxiv Preprint Arxiv:2010.16061, 2020.
21. A. Utku, Z. Ayaz, D. Çiftçi, and M. A. Akcayol, "Deep Learning Based Classification for Hoverflies (Diptera: Syrphidae)," Journal of the Entomological Research Society, Vol. 25, No. 3, Pp. 529-544, 2023.
22. Y. Canbay, S. Adsiz, and P. Canbay, "Privacy-Preserving Transfer Learning Framework for Kidney Disease Detection," Applied Sciences, Vol. 14, No. 19, P. 8629, 2024.
23. Y. Kaya, Z. Yiner, M. Kaya, and F. Kuncan, "A New Approach to Covid-19 Detection from X-Ray Images Using Angle Transformation with Googlenet and Lstm," Measurement Science and Technology, Vol. 33, No. 12, P. 124011, 2022.