Hybrid Image Compression-Encryption Scheme with Chaotic Logistic Map and XOR with Variational Autoencoder

Abstract

With the increase in the speed of digital data production and transmission, protecting sensitive content and preventing unauthorized access has become a critical requirement. In this context, data security and encryption methods are indispensable components of modern information systems. Meanwhile, the increasing volume of data necessitates transmission at lower bandwidth and storage costs. This situation demands the use of effective compression techniques to enhance efficiency. In this study, a hybrid system is proposed for both compression and secure transmission of visual data. Based on the Variational Autoencoder (VAE) model, exclusive OR (XOR) and chaotic system-based encryption methods were integrated. Three model-method combinations (VAE, VAE + XOR, and VAE + Chaotic) were implemented. The performance of these model methods was comprehensively analyzed using multi-faceted metrics, including visual quality (PSNR, SSIM), security (NPCR, UACI), statistical analysis (entropy, correlation, histogram), processing time (encoding/decoding, encryption/decryption), compression ratio, and hardware resource usage (CPU, RAM, GPU). Experimental studies were conducted using the FEI face image dataset. According to the results, the VAE + Chaotic model method stands out as the most successful and balanced solution, offering high reconstruction quality, strong security features, low hardware usage, and fast processing time. Overall, this study demonstrates that deep learning-based models provide an effective alternative for secure visual data transmission, especially in resource-constrained environments.

Keywords

• Image security
• Encryption
• Compression
• VAE
• Chaotic systems
• XOR

References

1. A. MaungMaung and H. Kiya, “Generative model-based attack on learnable image encryption for privacy-preserving deep learning,” arXiv preprint arXiv:2303.05036, 2023. doi: 10.48550/arXiv.2303.05036
2. F. Ahmed, M. U. Rehman, J. Ahmad, M. S. Khan, W. Boulila, G. Srivastava, and W. J. Buchanan, “A DNA based colour image encryption scheme using a convolutional autoencoder,” ACM Transactions on Multimedia Computing, Communications and Applications, vol. 19, no. 3s, pp. 1–21, 2023. doi: 10.1145/3570165
3. T. Al-Maadeed, I. Hussain, A. Anees, and M. T. Mustafa, “An image encryption algorithm based on chaotic Lorenz system and novel primitive polynomial S-boxes,” arXiv preprint arXiv:2006.11847, 2020. doi: 10.48550/arXiv.2006.11847
4. G. Chen, Y. Mao, and C. K. Chui, “A symmetric image encryption scheme based on 3D chaotic cat maps,” Chaos, Solitons & Fractals, vol. 21, no. 3, pp. 749–761, 2004. doi: 10.1016/j.chaos.2003.12.022
5. J. Zeng and C. Wang, “A novel hyperchaotic image encryption system based on particle swarm optimization algorithm and cellular automata,” Security and Communication Networks, vol. 2021, no. 1, pp. 6675565, 2021. doi: 10.1155/2021/6675565
6. S. Li and X. Zheng, “Cryptanalysis of a chaotic image encryption method,” in 2002 IEEE International Symposium on Circuits and Systems (ISCAS), vol. 2, pp. II–II, 2002. doi: 10.1109/ISCAS.2002.1011451
7. Y. Zhou, L. Bao, and C. P. Chen, “A new 1D chaotic system for image encryption,” Signal Processing, vol. 97, pp. 172–182, 2014. doi: 10.1016/j.sigpro.2013.10.034
8. N. K. Pareek, V. Patidar, and K. K. Sud, “Image encryption using chaotic logistic map,” Image and Vision Computing, vol. 24, no. 9, pp. 926–934, 2006. doi: 10.1016/j.imavis.2006.02.021

9. G. Alvarez and S. Li, “Cryptographic requirements for chaotic secure communications,” arXiv preprint nlin/0311039, 2003. doi: 10.48550/arXiv.nlin/0311039
10. Z. Zhao, C. Yang, Z. Qiu, and Q. Wu, “Discrete Cosine Transform-Based Joint Spectral–Spatial Information Compression and Band-Correlation Calculation for Hyperspectral Feature Extraction,” Remote Sensing, vol. 16, no. 22, pp. 4270, 2024. doi: 10.3390/rs16224270
11. S. Liu, Z. Chen, X. Wang, and Z. Wang, “Deep learning-based image compression: A survey,” IEEE Transactions on Pattern Analysis and Machine Intelligence, 2020. doi: 10.1109/TPAMI.2020.2998145
12. D. K. Jain, D. Gaur, K. Gaur, and N. Jain, “Image compression using discrete cosine transform and adaptive Huffman coding,” International Journal of Emerging Trends & Technology in Computer Science (IJETTCS), vol. 3, no. 1, pp. 90–94, 2014.
13. S. Thomas, A. Krishna, S. Govind, and A. K. Sahu, “A novel image compression method using wavelet coefficients and Huffman coding,” Journal of Engineering Research, vol. 13, no. 1, pp. 361–370, 2025. doi: 10.1016/j.jer.2023.08.015
14. R. Ranjan and P. Kumar, “An improved image compression algorithm using 2D DWT and PCA with canonical huffman encoding,” Entropy, vol. 25, no. 10, pp. 1382, 2023. doi: 10.3390/e25101382
15. A. Skodras, C. Christopoulos, and T. Ebrahimi, “The JPEG 2000 still image compression standard,” IEEE Signal Processing Magazine, vol. 18, no. 5, pp. 36–58, 2002. doi: 10.1109/79.952804
16. G. J. Sullivan, J. R. Ohm, W. J. Han, and T. Wiegand, “Overview of the high efficiency video coding (HEVC) standard,” IEEE Transactions on Circuits and Systems for Video Technology, vol. 22, no. 12, pp. 1649–1668, 2012. doi: 10.1109/TCSVT.2012.2221191
17. G. Toderici, D. Vincent, N. Johnston, S. J. Hwang, D. Minnen, J. Shor, and M. Covell, “Full resolution image compression with recurrent neural networks,” in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 5306–5314, 2017.
18. Z. Cheng, H. Sun, M. Takeuchi, and J. Katto, “Learned image compression with discretized Gaussian mixture likelihoods and attention modules,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 7939–7948, 2020.
19. E. Agustsson, M. Tschannen, F. Mentzer, R. Timofte, and L. V. Gool, “Generative adversarial networks for extreme learned image compression,” in Proceedings of the IEEE/CVF International Conference on Computer Vision, pp. 221–231, 2019. doi: 10.1109/ICCV.2019.00031
20. Y. Choi, M. El-Khamy, and J. Lee, “Variable rate deep image compression with a conditional autoencoder,” in Proceedings of the IEEE/CVF International Conference on Computer Vision, pp. 3146–3154, 2019.
21. P. Shete and S. Kohle, “Image encryption using AES algorithm: study and evaluation,” Int. J. Res. Appl. Sci. Eng. Technol., vol. 10, no. 9, pp. 1134–1137, 2022. doi: 10.22214/ijraset.2022.46619
22. R. K. HS, P. K. HR, K. B. Sudeepa, and G. Aithal, “Enhanced security system using symmetric encryption and visual cryptography,” International Journal of Advances in Engineering & Technology, vol. 6, no. 3, pp. 1211–1219, 2013.
23. A. Sahoo, P. Mohanty, and P. C. Sethi, “Image encryption using RSA algorithm,” in Intelligent Systems: Proceedings of ICMIB 2021, pp. 641–652, Singapore: Springer Nature Singapore, 2022. doi: 10.1007/978-981-19-0901-6_56
24. A. H. Jassem, A. T. Hashim, and S. A. Ali, “Enhanced blowfish algorithm for image encryption based on chaotic map,” in 2019 First International Conference of Computer and Applied Sciences (CAS), pp. 232–237, 2019. doi: 10.1109/CAS47993.2019.9075747
25. A. Pourjabbar Kari, A. Habibizad Navin, A. M. Bidgoli, and M. Mirnia, “A new image encryption scheme based on hybrid chaotic maps,” Multimedia Tools and Applications, vol. 80, no. 2, pp. 2753–2772, 2021. doi: 10.1007/s11042-020-09648-1
26. A. H. Alrubaie, M. A. A. A. Khodher, and A. T. Abdulameer, “Image encryption based on 2DNA encoding and chaotic 2D logistic map,” Journal of Engineering and Applied Science, vol. 70, no. 1, pp. 60, 2023. doi: 10.1186/s44147-023-00228-2
27. D. A. Q. Shakir, A. Salim, S. Q. Abd Al-Rahman, and A. M. Sagheer, “Image encryption using Lorenz chaotic system,” Journal of Techniques, vol. 5, no. 1, pp. 122–128, 2023. doi: 10.51173/jt.v5i1.840
28. D. Cheng, Y. Chen, and H. Huang, “Symmetric multiple-image encryption algorithm using Chen's hyper-chaotic system,” Research Square (preprint), 2024. doi: 10.21203/rs.3.rs-4969461/v1
29. FEI Face Database, “Centro Universitário da FEI,” [Online]. Available: https://fei.edu.br/~cet/facedatabase.html
30. Z. Man, J. Li, X. Di, Y. Sheng, and Z. Liu, “Double image encryption algorithm based on neural network and chaos,” Chaos, Solitons & Fractals, vol. 152, pp. 111318, 2021. doi: 10.1016/j.chaos.2021.111318
31. C. Wang and Y. Zhang, “A novel image encryption algorithm with deep neural network,” Signal Processing, vol. 196, pp. 108536, 2022. doi: 10.1016/j.sigpro.2022.108536
32. D. Xu, G. Li, W. Xu, and C. Wei, “Design of artificial intelligence image encryption algorithm based on hyperchaos,” Ain Shams Engineering Journal, vol. 14, no. 3, pp. 101891, 2023. doi: 10.1016/j.asej.2022.101891
33. N. Mao, X. Tong, M. Zhang, and Z. Wang, “A hyperchaotic image encryption algorithm based on LSTM neural network and lifting wavelet transform,” Physica Scripta, vol. 98, no. 7, pp. 075215, 2023. doi: 10.1088/1402-4896/acdc62
34. B. V. Nair, S. S. Muni, and A. Durdu, “Deep learning and chaos: A combined approach to image encryption and decryption,” arXiv preprint arXiv:2406.16792, 2024. doi: 10.48550/arXiv.2406.16792
35. A. Kadir, M. S. Azzaz, R. Kaibou, and Y. Alloun, “Efficient image encryption using a new model of Chaotic Neural Network,” The Journal of Supercomputing, vol. 81, no. 16, pp. 1481, 2025. doi: 10.1007/s11227-025-07977-2
36. Y. Sang, J. Sang, and M. S. Alam, “Image encryption based on logistic chaotic systems and deep autoencoder,” Pattern Recognition Letters, vol. 153, pp. 59–66, 2022. doi: 10.1016/j.patrec.2021.11.025
37. N. Gupta and R. Vijay, “Hybrid image compression-encryption scheme based on multilayer stacked autoencoder and logistic map,” China Communications, vol. 19, no. 1, pp. 238–252, 2022. doi: 10.23919/JCC.2022.01.017
38. Z. Bao, R. Xue, J. Hu, and Y. Liu, “Color image encryption based on lite dense-ResNet and bit-XOR diffusion,” Multimedia Tools and Applications, vol. 83, no. 5, pp. 12819–12848, 2024. doi: 10.1007/s11042-023-16073-7
39. A. K. Panigrahy, S. R. Maniyath, M. Sathiyanarayanan, M. Dholvan, T. Ramaswamy, S. Hanumanthakari, and R. Swain, “A faster and robust artificial neural network based image encryption technique with improved SSIM,” IEEE Access, vol. 12, pp. 10818–10833, 2024. doi: 10.1109/ACCESS.2024.3353294