Preserving human privacy in real estate listing applications by deep learning methods

Abstract

The images are important components of real estate applications on the internet to inform users. There are multiple rental and sale properties and many images of these properties on the internet, and it is challenging to control the images of these real estate in terms of time, workload, and cost. Considering the requirements of the problem, Deep Learning (DL), one of the Artificial Intelligence (AI) methods, offers ideal solutions. This study aims to distinguish images that contain humans using deep learning techniques. This will also aid in not violating the privacy of people according to the Law on the Protection of Personal Data in the image content used in real estate applications. For this purpose, firstly, a dataset of real estate images with and without humans called the Real Estate Privacy (REP) dataset was created. The REP dataset was split into 70%, 20%, and 10% for training, validation, and testing, respectively. Secondly, the REP dataset was trained with Inceptionv3, ResNet-50, and DenseNet-169 architectures using transfer learning. Lastly, the performances of the architectures were evaluated by accuracy, precision, recall, and F1-score accuracy metrics. Experimental results indicate that the 52 epoch ResNet-50 architecture is the best for our datasets with 98.45% overall accuracy and 98.00% precision, 98.90% recall, and 98.44% F1-score. The Inceptionv3 model provided the best results on the 55th epoch with 98.27% accuracy, 97.81% precision, 98.71% recall, and 98.26% F1-score. Finally, the DenseNet-169 model produced the best results on the 47th epoch, with 97.81% accuracy, 97.09% precision, 98.52% recall, and 97.80% F1-score. Accuracy assessment shows that the highest accuracy among the three architectures was obtained with the ResNet-50 architecture This study shows that deep learning methods offer a perspective to image content control and can be used efficiently in real estate applications.

Keywords

• Real Estate
• Privacy
• ResNet-50
• Inception v3
• DenseNet-169

Supporting Institution

TÜBİTAK

Project Number

1139B412100343

Thanks

This study was supported within the scope of TÜBİTAK 2209-B. Undergraduate Research Projects Support Program for Industry with project number 1139B412100343.

References

1. Fields, D., & Rogers, D. (2021). Towards a critical housing studies research agenda on platform real estate. Housing, theory and society, 38(1), 72-94.
2. Kumari, A., Maan, V., & Dhiraj. (2021). A Deep Learning-Based Segregation of Housing Image Data for Real Estate Application. In Intelligent Learning for Computer Vision: Proceedings of Congress on Intelligent Systems 2020 (pp. 165-179). Springer Singapore.
3. Bappy, J. H., Barr, J. R., Srinivasan, N., & Roy-Chowdhury, A. K. (2017, March). Real estate image classification. In 2017 ieee winter conference on applications of computer vision (wacv) (pp. 373-381). IEEE.
4. Azizi, I., & Rudnytskyi, I. (2022). Improving Real Estate Rental Estimations with Visual Data. Big Data and Cognitive Computing, 6(3), 96.
5. Hassanzadeh, Z., Biddle, R., & Marsen, S. (2021). User perception of data breaches. IEEE Transactions on Professional Communication, 64(4), 374-389.
6. Erdos, D. (2022). Identification in personal data: Authenticating the meaning and reach of another broad concept in EU data protection law. Computer Law & Security Review, 46, 105721.
7. Zhang, B., Zou, G., Qin, D., Ni, Q., Mao, H., & Li, M. (2022). RCL-Learning: ResNet and convolutional long short-term memory-based spatiotemporal air pollutant concentration prediction model. Expert Systems with Applications, 207, 118017.
8. Salman, F. M., & Abu-Naser, S. S. (2022). Classification of real and fake human faces using deep learning. International Journal of Academic Engineering Research (IJAER), 6(3), 1-14

9. Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017). Imagenet classification with deep convolutional neural networks. Communications of the ACM, 60(6), 84-90.
10. Long, J., Shelhamer, E., & Darrell, T. (2015). Fully convolutional networks for semantic segmentation. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 3431-3440).
11. Simonyan, K., & Zisserman, A. (2014). Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556.
12. Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., ... & Rabinovich, A. (2015). Going deeper with convolutions. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 1-9).
13. He, K., Zhang, X., Ren, S., & Sun, J. (2016). Deep residual learning for image recognition. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 770-778).
14. Xie, S., Girshick, R., Dollár, P., Tu, Z., & He, K. (2017). Aggregated residual transformations for deep neural networks. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 1492-1500).
15. Huang, G., Liu, S., Van der Maaten, L., & Weinberger, K. Q. (2018). Condensenet: An efficient densenet using learned group convolutions. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 2752-2761).
16. Zoph, B., Vasudevan, V., Shlens, J., & Le, Q. V. (2018). Learning transferable architectures for scalable image recognition. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 8697-8710).
17. Tan, M., & Le, Q. (2019, May). Efficientnet: Rethinking model scaling for convolutional neural networks. In International conference on machine learning (pp. 6105-6114). PMLR.
18. Koch, D., Despotovic, M., Sakeena, M., Döller, M., & Zeppelzauer, M. (2018, June). Visual estimation of building condition with patch-level ConvNets. In Proceedings of the 2018 ACM Workshop on Multimedia for Real Estate Tech (pp. 12-17).
19. Zeppelzauer, M., Despotovic, M., Sakeena, M., Koch, D., & Döller, M. (2018, June). Automatic prediction of building age from photographs. In Proceedings of the 2018 ACM on International Conference on Multimedia Retrieval (pp. 126-134).
20. Zhao, Y., Chetty, G., & Tran, D. (2019, December). Deep learning with XGBoost for real estate appraisal. In 2019 IEEE symposium series on computational intelligence (SSCI) (pp. 1396-1401). IEEE.
21. Kamara, A. F., Chen, E., Liu, Q., & Pan, Z. (2020). A hybrid neural network for predicting Days on Market a measure of liquidity in real estate industry. Knowledge-Based Systems, 208, 106417.
22. Zhou, B., Zhao, H., Puig, X., Xiao, T., Fidler, S., Barriuso, A., & Torralba, A. (2019). Semantic understanding of scenes through the ade20k dataset. International Journal of Computer Vision, 127(3), 302-321.
23. Barhoom, A. M., & Abu-Naser, S. S. (2022). Diagnosis of Pneumonia Using Deep Learning. International Journal of Academic Engineering Research (IJAER), 6(2), 48-68
24. Zhou, L., Pan, S., Wang, J., & Vasilakos, A. V. (2017). Machine learning on big data: Opportunities and challenges. Neurocomputing, 237, 350-361.
25. He, K., Zhang, X., Ren, S., Sun, J. (2016). Identity mappings in deep residual networks. In Lecture Notes in Computer Science (Including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 630–645.
26. Bayram, B., Kilic, B., Özoğlu, F., Erdem, F., Bakirman, T., Sivri, S., ... & Delen, A. (2020). A Deep learning integrated mobile application for historic landmark recognition: A case study of Istanbul. Mersin Photogrammetry Journal, 2(2), 38-50.
27. Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., & Wojna, Z. (2016). Rethinking the inception architecture for computer vision. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 2818-2826).
28. Degadwala, S., Vyas, D., Biswas, H., Chakraborty, U., & Saha, S. (2021, July). Image captioning using inception V3 transfer learning model. In 2021 6th International Conference on Communication and Electronics Systems (ICCES) (pp. 1103-1108). IEEE.
29. Joshi, K., Tripathi, V., Bose, C., & Bhardwaj, C. (2020). Robust sports image classification using InceptionV3 and neural networks. Procedia Computer Science, 167, 2374-2381.
30. Sam, S. M., Kamardin, K., Sjarif, N. N. A., & Mohamed, N. (2019). Offline signature verification using deep learning convolutional neural network (CNN) architectures GoogLeNet inception-v1 and inception-v3. Procedia Computer Science, 161, 475-483.
31. Gunawan, A. A., & Surya, K. (2018). Brainwave classification of visual stimuli based on low-cost EEG spectrogram using DenseNet. Procedia Computer Science, 135, 128-139.
32. Chollet, F. (2015). Keras: Deep learning for humans, Github. https://github.com/keras-team/keras