Background subtraction based on a Self-Adjusting MoG

Abstract

The diversity in background scenes such as, illumination changes, dynamics of the background, camouflage effect, shadow, etc. is a big deal for moving objects detection methods makes it impossible to manage the multimodality of scenes in video surveillance systems. In this paper we present a new method that allows better detection of moving objects. This method combine the robustness of the Artificial Immune Recognition System (AIRS) with respect to the local variations and the power of Gaussian mixtures (MoG) to model changes at the pixel level. The task of the AIRS is to generate several MoG models for each pixel. This models are filtred through two mecanism: the competition for resources and the development of a candidate memory cell. The best model is merged with the exesting MoG according to the Memory cell introduction process. Obtained results on the Wallflower dataset proved the performance of our system compared to other state-of-the-art methods.

Keywords

• Background Subtraction,AIRS,Video Surveillance,Pixel Classication,Foreground Segmentation,MoG

A New Process for Background Subtraction based on AIRS

Abstract

The diversity in background scenes such as, illumination changes, dynamics of the background, camouflage effect, shadow, etc. is a big deal for moving objects detection methods makes it impossible to manage the multimodality of scenes in video surveillance systems.

In this paper we present a new method that allows better detection of moving objects. This method combine the robustness of the Artificial Immune Recognition System (AIRS) with respect to the local variations and the power of Gaussian mixtures (GMM) to model changes at the pixel level.

The task of the AIRS is to generate several GMM models for each pixel. This models are filtred through two mecanism: the competition for resources and the development of a candidate memory cell. The best model is merged with the exesting GMM according to the Memory cell introduction process.

results obtained on the Wallflower dataset proved the performance of our system compared to other state-of-the-art methods.

Keywords

• Background Subtraction,GMM,AIRS,Video Surveillance,Pixel Classication,Foreground Segmentation

References

1. Reference1 Allebosch, G., Van Hamme, D., Deboeverie, F., Veelaert, P., Philips, W.: C-effic: color and edge based foreground background segmentation with interior classification. In: International Joint Conference on Computer Vision, Imaging and Computer Graphics. pp. 433-454. Springer (2015)
2. Reference2 Babaee, M., Dinh, D.T., Rigoll, G.: A deep convolutional neural network for video sequence background subtraction. Pattern Recognition 76, 635-649 (2018)
3. Reference3 Bouwmans, T.: Background subtraction for visual surveillance: A fuzzy approach. Handbook on soft computing for video surveillance 5, 103-138 (2012)
4. Reference4 Brutzer, S., Hoferlin, B., Heidemann, G.: Evaluation of background subtraction techniques for video surveillance. In: CVPR 2011. pp. 1937-1944. IEEE (2011)
5. Reference5 Bucak, S.S., Gunsel, B.: Video content representation by incremental non-negative matrix factorization. In: 2007 IEEE International Conference on Image Processing. vol. 2, pp. II-113. IEEE (2007)
6. Reference6 Charoenpong, T., Supasuteekul, A., Nuthong, C.: Adaptive background modeling from an image sequence by using k-means clustering. In: ECTI-CON2010: The 2010 ECTI International Confernce on Electrical Engineering/Electronics, Computer, Telecommunications and Information Technology. pp. 880-883. IEEE (2010)
7. Reference7 Chen, M., Wei, X., Yang, Q., Li, Q., Wang, G., Yang, M.H.: Spatiotemporal gmm for background subtraction with superpixel hierarchy. IEEE transactions on pattern analysis and machine intelligence 40(6), 1518-1525 (2018)
8. Reference8 Elgammal, A., Harwood, D., Davis, L.: Non-parametric model for background subtraction. In: European conference on computer vision. pp. 751-767. Springer (2000)

9. Reference9 Farou, B., Kouahla, M.N., Seridi, H., Akdag, H.: Effecient local monitoring approach for the task of background subtraction. Engineering Applications of Artificial Intelligence 64, 1-12 (2017)
10. Reference10 Friedman, N., Russell, S.: Image segmentation in video sequences: A probabilistic approach. In: Proceedings of the Thirteenth conference on Uncertainty in artificial intelligence. pp. 175-181. Morgan Kaufmann Publishers Inc. (1997)
11. Reference11 Haritaoglu, I., Harwood, D., Davis, L.S.: W/sup 4: real-time surveillance of people and their activities. IEEE Transactions on pattern analysis and machine intelligence 22(8), 809{830 (2000)
12. Reference12 Hunziker, S., Quanz, S.P., Amara, A., Meyer, M.R.: Pca-based approach for subtracting thermal background emission in high-contrast imaging data. Astronomy & Astrophysics 611, A23 (2018)
13. Reference13 Javed, S., Narayanamurthy, P., Bouwmans, T., Vaswani, N.: Robust pca and robust subspace tracking: A comparative evaluation. In: 2018 IEEE Statistical Signal Processing Workshop (SSP). pp. 836-840. IEEE (2018)
14. Reference14 Jianzhao, C., Victor, O.C., Gilbert, O.M., Changtao, W.: A fast background subtraction method using kernel density estimation for people counting. In: 2017 9th International Conference on Modelling, Identi_cation and Control (ICMIC). pp. 133-138. IEEE (2017)
15. Reference15 Krungkaew, R., Kusakunniran, W.: Foreground segmentation in a video by using a novel dynamic codebook. In: 2016 13th International Conference on Electrical Engineering/Electronics, Computer, Telecommunications and Information Technology (ECTI-CON). pp. 1-6. IEEE (2016)
16. Reference16 Li, X., Hu, W., Zhang, Z., Zhang, X.: Robust foreground segmentation based on two effective background models. In: Proceedings of the 1st ACM international conference on Multimedia information retrieval. pp. 223-228. ACM (2008)
17. Reference17 Lim, L.A., Keles, H.Y.: Foreground segmentation using convolutional neural networks for multiscale feature encoding. Pattern Recognition Letters 112, 256-262 (2018)
18. Reference18 Lim, L.A., Keles, H.Y.: Learning multi-scale features for foreground segmentation. arXiv preprint arXiv:1808.01477 (2018)
19. Reference19 Martins, I., Carvalho, P., Corte-Real, L., Alba-Castro, J.L.: Bmog: boosted Gaussian mixture model with controlled complexity. In: Iberian Conference on Pattern Recognition and Image Analysis. pp. 50-57. Springer (2017)
20. Reference20 Oliver, N.M., Rosario, B., Pentland, A.P.: A bayesian computer vision system for modeling human interactions. IEEE transactions on pattern analysis and machine intelligence 22(8), 831-843 (2000)
21. Reference21 Shen, Y., Hu, W., Yang, M., Liu, J., Wei, B., Lucey, S., Chou, C.T.: Real-time and robust compressive background subtraction for embedded camera networks. IEEE Transactions on Mobile Computing 15(2), 406-418 (2016)
22. Reference22 St-Charles, P.L., Bilodeau, G.A., Bergevin, R.: A self-adjusting approach to change detection based on background word consensus. In: 2015 IEEE Winter Conference on Applications of Computer Vision. pp. 990-997. IEEE (2015)
23. Reference23 St-Charles, P.L., Bilodeau, G.A., Bergevin, R.: Subsense: A universal change detection method with local adaptive sensitivity. IEEE Transactions on Image Processing 24(1), 359-373 (2015)
24. Reference24 Stauffer, C., Grimson, W.E.L.: Adaptive background mixture models for real-time tracking. In: Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149). vol. 2, pp. 246-252. IEEE (1999)
25. Reference25 Toyama, K., Krumm, J., Brumitt, B., Meyers, B.: Wallower: Principles and practice of background maintenance. In: Proceedings of the Seventh IEEE International Conference on Computer Vision. vol. 1, pp. 255-261. IEEE (1999)
26. Reference26 Tsai, D.M., Lai, S.C.: Independent component analysis-based background subtraction for indoor surveillance. IEEE Transactions on image processing 18(1), 158-167 (2009)
27. Reference27 Viswanath, A., Behera, R.K., Senthamilarasu, V., Kutty, K.: Background modelling from a moving camera. Procedia Computer Science 58, 289-296 (2015)
28. Reference28 Wang, K., Gou, C., Wang, F.Y.: mf4gcd: A robust change detection method for intelligent visual surveillance. IEEE Access 6, 15505-15520 (2018)
29. Reference29 Wang, Y., Luo, Z., Jodoin, P.M.: Interactive deep learning method for segmenting moving objects. Pattern Recognition Letters 96, 66-75 (2017)
30. Reference30 Watkins, A., Boggess, L.: A new classifier based on resource limited artificial immune systems. In: Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No. 02TH8600). vol. 2, pp. 1546-1551. IEEE (2002)
31. Reference31 Wren, C.R., Azarbayejani, A., Darrell, T., Pentland, A.P.: P_nder: Real-time tracking of the human body. IEEE Transactions on pattern analysis and machine intelligence 19(7), 780-785 (1997)
32. Reference32 Xia, H., Song, S., He, L.: A modified gaussian mixture background model via spatiotemporal distribution with shadow detection. Signal, Image and Video Processing 10(2), 343-350 (2016)
33. Reference33 Yu, J., Zhou, X., Qian, F.: Object kinematic model: A novel approach of adaptive background mixture models for video segmentation. In: 2010 8th World Congress on Intelligent Control and Automation. pp. 6225-6228. IEEE (2010)