Smart attendance monitoring system using multimodal biometrics

Abstract

The trajectory of a person’s career is significantly influenced by attendance. The conventional register-based attendance system is tedious, time-consuming, and generally uninteresting. These age-old methods, being laborious and time-intensive, warrant a more efficient alternative. In this paper, we introduce a Bimodal Attendance system implemented through biometrics. We delve into the examination of key physical characteristics of a human being, such as the face and fingerprints. User enrollment involves collecting essential user information, including facial and fingerprint data. A web camera is employed to capture live facial biometrics, while the Mantra Fingerprint sensor (MFS100) is utilized for the acquisition of the user’s fingerprint image. The collected facial images undergo preprocessing to reduce noise, and facial recognition is accomplished by detecting facial landmarks. Implementation of Convolutional Neural Network-based facial recognition is executed using the Dlib package. Additionally, we propose a methodology for fingerprint verification utilizing Scale Invariant Feature Transformation (SIFT). Distinctive SIFT feature points are extracted in scale space based on texture information around the feature points, facilitating effective matching. In this multimodal attendance system, real-time attendance marking is achieved by capturing facial images. The fingerprint image is subsequently captured and verified if the recognized face corresponds to a registered user. Attendance records are updated in the database, ensuring accuracy surpassing 70% identification.

Keywords

• Binarization
• Face Recognition
• Local Extreme
• Minutiae
• Multimodal Biometrics

References

1. REFERENCES
2. [1] Charity, A., Okokpujie, K., & Etinosa, N. O. (2017, November). A bimodal biometrie student attendance system. In 2017 IEEE 3rd International Conference on Electro-Technology for National Development (NIGERCON) (pp. 464-471). IEEE.
3. [2] Samatha, J., Manjusha, D., Pooja, B., & Usha, A. (2020). Student placement chance pre-diction. Journal of Emerging Technology & Innovative Research (JETIR), 7(5), 2349-5162.
4. [3] Juluri, S., SAGAR, D., REDDY, V. P., & Koundinya, G. S. (2020). VERIFICATION FOR ONLINE SIGNATURE BIOMETRICS USING DEEP LEARNING. I-Manager's Journal on Computer Science, 8(3).
5. [4] Memane, R., Jadhav, P., Patil, J., Mathapati, S., & Pawar, A. (2022, August). Attendance Monitoring System Using Fingerprint Authentication. In 2022 6th International Conference On Computing, Communication, Control And Automation (ICCUBEA (pp. 1-6). IEEE.
6. [5] DEMIR, I., & KARABOĞA, H. A. (2021). Modeling mathematics achievement with deep learning methods. Sigma: Journal of Engineering & Natural Sciences/Mühendislik ve Fen Bilimleri Dergisi, 39.
7. [6] Selçuk, A. L. P., YİĞİT, Ö. E., & Ersoy, Ö. Z. (2020). Prediction of bist price indices: a comparative study between traditional and deep learning methods. Sigma Journal of Engineering and Natural Sciences, 38(4), 1693-1704.
8. [7] Madhavi, G., & Samatha, J. (2020, May). Secure data storage and access of data in cloud using Elliptic curve cryptography. In IEEE J (Vol. 11).

9. [8] Sarker, D. K., Hossain, N. I., & Jamil, I. A. (2016, December). Design and implementation of smart attendance management system using multiple step authentication. In 2016 International Workshop on Computational Intelligence (IWCI) (pp. 91-95). IEEE.
10. [9] Gudavalli, M., Raju, S. V., Babu, A. V., & Kumar, D. S. (2012, March). Multimodal Biometrics--Sources, Architecture and Fusion Techniques: An Overview. In 2012 International Symposium on Biometrics and Security Technologies (pp. 27-34). IEEE.
11. [10] Soewito, B., Gaol, F. L., Simanjuntak, E., & Gunawan, F. E. (2016, July). Smart mobile attendance system using voice recognition and fingerprint on smartphone. In 2016 International Seminar on Intelligent Technology and Its Applications (ISITIA) (pp. 175-180). IEEE.
12. [11] Ouch, R., Garcia-Zapirain, B., & Yampolskiy, R. (2017, December). Multimodal biometrie systems: A systematic review. In 2017 IEEE international symposium on signal processing and information technology (ISSPIT) (pp. 439-444). IEEE.
13. [12] Debnath, S., Ramalakshmi, K., & Senbagavalli, M. (2022, January). Multimodal authentication system based on audio-visual data: A review. In 2022 International Conference for Advancement in Technology (ICONAT) (pp. 1-5). IEEE.
14. [13] Siswanto, A. R. S., Nugroho, A. S., & Galinium, M. (2014, September). Implementation of face recognition algorithm for biometrics based time attendance system. In 2014 International Conference on ICT For Smart Society (ICISS) (pp. 149-154). IEEE.
15. [14] Ariffin, S. M. Z. S. Z., Jamil, N., & Kasinathan, V. (2022, November). Image Fusion for Single-trait Multimodal Biometrics: A Brief Review. In 2022 IEEE 20th Student Conference on Research and Development (SCOReD) (pp. 13-18). IEEE.
16. [15] Sivakumar, P., Rathnam, B. R., Divakar, S., Teja, M. A., & Prasad, R. R. (2021, November). A Secure and Compact Multimodal Biometric Authentication Scheme using Deep Hashing. In 2021 IEEE International Conference on Intelligent Systems, Smart and Green Technologies (ICISSGT) (pp. 27-31). IEEE.
17. [16] Malathy, E. M., Sivamurugan, V., & Rajtilak, S. (2020, September). Performance Analysis and Enhancement to Biometric based Attendance System. In 2020 4th International Conference on Computer, Communication and Signal Processing (ICCCSP) (pp. 1-3). IEEE
18. [17] Nihan, K. A. Y. A., & Erdem, F. (2023). Artificial neural network approach for lead removal from aqueous solution by agricultural waste derived biochars. Sigma Journal of Engineering and Natural Sciences, 41(1), 64-73.
19. [18] Lu, Y., Fu, Y., Li, J., Li, X., & Kong, J. (2008, December). A multi-modal authentication method based on human face and palmprint. In 2008 Second International Conference on Future Generation Communication and Networking (Vol. 2, pp. 193-196). IEEE.
20. [19] Patil, P., & Shinde, S. (2020, November). Comparative analysis of facial recognition models using video for real time attendance monitoring system. In 2020 4th International Conference on Electronics, Communication and Aerospace Technology (ICECA) (pp. 850-855). IEEE.
21. [20] Ramalingam, M., Vinothkumar, S., Varadhaganapathy, S., & Subha, S. (2021, January). Multi-user authentication using biometric sensor using parallel processing algorithm for attendance monitoring. In 2021 6th International Conference on Inventive Computation Technologies (ICICT) (pp. 84-89). IEEE. [21] ER, B. A., ŞİŞMAN, A., & ARDALI, Y. (2022). Applicability of radial-based artificial neural networks (RBNN) on coliform calculation: A case of study. Sigma, 40(4), 724-731.
22. [22] Frischholz, R. W., & Dieckmann, U. (2000). BiolD: a multimodal biometric identification system. Computer, 33(2), 64-68.
23. [23] Utomo, S. B., & Hendradjaya, B. (2018, October). Multifactor authentication on mobile secure attendance system. In 2018 International Conference on ICT for Smart Society (ICISS) (pp. 1-5). IEEE.
24. [24] Maheswari, V. U., Aluvalu, R., & Mudrakola, S. (2022, March). An integrated number plate recognition system through images using threshold-based methods and KNN. In 2022 International Conference on Decision Aid Sciences and Applications (DASA) (pp. 493-497). IEEE.
25. [25] Gawande, U., & Golhar, Y. (2018). Biometric security system: a rigorous review of unimodal and multimodal biometrics techniques. International Journal of Biometrics, 10(2), 142-175.
26. [26] Khan, M. Y., & Ram, S. A. (2015, December). GPS enabled employee registration and attendance tracking system. In 2015 International Conference on Control, Instrumentation, Communication and Computational Technologies (ICCICCT) (pp. 62-65). IEEE.
27. [27] Charity, A., Okokpujie, K., & Etinosa, N. O. (2017, November). A bimodal biometrie student attendance system. In 2017 IEEE 3rd International Conference on Electro-Technology for National Development (NIGERCON) (pp. 464-471). IEEE.
28. [28] Yadav, A., Sharma, A., & Yadav, S. S. (2022, April). Attendance Management System Based on Face Recognition Using Haar-Cascade. In 2022 2nd International Conference on Advance Computing and Innovative Technologies in Engineering (ICACITE) (pp. 1972-1976). IEEE.
29. [29] Wagh, P., Thakare, R., Chaudhari, J., & Patil, S. (2015, October). Attendance system based on face recognition using eigen face and PCA algorithms. In 2015 International Conference on Green Computing and Internet of Things (ICGCIoT) (pp. 303-308). IEEE.
30. [30] Bhat, A., Rustagi, S., Purwaha, S. R., & Singhal, S. (2020, July). Deep-learning based group-photo attendance system using one shot learning. In 2020 International Conference on Electronics and Sustainable Communication Systems (ICESC) (pp. 546-551). IEEE.
31. [31] Agarwal, L., Mukim, M., Sharma, H., Bhandari, A., & Mishra, A. (2021, March). Face recognition based smart and robust attendance monitoring using deep CNN. In 2021 8th International Conference on Computing for Sustainable Global Development (INDIACom) (pp. 699-704). IEEE.
32. [32] Moura, A. F., Pereira, S. S., Moreira, M. W., & Rodrigues, J. J. (2020, December). Video monitoring system using facial recognition: A facenet-based approach. In GLOBECOM 2020-2020 IEEE Global Communications Conference (pp. 1-6). IEEE.
33. [33] Sawhney, S., Kacker, K., Jain, S., Singh, S. N., & Garg, R. (2019, January). Real-time smart attendance system using face recognition techniques. In 2019 9th international conference on cloud computing, data science & engineering (Confluence) (pp. 522-525). IEEE.
34. [34] Singh, S. (2019, July). A Neural Network based Attendance Monitoring and Database Management System using Fingerprint Recognition and Matching. In 2019 IEEE International Conference on Electronics, Computing and Communication Technologies (CONECCT) (pp. 1-7). IEEE.
35. [35] Sivakumar, P., Rathnam, B. R., Divakar, S., Teja, M. A., & Prasad, R. R. (2021, November). A Secure and Compact Multimodal Biometric Authentication Scheme using Deep Hashing. In 2021 IEEE International Conference on Intelligent Systems, Smart and Green Technologies (ICISSGT) (pp. 27-31). IEEE.
36. [36] Garg, V., Singhal, A., & Tiwari, P. (2018, January). a study on transformation in technological based biometrics attendance system: Human resource management practice. In 2018 8th International Conference on Cloud Computing, Data Science & Engineering (Confluence) (pp. 809-813). IEEE.
37. [37] Dhanalakshmi, N., Kumar, S. G., & Sai, Y. P. (2017, January). Aadhaar based biometric attendance system using wireless fingerprint terminals. In 2017 IEEE 7th international advance computing conference (IACC) (pp. 651-655). IEEE.
38. [38] Bouzouina, Y., & Hamami, L. (2017, August). Multimodal biometric: Iris and face recognition based on feature selection of iris with GA and scores level fusion with SVM. In 2017 2nd International Conference on Bio-engineering for Smart Technologies (BioSMART) (pp. 1-7). IEEE.
39. [39] Al-Waisy, A. S., Qahwaji, R., Ipson, S., Al-Fahdawi, S., & Nagem, T. A. (2018). A multi-biometric iris recognition system based on a deep learning approach. Pattern Analysis and Applications, 21, 783-802.
40. [40] Aronowitz, H., Li, M., Toledo-Ronen, O., Harary, S., Geva, A., Ben-David, S., ... & Nahamoo, D. (2014, September). Multi-modal biometrics for mobile authentication. In IEEE International Joint Conference on Biometrics (pp. 1-8). IEEE.
41. [41] Purohit, H., & Ajmera, P. K. (2021). Optimal feature level fusion for secured human authentication in multimodal biometric system. Machine Vision and Applications, 32, 1-12.
42. [42] Tripathi, S., Murgi, J., Soni, K. R. S., & Singh, R. (2021). A literature survey on multi model bio-metric system. J. Comput. Technol, 10, 1-5.
43. [43] Jagadiswary, D., & Saraswady, D. (2016). Biometric authentication using fused multimodal biometric. Procedia Computer Science, 85, 109-116.
44. [44] Arya, S., Agrawal, A., & Indore, I. (2018). Face recognition with partial face recognition and convolutional neural network. International Journal of Advanced Research in Computer Engineering & Technology (IJARCET), 7(1), 91-94.
45. [45] Waingankar, A., Upadhyay, A., Shah, R., Pooniwala, N., & Kasambe, P. (2018). Face recognition based attendance management system using machine learning. International Research Journal of Engineering and Technology (IRJET), 5(06), 1979-1985.
46. [46] Sharma, S., Shanmugasundaram, K., & Ramasamy, S. K. (2016, May). FAREC—CNN based efficient face recognition technique using Dlib. In 2016 international conference on advanced communication control and computing technologies (ICACCCT) (pp. 192-195). IEEE.
47. [47] Tyagi, S., Chawla, B., Jain, R., & Srivastava, S. (2022). Multimodal biometric system using deep learning based on face and finger vein fusion. Journal of Intelligent & Fuzzy Systems, 42(2), 943-955.
48. [48] Akrouf, S., Belayadi, Y., Mostefai, M., & Chahir, Y. (2011). A multi-modal recognition system using face and speech. International Journal of Computer Science Issues, 8(3), 1694-0814.
49. [49] Vishi, K., & Yayilgan, S. Y. (2013, October). Multimodal biometric authentication using fingerprint and iris recognition in identity management. In 2013 Ninth International Conference on Intelligent Information Hiding and Multimedia Signal Processing (pp. 334-341). IEEE.
50. [50] Jing, X. Y., Li, S., Li, W. Q., Yao, Y. F., Lan, C., Lu, J. S., & Yang, J. Y. (2012). Palmprint and face multi-modal biometric recognition based on SDA-GSVD and its kernelization. Sensors, 15(5), 5551-5571.
51. [51] Leghari, M., Memon, S., Dhomeja, L. D., Jalbani, A. H., & Chandio, A. A. (2021). Deep feature fusion of fingerprint and online signature for multimodal biometrics. Computers, 10(2), 21.
52. [52] Lowe, D. G. (2004). Distinctive image features from scale-invariant keypoints. International journal of computer vision, 60, 91-110.
53. [53] https://medium.com/data-breach/introduction-to-sift-scale-invariant-feature-transform-65d7f3a72d40
54. [54] Geeganage, J., Rathnayake, K., Fernando, V., Kumarasinghe, P., De Silva, S. D., Wuttisittikulkij, L., & Wijayasekara, S. K. (2022, May). Precise Integrated Contactless Attendance Tracking, Recording and Analyzing System. In 2022 19th International Conference on Electrical Engineering/Electronics, Computer, Telecommunications and Information Technology (ECTI-CON) (pp. 1-4). IEEE. [55] Nakagawa, T., Nakanishi, I., Itoh, Y., & Fukui, Y. (2005, December). Multi-modal biometrics authentication using on-line signature and voice pitch. In 2006 International Symposium on Intelligent Signal Processing and Communications (pp. 399-402). IEEE.
55. [56] Kiran, T. A., Reddy, N. D. K., Ninan, A. I., Krishnan, P., Aravindhar, D. J., & Geetha, A. (2020, September). Pca based facial recognition for attendance system. In 2020 International Conference on Smart Electronics and Communication (ICOSEC) (pp. 248-252). IEEE.
56. [57] Wang, J., Li, Y., Ao, X., Wang, C., & Zhou, J. (2009, August). Multi-modal biometric authentication fusing iris and palmprint based on GMM. In 2009 IEEE/SP 15th Workshop on Statistical Signal Processing (pp. 349-352). IEEE.
57. [58] Kumar, A., Verma, L., & Singh, T. (2022, April). Introduction to Multimodal Biometrics using OpenCV. In 2022 2nd International Conference on Advance Computing and Innovative Technologies in Engineering (ICACITE) (pp. 1505-1509). IEEE.
58. [59] Devi, R., & Sujatha, P. (2017, March). A study on biometric and multi-modal biometric system modules, applications, techniques and challenges. In 2017 Conference on Emerging Devices and Smart Systems (ICEDSS) (pp. 267-271). IEEE.
59. [60] Garg, V., Singhal, A., & Tiwari, P. (2018, January). a study on transformation in technological based biometrics attendance system: Human resource management practice. In 2018 8th International Conference on Cloud Computing, Data Science & Engineering (Confluence) (pp. 809-813). IEEE.
60. [61] Zhang, H., Huang, Z., & Li, Y. (2009, August). An overview of multi-modal biometrics based on face and ear. In 2009 IEEE International Conference on Automation and Logistics (pp. 1705-1709). IEEE.
61. [62] Middendorff, C., Bowyer, K. W., & Yan, P. (2007, June). Multi-modal biometrics involving the human ear. In 2007 IEEE Conference on Computer Vision and Pattern Recognition (pp. 1-2). IEEE.
62. [63] Kamelia, L., Hamidi, E. A. D., Darmalaksana, W., & Nugraha, A. (2018, July). Real-time online attendance system based on fingerprint and GPS in the smartphone. In 2018 4th international conference on wireless and telematics (ICWT) (pp. 1-4). IEEE. [64] CİHAN, M., UZBAŞ, B., & CEYLAN, M. (2023). Fusion and CNN based classification of liver focal lesions using magnetic resonance imaging phases. Sigma, 41(1), 135-145.