SUPERPIXEL BASED TEXT LINE SEGMENTATION

Abstract

Text line segmentation is one of the essential stages of historical document analysis applications. The accuracy of text line segmentation affects directly the success of following document analysis steps.  For printed documents, lossless text line segmentation can be done readily. But, for handwritten documents, unfortunately it is still a challenging problem because of the skewed, curved, fluctuated text lines, narrow gaps between the text lines, overlapping and touching components. In this paper, a novel superpixel-based text line segmentation method for handwritten documents is proposed. This method aims to extract the most reliable boundary to segment consecutive text lines.  This method is implemented HIT-MW dataset containing 853 Chinese handwritten document images. The most important feature of this dataset is to be composed of documents having skewed, overlapping and touching text lines.  A detection rate of 98.03% and a recognition accuracy of 97.66% is obtained and these results are compared with the ones of existing state of the art methods. With these results, segmentation success and potential of our method for handwriting text line segmentation is pointed out.

Keywords

• Superpixel,Text Line Segmentation,Handwritten Document,Document Image Analysis,Watershed Segmentation

SÜPERPİKSEL TABANLI SATIR BÖLÜTLEME

Abstract

Satır bölütleme tarihi doküman analizi uygulamalarının en temel aşamalarından birisidir. Satır bölütleme başarısı, daha sonraki doküman analizi yöntemlerinin başarısını doğrudan etkilemektedir. Matbu belgelerde kayıpsız satır bölütleme işlemi kolaylıkla yapılabilmektedir. Ancak, el yazımı belgeler için satır bölütleme işlemi metin satırlarının eğik, eğri, dalgalı olması, satırlar arası boşlukların darlığı, örtüşen ve temas eden bileşenlerden dolayı hala zorlayıcı bir problemdir. Bu çalışmada, el yazımı dokümanlar için süperpiksel tabanlı yeni bir satır bölütleme yöntemi önerilmiştir. Yöntem ardışık satırları bölütleyebilen en güvenli sınırın elde edilmesini hedeflemektedir. Önerilen yöntem 853 adet Çince el yazımı doküman imgesi içeren HIT-MW veri seti üzerinde uygulanmıştır. Veri setinin en önemli özelliği eğik, temas eden ve örtüşen satır davranışlarına sahip imgelerden oluşmasıdır. Önerilen yöntem ile % 98.03 tespit oranı, % 97.66 tanıma doğruluğu elde edilmiş ve yöntemin başarısı literatürde bulunan diğer yöntemlerle karşılaştırılmıştır. Elde edilen sonuçlar ışığında önerilen yöntemin el yazımı metinlerde satır bölütleme uygulamalarındaki başarısı ve potansiyeli ortaya konmuştur. 

Keywords

• Süperpiksel,Satır Bölütleme,El Yazısı Belge,Doküman İmgesi Analizi,Metin Satırı Çıkarımı,Havza Bölütleme

References

1. Adiguzel, H., Sahin, E., Duygulu, P., 2012. A Hybrid Approach for Line Segmentation in Handwritten Documents. In Frontiers in Handwriting Recognition (ICFHR), 2012 International Conference on (pp. 503-508). IEEE.
2. Alaei, A., Pal, U., Nagabhushan, P., 2011. A New Scheme for Unconstrained Handwritten Text-Line Segmentation. Pattern Recognition, 44(4), 917-928.
3. Arivazhagan, M., Srinivasan, H., Srihari, S. (2007, January). A statistical approach to line segmentation in handwritten documents. In Document Recognition and Retrieval XIV (Vol. 6500, p. 65000T). International Society for Optics and Photonics.
4. Ataer, E., Duygulu, P., 2006. Retrieval of Ottoman Documents. In Proceedings of the 8th ACM International Workshop on Multimedia Information Retrieval (MIR '06). ACM, New York, NY, USA, 155-162.
5. Du, X., Pan, W., Bui, T. D. (2009). Text line segmentation in handwritten documents using Mumford–Shah model. Pattern Recognition, 42(12), 3136-3145.
6. Fulkerson, B., Vedaldi, A., Soatto, S. (2009, September). Class segmentation and object localization with superpixel neighborhoods. In Computer Vision, 2009 IEEE 12th International Conference on (pp. 670-677). IEEE.
7. Han, X., Yao, H., Zhong, G. (2017, February). Handwritten text line segmentation by spectral clustering. In Eighth International Conference on Graphic and Image Processing (ICGIP 2016) (Vol. 10225, p. 102251A). International Society for Optics and Photonics.
8. He, X., Zemel, R. S., Ray, D. (2006, May). Learning and incorporating top-down cues in image segmentation. In European conference on computer vision (pp. 338-351). Springer, Berlin, Heidelberg.

9. Hoiem, D., Efros, A. A., Hebert, M. (2005, July). Automatic photo pop-up. In ACM transactions on graphics (TOG) (Vol. 24, No. 3, pp. 577-584). ACM.
10. Hull, J. J. (1998). Document Image Skew Detection: Survey and Annotated Bibliography. Document Analysis Systems II, 40-64.
11. Koo, H. I., Cho, N. I. (2012). Text-line Extraction in Handwritten Chinese Documents Based on An Energy Minimization Framework. IEEE Transactions on Image Processing, 21(3), 1169-1175.
12. Li, Y., Sun, J., Tang, C. K., Shum, H. Y. (2004, August). Lazy snapping. In ACM Transactions on Graphics (ToG) (Vol. 23, No. 3, pp. 303-308). ACM.
13. Li, Y., Zheng, Y., Doermann, D., Jaeger, S. (2008). Script-Independent Text Line Segmentation in Freestyle Handwritten Documents. IEEE Transactions on Pattern Analysis and Machine Intelligence, 30(8), 1313-1329.
14. Likforman-Sulem, L., Hanimyan, A., Faure, C. (1995, August). A Hough Based Algorithm for Extracting Text Lines in Handwritten Documents. In Document Analysis and Recognition, 1995., Proceedings of the Third International Conference on (Vol. 2, pp. 774-777). IEEE.
15. Louloudis, G., Gatos, B., Pratikakis, I., Halatsis, K. (2006, October). A Block-Based Hough Transform Mapping for Text Line Detection in Handwritten Documents. In Tenth International Workshop on Frontiers in Handwriting Recognition. Suvisoft.
16. Louloudis, G., Gatos, B., Pratikakis, I., Halatsis, C. (2008). Text Line Detection in Handwritten Documents. Pattern Recognition, 41(12), 3758-3772.
17. Nagy, G., Seth, S., Viswanathan, M. (1992). A prototype document image analysis system for technical journals. Computer, 25(7), 10-22.
18. O'Gorman, L. (1993). The document spectrum for page layout analysis. IEEE Transactions on Pattern Analysis and Machine Intelligence, 15(11), 1162-1173.
19. Ryu, J., Koo, H. I., Cho, N. I. (2014). Language-Independent Text-Line Extraction Algorithm for Handwritten Documents. IEEE Signal Processing Letters, 21(9), 1115-1119.
20. Saabni, R., Asi, A., El-Sana, J. (2014). Text Line Extraction for Historical Document Images. Pattern Recognition Letters, 35, 23-33.
21. Soille, P. (2013). Morphological Image Analysis: Principles and Applications. Springer Science & Business Media.
22. Stamatopoulos, N., Gatos, B., Louloudis, G., Pal, U., Alaei, A. (2013, August). ICDAR 2013 handwriting segmentation contest. In Document Analysis and Recognition (ICDAR), 2013 12th International Conference on (pp. 1402-1406). IEEE.
23. Su, T., Zhang, T., Guan, D. (2007). Corpus-based HIT-MW database for offline recognition of general-purpose Chinese handwritten text. International Journal of Document Analysis and Recognition (IJDAR), 10(1), 27.
24. Vincent, L., Soille, P. (1991). Watersheds in digital spaces: an efficient algorithm based on immersion simulations. IEEE Transactions on Pattern Analysis & Machine Intelligence, (6), 583-598.
25. Yin, F., Liu, C. L. (2009). Handwritten Chinese text line segmentation by clustering with distance metric learning. Pattern Recognition, 42(12), 3146-3157.
26. Zhang, L., Gao, Y., Xia, Y., Lu, K., Shen, J., Ji, R. (2014). Representative Discovery of Structure Cues for Weakly-Supervised Image Segmentation. IEEE Trans. Multimedia, 16(2), 470-479.
27. Ziaratban, M., Faez, K. (2010, August). An adaptive script-independent block-based text line extraction. In Pattern Recognition (ICPR), 2010 20th International Conference on (pp. 249-252). IEEE.