Transfer Learning for Turkish Cuisine Classification

Abstract

Thanks to developments in data-oriented domains like deep learning and big data, the integration of artificial intelligence with food category recognition has been a topic of interest for decades. The capacity of image classification to produce more precise outcomes in less time has made it a popular topic in computer vision. For the purpose of food categorization, three well-known CNN-based models—EfficientNetV2M, ResNet101, and VGG16—were fine-tuned in this research. Moreover, the pre-trained Vision Transformer (ViT) was used for feature extraction, followed by classification using a Random Forest (RF) algorithm. All the models were assessed on the TurkishFoods-15 dataset. It was found that the ViT and RF models were most effective in accurately capturing food images, with precision, recall, and F1-score values of 0.91, 0.86, and 0.88 respectively.

Keywords

• Food classification
• Deep learning
• Convolutional neural network
• Image classification
• Transfer learning
• ViT

References

1. Akan T, Alp S, Bhuiyan MAN. 2023. Vision transformers and Bi-LSTM for Alzheimer's disease diagnosis from 3D MRI. The 2023 Congress in Computer Science, Computer Engineering, & Applied Computing (CSCE), August 7-10, Las Vegas, NV, US, pp: 143.
2. Alp S, Akan T, Bhuiyan MS, Disbrow EA, Conrad SA, Vanchiere JA, Kevil CG, Bhuiyan MA. 2024. Joint transformer architecture in brain 3D MRI classification: its application in Alzheimer’s disease classification. Sci Rep, 14: 8996.
3. Alp S, Şenlik R. 2023. Transfer learning approach for classification of beef meat regions with CNN. The 2023 Innovations in Intelligent Systems and Applications Conference (ASYU), August 14-16, Sivas, Turkiye, pp: 1-5.
4. Beijbom O, Joshi N, Morris D, Saponas S, Khullar S. 2015. Menu-Match: restaurant-specific food logging from images. The 2015 IEEE Winter Conference on Applications of Computer Vision, January 5-9, Waikoloa, HI, USA, pp: 844-851.
5. Bossard L, Guillaumin M, Van Gool L. 2014. Food-101 – Mining discriminative components with random forests. In: Fleet D, Pajdla T, Schiele B, Tuytelaars T (eds) Computer Vision – ECCV 2014. ECCV 2014. Lecture Notes Computer Sci, 8694: 446-461.
6. Boyd L, Nnamoko N, Lopes R. 2024. Fine-grained food image recognition: A study on optimising convolutional neural networks for improved performance. J Imaging, 10(6): 126.
7. Chai J, Zeng H, Li A, Ngai EW. 2021. Deep learning in computer vision: a critical review of emerging techniques and application scenarios. Mach Learn Appl, 6: 100134.
8. Chen J, Zhu B, Ngo CW, Chua TS, Jiang YG. 2020. A study of multi-task and region-wise deep learning for food ingredient recognition. IEEE Trans Image Process, 30: 1514-1526.

9. Dosovitskiy A, Beyer L, Kolesnikov A, Weissenborn D, Zhai X, Unterthiner T, Dehghani M, Minderer M, Heigold G, Gelly S, Uszkoreit J, Houlsby N. 2021. An image is worth 16x16 words: transformers for image recognition at scale. URL= https://arxiv.org/abs/2010.11929 (accessed date: August 31, 2024).
10. Gao X, Xiao Z, Deng Z. 2024. High accuracy food image classification via vision transformer with data augmentation and feature augmentation. J Food Eng, 365: 111833.
11. Güngör C, Baltacı F, Erdem A, Erdem E. 2017. Turkish cuisine: a benchmark dataset with Turkish meals for food recognition. The 2017 25th Signal Processing and Journal: Communications Applications Conference (SIU), May 15-17, Antalya, Türkiye, pp: 1-4.
12. He K, Zhang X, Ren S, Sun J. 2016. Deep residual learning for image recognition. In: Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), June 27-30, Las Vegas, NV, USA, pp. 770-778.
13. Kawano Y, Yanai K. 2015. Automatic expansion of a food image dataset leveraging existing categories with domain adaptation. In: Proceedings of the Computer Vision - ECCV 2014 Workshops, September 6-, Zurich, Switzerland, pp: 3–17.
14. Kayıkçı Ş, Başol Y, Dörter E. 2019. Classification of Turkish cuisine with deep learning on mobile platform. The 4th International Conference on Computer Science and Engineering (UBMK), September 19-21, Samsun, Türkiye, pp: 1-5.
15. Kiourt C, Pavlidis G, Markantonatou S. 2020. Deep learning approaches in food recognition. In: Tsihrintzis G, Jain L, editors. Machine learning paradigms. Learning and analytics in intelligent systems, vol 18. Springer, Cham, Germany, pp: 83-108.
16. Nijhawan R, Sinha G, Batra A, Kumar M, Sharma H. 2024. VTnet+ handcrafted based approach for food cuisines classification. Multimedia Tools Appl, 83(4): 10695-10715.
17. Simonyan K, Zisserman A. 2015. Very deep convolutional networks for large-scale image recognition. URL= https://arxiv.org/abs/1409.1556 (accessed date: August 31, 2024).
18. Suddul G, Seguin JFL. 2023. A comparative study of deep learning methods for food classification with images. Food Humanity, 1: 800-808.
19. Tan M, Le Q. 2019. EfficientNet: rethinking model scaling for convolutional neural networks. The 36th International Conference on Machine Learning, June 9-15, Long Beach, CA, US, pp: 6105-6114.
20. Tan M, Le Q. 2021. EfficientNetV2: smaller models and faster training. The 38th International Conference on Machine Learning, July 18-24, Virtual Conference, pp: 10096-10106.
21. Yang S, Chen M, Pomerleau D, Sukthankar R. 2010. Food recognition using statistics of pairwise local features. The 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, June 13-18, San Francisco, CA, US, pp: 2249-2256.
22. Zhang Y, Deng L, Zhu H, Wang W, Ren Z, Zhou Q, Lu S, Sun S, Zhu Z, Gorriz JM. 2023. Deep learning in food category recognition. Inf Fusion, 98: 101859.