NLP-Based Problem-Solution Relationship Extraction and Mapping in Computer Architecture Literature

Abstract

Research in computer architecture typically follows a structured approach, addressing narrowly defined problems with specialized solutions. Because these articles exhibit consistent writing patterns, they are highly suitable for automated analysis. In this paper, a natural language processing (NLP) workflow is presented for classifying research papers based on the specific problems they investigate and the solutions they propose. By mapping these problem-solution relationships across a large corpus of articles, the proposed approach identifies frequently studied pairings, reveals historical research trends, and uncovers potential gaps in the literature, thereby helping direct future academic work.

Keywords

• Natural language processing
• literature survey
• text embeddings
• topic modeling
• computer architecture

Bilgisayar Mimarisi Literatüründe NLP Tabanlı Problem-Çözüm İlişkisi Çıkarımı ve Haritalandırması

Abstract

Bilgisayar mimarisi alanındaki araştırmalar, tipik olarak yapılandırılmış bir yaklaşım izlemekte ve dar kapsamlı olarak tanımlanmış problemleri özelleşmiş çözümlerle ele almaktadır. Bu makaleler tutarlı yazım örüntüleri sergilediklerinden dolayı otomatik analize son derece uygundurlar. Bu çalışmada, araştırma makalelerini inceledikleri spesifik problemlere ve önerdikleri çözümlere göre sınıflandırmak amacıyla bir doğal dil işleme (NLP) iş akışı sunulmaktadır. Önerilen bu yaklaşım, söz konusu problem-çözüm ilişkilerini geniş bir makale derlemi üzerinde haritalandırarak sıklıkla çalışılan eşleşmeleri tespit etmekte, tarihsel araştırma eğilimlerini ortaya koymakta ve literatürdeki olası boşlukları açığa çıkararak gelecekteki akademik çalışmalara yön verilmesine yardımcı olmaktadır.

Keywords

• Doğal dil işleme
• literatür taraması
• metin gömmeleri
• konu modelleme
• bilgisayar mimarisi

References

1. [1] B. Kolukisa, B. K. Dedeturk, B. A. Dedeturk, A. Gulsen, and G. Bakal, A comparative analysis on medical article classification using text mining & machine learning algorithms, in: 2021 6th International Conference on Computer Science and Engineering (UBMK), IEEE, 2021, pp. 360–365.
2. [2] İnal, Y., Bakal, G., and Eşit, M., Multi-Method Text Summarization: Evaluating Extractive and BART-Based Approaches on CNN/Daily Mail, in: 2025 9th International Symposium on Innovative Approaches in Smart Technologies (ISAS), IEEE, 2025, pp. 1-7.
3. [3] C. Yiran, Y. Xie, L. Song, F. Chen, and T. Tang., A survey of accelerator architectures for deep neural networks, Engineering 6 (3) (2020) 264–274.
4. [4] S. Mittal, A survey of ReRAM-based architectures for processing-in-memory and neural network acceleration, Machine learning and knowledge extraction 1 (2018) 75–114.
5. [5] J. Cong, M. A. Ghodrat, M. Gill, B. Grigorian, and G. Reinman, Accelerator-rich architectures:Opportunities and progresses, in: 2014 51st ACM/EDAC/IEEE Design Automation Conference(DAC), IEEE, 2014, pp. 1–6.
6. [6] M. Grootendorst, BERTopic: Neural topic modeling with a class-based TF-IDF procedure, arXiv preprint arXiv:2203.05794, 2022.
7. [7] N. Reimers and I. Gurevych, Sentence-BERT: Sentence embeddings using Siamese BERT-networks, in: Proceedings of the 2019 conference on empirical methods in natural language processing and the 9th international joint conference on natural language processing (EMNLP-IJCNLP), ACL, 2019, pp. 3982–3992.
8. [8] M. Karabacak and K. Margetis, Natural language processing reveals research trends and topics in the spine journal over two decades: a topic modeling study, The Spine Journal 24 (3) (2024) 397–405.

9. [9] M. Karabacak, P. Jagtiani, A. Jain, F. Panov, and K. Margetis, Tracing topics and trends in drug-resistant epilepsy research using a natural language processing-based topic modeling approach, Epilepsia 65 (4) (2024) 861–872.
10. [10] T. U. Sen, M. C. Yakit, M. S. Gumus, O. Abar, and G. Bakal, Combining N-grams and graph convolution for text classification, Applied Soft Computing 175 (2025) 113092.
11. [11] J. Sawicki, M. Ganzha, and M. Paprzycki, The state of the art of natural language processing–A systematic automated review of NLP literature using NLP techniques, Data Intelligence 5 (3) (2023) 707–749.
12. [12] T. U. Sen and G. Bakal, A transfer learning application on the reliability of psychological drugs’ comments, in: 2023 International Conference on Smart Applications, Communications and Networking (SmartNets), IEEE, 2023, pp. 1–6.
13. [13] IEEE Xplore Digital Library (2026) Accessed 15 Jan 2026.
14. [14] ACM Digital Library (2026) Accessed 15 Jan 2026.
15. [15] arXiv, Cornell University Library, Ithaca, NY, USA (2026) Accessed 15 Jan 2026.
16. [16] PyMuPDF: A high performance Python library for data extraction, analysis, conversion and manipulation of PDF (and other) documents (2026) Accessed 15 Jan 2026.
17. [17] M. Honnibal, I. Montani, S. Van Landeghem, and A. Boyd, spaCy: Industrial-strength natural language processing in Python (2020) Accessed 15 Jan 2026.
18. [18] Sentence-transformers/all-MiniLM-L6-v2 (2026) Accessed 15 Jan 2026.
19. [19] I. Beltagy, K. Lo, and A. Cohan, SciBERT: A pretrained language model for scientific text, in: Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP), Association for Computational Linguistics, 2019, pp. 3615–3620.
20. [20] G. Stanovsky, J. Michael, L. Zettlemoyer, and I. Dagan, Supervised open information extraction, in: Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers), Association for Computational Linguistics, 2018, pp. 885–895.