New Approaches, Technological Advancements, and Urban Applications in the Evaluation of Web-Based Spatial Digital Data Sources

Abstract

Recent technological advances have significantly transformed the acquisition, management, and use of web-based spatial data. This review evaluates the acquisition and application areas of spatial data from digital sources using web scraping and Application Programming Interface (API) based data extraction methods. The literature shows that such data are effectively used in areas such as urban planning, infrastructure management, and disaster management. Web scraping and API approaches can supplement spatial datasets obtained through traditional data collection methods by providing location and attribute information. However, data integrity, privacy, and standardization deficiencies are significant challenges to the more effective use of web-based spatial digital data sources. Despite this, these digital sources have become powerful tools that support thematic data integration, providing a holistic perspective on urban planning and management. Consequently, web-based spatial data sources not only facilitate data access but also support more holistic analyses and strategies by enabling the integration of diverse thematic datasets in urban planning and management.

Keywords

• Spatial Data
• Web Scraping
• API
• Digital Data
• Location

Web Tabanlı Mekânsal İçerikli Dijital Veri Kaynaklarının Değerlendirilmesinde Yeni Yaklaşımlar, Teknolojik Gelişmeler ve Kentsel Uygulama Örnekleri

Abstract

Son yıllardaki teknolojik gelişmeler, web tabanlı mekânsal içerikli dijital verilerin elde edilme, yönetim ve kullanım süreçlerinde önemli dönüşümler yaratmıştır. Bu derleme çalışmasında, web kazıma ve Uygulama Programlama Arayüzü (API) temelli veri çıkarım yöntemleriyle dijital kaynaklardan mekânsal verilerin elde edilmesi ve kullanım alanları değerlendirilmiştir. Literatürde bu tür verilerin kentsel planlama, altyapı ve afet yönetimi gibi alanlarda etkin biçimde kullanıldığı görülmektedir. Web kazıma ve uygulama programlama arayüzü yaklaşımları, geleneksel veri toplama yöntemleri ile elde edilen mekânsal veri setlerini lokasyon ve öznitelik bilgileri açısından destekleyebilmektedir. Ancak veri bütünlüğü, gizlilik ve standardizasyon eksiklikleri; web tabanlı mekânsal içerikli dijital veri kaynaklarının daha etkin bir şekilde kullanılmasının önündeki önemli zorluklardır. Buna rağmen bu dijital kaynaklar, kentsel planlama ve yönetime bütüncül bir bakış kazandırarak tematik veri entegrasyonunu destekleyen güçlü araçlar hâline gelmiştir. Sonuç olarak, web tabanlı mekânsal içerikli dijital veri kaynakları, yalnızca veriye erişimi kolaylaştırmakla kalmayıp; kentsel planlama ve yönetimde farklı tematik verilerin entegrasyonunu sağlayarak daha bütüncül analiz ve stratejilerin geliştirilmesine katkı sunmaktadır.

Keywords

• Mekânsal Veri
• Web kazıma
• API
• Dijital veri
• Lokasyon

Supporting Institution

Finansal destek bulunmamaktadır.

Ethical Statement

Bu çalışma için etik kurul iznine gerek yoktur. Buna ilişkin ıslak imzalı onam formu, makale süreç dosyasına eklenmiştir

Thanks

Teşekkür edilecek kişi veya kurum bulunmamaktadır.

References

1. Atwal, K. S., Anderson, T., Pfoser, D., & Züfle, A. (2022). Predicting building types using OpenStreetMap. Scientific Reports, 12(1), 19976.
2. Brindley, P., Goulding, J., & Wilson, M. L. (2018). Generating vague neighbourhoods through data mining of passive web data. International Journal of Geographical Information Science, 32(3), 498–523.
3. Burrough, P. A., & McDonnell, R. A. (1998). Principles of geographical information systems. Oxford University Press Inc., New York.
4. Calafiore, A., Palmer, G., Comber, S., Arribas-Bel, D., & Singleton, A. (2021). A geographic data science framework for the functional and contextual analysis of human dynamics within global cities. Computers, Environment and Urban Systems, 85, 101539.
5. Chen, F., Hou, J., Gu, X., Hou, J., Pan, Q., & Tang, Z. (2022). Research on temporal and spatial evolution of public’s response to the mandatory waste separation policy based on big data mining. Sustainable Production and Consumption, 31, 236–248.
6. Chow, T. E., Schuermann, R. T., Ngu, A. H., & Dahal, K. R. (2018). Spatial mining of migration patterns from web demographics. International Journal of Geographical Information Science, 32(10), 1977–1998. https://doi.org/10.1080/13658816.2018.1470633.
7. Deng, Y., Chen, R., Yang, J., Li, Y., Jiang, H., Liao, W., & Sun, M. (2022). Identify urban building functions with multisource data: A case study in Guangzhou, China. International Journal of Geographical Information Science, 36(10), 2060–2085.
8. Dolu, D. G., & Şen, A. (2024). Coğrafi referanslı sosyal medya verilerinden doğal dil işleme ve derin öğrenme kullanılarak duygu analizi: Kahramanmaraş depremleri örneği. Journal of Geodesy and Geoinformation, 11(1), 51–67. https://doi.org/10.9733/JGG.2024R0005.T.

9. Ensari, E., & Kobaş, B. (2018). Web scraping and mapping urban data to support urban design decisions. A/Z: ITU Journal of Faculty of Architecture, 15(1), 5–21. https://doi.org/10.5505/itujfa.2018.40360.
10. Fonte, C. C., Minghini, M., Antoniou, V., Patriarca, J., & See, L. (2018). Classification of building function using available sources of VGI. ISPRS-International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, 42, 209–215.
11. Gao, F., Huang, G., Li, S., Huang, Z., & Chai, L. (2021). Integrating the eigendecomposition approach and k-means clustering for inferring building functions with location-based social media data. ISPRS International Journal of Geo-Information, 10(12), 834.
12. Goodchild, M. F. (2007). Citizens as sensors: The world of volunteered geography. GeoJournal, 69(4), 211–221. https://doi.org/10.1007/s10708-007-9111-y.
13. Haan, K. (2025, 24 Ekim). Top Website Statistics For 2025. Forbes. https://www.forbes.com/advisor/business/software/website-statistics/
14. Han, J., Kamber, M., & Pei, J. (2012). Data Mining: Concepts and techniques (3rd ed.). Morgan Kaufmann Publishers is an imprint of Elsevier.
15. Jo, T. (2024). Text Mining: Concepts, implementation, and big data challenge. (2nd ed.) Springer.
16. Kilic, B., & Gülgen, F. (2020). Investigating the quality of reverse geocoding services using text similarity techniques and logistic regression analysis. Cartography and Geographic Information Science, 47(4), 336–349. https://doi.org/10.1080/15230406.2020.1746198.
17. Küçük, K. C., & Anbaroğlu, B. (2019). OpenStreetMap binalarının mekânsal doğruluğunun analizi. Türkiye Coğrafi Bilgi Sistemleri Dergisi, 1(1), 5–13.
18. Kuşak, L. (2010). Web ortamında mekânsal veri kazanımı (spatial data gain from web) (Yayın No. 350628) [Doktora Tezi, İstanbul Teknik Üniversitesi]. YÖK Ulusal Tez Merkezi.
19. Laender, A. H. F., Ribeiro-Neto, B. A., Da Silva, A. S., & Teixeira, J. S. (2002). A brief survey of web data extraction tools. ACM SIGMOD Record, 31(2), 84–93.
20. Li, D., Wang, S., & Li, D. (2015). Spatial data mining: Theory and application (1st ed.) Springer
21. Lin, Y., & Kant, S. (2021). Using social media for citizen participation: Contexts, empowerment, and inclusion. Sustainability, 13(12), 6635. https://doi.org/10.3390/su13126635.
22. Liu, X., Macedo, J., Zhou, T., Shen, L., Liao, Y., & Zhou, Y. (2018). Evaluation of the utility efficiency of subway stations based on spatial information from public social media. Habitat International, 79, 10–17.
23. Makhabel, B., Mishra, P., Danneman, N., & Heimann, R. (2017). R: Mining spatial, text, web, and social media data (1st ed). Packt Publishing.
24. Makice, K. (2009). Twitter API Up and Running. O’Reilly Media.
25. Martins, B. E. da G. M. (2008). Geographically aware web text mining [Doctoral dissertation, Universidade de Lisboa].
26. Memduhoğlu, A. (2024). 6 Şubat depremlerinden etkilenen şehirlere ait OpenStreetMap verilerinin niceliksel ve semantik analizi. Niğde Ömer Halisdemir Üniversitesi Mühendislik Bilimleri Dergisi, 13(4), 1264–1276. https://doi.org/10.28948/ngmuh.1476998.
27. Memduhoglu, A., & Basaraner, M. (2024). Semantic enrichment of building functions through geospatial data integration and ontological inference. Environment and Planning B: Urban Analytics and City Science, 51(4), 923–938. https://doi.org/10.1177/23998083231206165.
28. Mitchell, R. (2018). Web scraping with python collecting more data from the modern web (2nd ed.). O’Reilly Media.
29. Molina-Campoverde, J. J., Rivera-Campoverde, N., Molina Campoverde, P. A., & Bermeo Naula, A. K. (2024). Urban mobility pattern detection: development of a classification algorithm based on machine learning and GPS. Sensors, 24(12), 3884.
30. Mueller, J. P. (2004). Mining amazon web services: Building applications with the Amazon API. Sybex.
31. Nishimura, T., Nishida, K., Toda, H., & Sawada, H. (2017). Social media knows what road it is: Quantifying Road characteristics with geo-tagged posts. Social Network Analysis and Mining, 7(1), 57. https://doi.org/10.1007/s13278-017-0473-y.
32. Özbek, T. N. N., & Ercoskun, O. (2023). Planlamada açık veri portalları/etkileşimli haritalar: İzmir (Türkiye) - Sidney (Avustralya) örneği. Bilişim Teknolojileri Dergisi, 16(3), 207–220. https://doi.org/10.17671/gazibtd.1246353.
33. Petroutsos, E. (2014). Google Maps: Power tools for maximizing the API. McGraw Hill.
34. Rajnish, D. R., & Srivastava, D. M. (2023). Web data mining with Python: Discover and extract information from the web using Python. BPB Publications.
35. Richardson, L. (2025, 28 Nisan). Beautiful Soup. https://www.crummy.com/software/BeautifulSoup
36. Salazar-Carrillo, J., Torres-Ruiz, M., Davis, C. A., Quintero, R., Moreno-Ibarra, M., & Guzmán, G. (2021). Traffic congestion analysis based on a Web-GIS and data mining of traffic events from Twitter. Sensors, 21(9), 2964.
37. Scrapy. (2025, 28 Nisan). Scrapy. https://scrapy.org
38. Serere, H. N., Resch, B., & Havas, C. R. (2023). Enhanced geocoding precision for location inference of tweet text using spaCy, Nominatim and Google Maps. A comparative analysis of the influence of data selection. PLOS ONE, 18(3), e0282942.
39. Setiawan, E. B., Putera Husein, G., & Setiyadi, A. (2023). Travel route recommendation system based on weather prediction and geolocation technology. In 2023 International Conference on Informatics Engineering, Science & Technology (INCITEST), pp. 1–7. IEEE https://doi.org/10.1109/INCITEST59455.2023.10395920
40. Taşkanat, T., Karaağaç, A., Beşdok, E., & Bostanci, B. (2018). Kentsel sorunların yönetimi için bir gönüllü coğrafi bilgi mobil uygulaması geliştirilmesi. Geomatik, 3(1), 84–91. https://doi.org/10.29128/geomatik.371144
41. Tomlison, R. F. (1974). The application of electronic computing methods and techniques to the storage, compilation, and assessment of mapped data [Doctoral dissertation, University of London].
42. Üsküplü, T., & Çolakoğlu, B. (2019). Sosyal ağ verileri ve mekân dizim analizlerinin kentsel stratejiler geliştirmede kullanımı: Kadıköy örneği. Megaron, 14(2), 269-278. https://doi.org/10.14744/megaron.2019.58569
43. Vaggione, P. (2014). Urban planning for city leaders (2nd ed., Vol. 1). United Nations Human Settlements Programme (UN-Habitat). https://unhabitat.org/urban-planning-for-city-leaders-0
44. Wang, Y., Wang, T., Tsou, M.-H., Li, H., Jiang, W., & Guo, F. (2016). Mapping dynamic urban land use patterns with crowdsourced geo-tagged social media (Sina-Weibo) and commercial points of interest collections in Beijing, China. Sustainability, 8(11), 1202. https://doi.org/10.3390/su8111202
45. Zha, W., Ye, Q., Li, J., & Ozbay, K. (2023). A social media data-driven analysis for transport policy response to the COVID-19 pandemic outbreak in Wuhan, China. Transportation Research Part A: Policy and Practice, 172, 103669. https://doi.org/10.1016/j.tra.2023.103669
46. Zhang, Y., Zhao, H., & Long, Y. (2025). CMAB: A Multi-Attribute Building Dataset of China. Scientific Data, 12(1). https://doi.org/10.1038/s41597-025-04730-5
47. Zheng, Y., Zhang, X., Ou, J., & Liu, X. (2024). Identifying building function using multisource data: A case study of China’s three major urban agglomerations. Sustainable Cities and Society, 108, 105498. https://doi.org/10.1016/j.scs.2024.105498