IoT Generated Real-Time Big Data Analytics: A Systematic Literature Review

Timoteos Onur Özçelik; Sultan Nezihe Turhan

doi:10.35377/saucis...1671167

IoT Generated Real-Time Big Data Analytics: A Systematic Literature Review

Abstract

The Internet of Things (IoT) is a communication paradigm and a network of interconnected heterogeneous devices. It generates large-scale, fast-changing, and differently formatted data, a phenomenon referred to as Big Data, which has become widely used with the rapid growth of IoT applications, especially since the end of the first decade of the 2000s. The Internet of Things (IoT) is a communication paradigm and a network of interconnected heterogeneous devices. It generates large-scale, fast-changing, and differently formatted data, which is referred to as Big Data and has become widely used with the rapid growth of IoT applications, especially since the end of the first decade of the 2000s. A critical characteristic of this data is its real-time nature, which—coupled with its volume, velocity, and variety—demands advanced real-time analytics to extract value. While existing reviews have explored the broader intersection of IoT and Big Data Analytics, this paper provides a systematic, PRISMA-guided review focusing specifically on real-time analytics in IoT devices. By restricting the scope to real-time streaming data, the study provides a detailed synthesis that complements existing broader surveys. Applying the PRISMA methodology, we selected and analyzed 33 relevant articles published between 2018 and 2024. Our analysis reveals that scalable architectures are crucial for real-time Big Data analytics and that integrating machine learning techniques is fundamental to enabling intelligent decision-making. The study also underscores the necessity of appropriate data processing tools. The primary challenge in this area is minimizing latency, followed by data heterogeneity, scalability, and resource constraints. Furthermore, the survey identifies the critical role of real-time analytics in areas such as healthcare and smart cities. It discusses integrating fog and edge computing into future architectures to address latency and resource constraints.

Keywords

References

L. Atzori, A. Iera, and G. Morabito, “The Internet of Things: A survey,” Comput. Netw., vol. 54, no. 15, pp. 2787–2805, 2010, doi: 10.1016/j.comnet.2010.05.010
S. Bansal and D. Kumar, “IoT ecosystem: A survey on devices, gateways, operating systems, middleware and communication,” Int. J. Wireless Inf. Netw., vol. 27, no. 3, pp. 340–364, 2020, doi: 10.1007/s10776-020-00483-7?urlappend=%3Futm_source%3Dresearchgate.net%26utm_medium%3Darticle
K. Figueredo, D. Seed, and C. Wang, “A scalable, standards-based approach for IoT data sharing and ecosystem monetization,” IEEE Internet Things J., vol. 9, no. 8, pp. 5645–5652, 2020, doi:10.1109/JIOT.2020.3023035
A. Naghib, N. J. Navimipour, M. Hosseinzadeh, and A. Sharifi, “A comprehensive and systematic literature review on the big data management techniques in the Internet of Things,” Wireless Netw., vol. 29, no. 3, pp. 1085–1144, 2023, doi:10.1007/s11276-022-03177-5
V. E. Balas, V. K. Solanki, and R. Kumar, Internet of Things and big data applications: Recent advances and challenges. Cham, Switzerland: Springer, 2020, doi:10.1007/978-3-030-39119-5
J. Bzai, F. Alam, A. Dhafer, M. Bojović, S. M. Altowaijri, I. K. Niazi, and R. Mehmood, “Machine learning-enabled Internet of Things (IoT): Data, applications, and industry perspective,” Electronics, vol. 11, no. 17, Art. no. 2676, 2022, doi:10.3390/electronics11172676
W. Chen, Z. Milosevic, F. A. Rabhi, and A. Berry, “Real-time analytics: Concepts, architectures and ML/AI considerations,” IEEE Access, vol. 11, pp. 71634–71657, 2023, doi:10.1109/ACCESS.2023.3295694
M. Amelia and C. Lucas, “Optimizing hybrid and multi-cloud architectures for real-time analytics and data-driven decisions,” 2024, doi:10.13140/RG.2.2.29733.51682

R. Aurangzaib, W. Iqbal, M. Abdullah, F. Bukhari, F. Ullah, and A. Erradi, “Scalable containerized pipeline for real-time big data analytics,” in Proc. IEEE Int. Conf. Cloud Comput. Technol. Sci. (CloudCom), 2022, pp. 25–32, doi:10.1109/CloudCom55334.2022.00014
H. Jamil, T. Umer, C. Ceken, and F. Al-Turjman, “Decision-based model for real-time IoT analysis using big data and machine learning,” Wireless Pers. Commun., vol. 121, no. 4, pp. 2947–2959, 2021, doi:10.1007/s11277-021-08857-7
F. Wang, H. Wang, and O. R. Dehghan, “Machine learning techniques and big data analysis for Internet of Things applications: A review study,” Cybern. Syst., vol. 55, no. 1, pp. 1–41, 2024, doi:10.1080/01969722.2022.2103231
M. S. Murshed, C. Murphy, D. Hou, N. Khan, G. Ananthanarayanan, and F. Hussain, “Machine learning at the network edge: A survey,” ACM Comput. Surv., vol. 54, no. 8, pp. 1–37, 2021, doi:10.1145/3469029
D. Moher et al., “Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement,” Int. J. Surg., vol. 8, no. 5, pp. 336–341, 2010, doi: 10.1016/j.ijsu.2010.02.007
M. A. Makarem and M. A. Razaz, “Role of big data analytics in the Internet of Things: A comprehensive survey,” in Proc. 3rd Int. Conf. Emerg. Smart Technol. Appl. (eSmarTA), 2023, pp. 1–15, doi:10.1109/eSmarTA59349.2023.10293480
A. F. Ahmad, M. S. Sayeed, C. P. Tan, K. G. Tan, M. A. Bari, and F. Hossain, “A review on IoT with big data analytics,” in Proc. 9th Int. Conf. Inf. Commun. Technol. (ICoICT), 2021, pp. 160–164, doi:10.1109/ICoICT52021.2021.9527503
N. C. Taher, I. Mallat, N. Agoulmine, and N. El-Mawass, “An IoT-cloud based solution for real-time and batch processing of big data: Application in healthcare,” in Proc. 3rd Int. Conf. Bio-Eng. Smart Technol. (BioSMART), 2019, pp. 1–8, doi:10.1109/BIOSMART.2019.8734185
M. H. ur Rehman, I. Yaqoob, K. Salah, M. Imran, P. P. Jayaraman, and C. Perera, “The role of big data analytics in industrial Internet of Things,” Future Gener. Comput. Syst., vol. 99, pp. 247–259, 2019, doi:10.1016/j.future.2019.04.020
D. Fawzy, S. M. Moussa, and N. L. Badr, “The Internet of Things and architectures of big data analytics: Challenges of intersection at different domains,” IEEE Access, vol. 10, pp. 4969–4992, 2022, doi:10.1109/ACCESS.2022.3140409
S. K. Jain, D. Paikaray, et al., “Enhancing IoT networking through predictive big data processing,” in Proc. 2nd Int. Conf. Artif. Intell. Mach. Learn. Appl. (AIMLA), 2024, pp. 1–6, doi:10.1109/AIMLA59606.2024.10531430
K. Kiran, S. Sen, and S. Sharma, “Improving connectivity of IoT-enabled networks through big data analytics,” in Proc. 15th Int. Conf. Comput. Commun. Netw. Technol. (ICCCNT), 2024, pp. 1–6, doi:10.1109/ICCCNT61001.2024.10725690
F. Rehman, M. Anwar, A. U. Mujtaba, H. Sharif, and N. Riaz, “Big data analytics for AIoT network,” in Artificial intelligence of things (AIoT). Boca Raton, FL, USA: CRC Press, 2024, pp. 140–163, doi:10.1201/9781003430018-11
A. Karkouch, H. Mousannif, H. Al Moatassime, and T. Noel, “Data quality in Internet of Things: A state-of-the-art survey,” J. Netw. Comput. Appl., vol. 73, pp. 57–81, 2016, doi:10.1016/j.jnca.2016.08.002
S. Zhu, T. Dong, and X. R. Luo, “A longitudinal study of the actual value of big data and analytics: The role of industry environment,” Int. J. Inf. Manage., vol. 60, Art. no. 102389, 2021, doi:10.1016/j.ijinfomgt.2021.102389
N. Côrte-Real, P. Ruivo, and T. Oliveira, “Leveraging Internet of Things and big data analytics initiatives in European and American firms: Is data quality a way to extract business value?,” Inf. Manage., vol. 57, no. 1, Art. no. 103141, 2020, doi:10.1016/j.im.2019.01.003
S. Kaleem, A. Sohail, M. U. Tariq, and M. Asim, “An improved big data analytics architecture using federated learning for IoT-enabled urban intelligent transportation systems,” Sustainability, vol. 15, no. 21, Art. no. 15333, 2023, doi:10.3390/su152115333
S. K. Sharma and X. Wang, “Live data analytics with collaborative edge and cloud processing in wireless IoT networks,” IEEE Access, vol. 5, pp. 4621–4635, 2017, doi:10.1109/ACCESS.2017.2682640
M. Habiba, M. R. Islam, S. Muyeen, and A. S. Ali, “Edge intelligence for network intrusion prevention in IoT ecosystem,” Comput. Electr. Eng., vol. 108, Art. no. 108727, 2023, doi:10.1016/j.compeleceng.2023.108727
H. Cai, B. Xu, L. Jiang, and A. V. Vasilakos, “IoT-based big data storage systems in cloud computing: Perspectives and challenges,” IEEE Internet Things J., vol. 4, no. 1, pp. 75–87, 2016, doi:10.1109/JIOT.2016.2619369
S. S. Kona and F. Mirza, “Integrating IoT with big data platforms: Challenges, technologies and strategic business insights,” J. Artif. Intell. Cloud Comput., vol. 1, no. 1, pp. 1–15, 2023, doi: 10.47363/JAICC/2023(2)302
F. Alam, R. Mehmood, I. Katib, N. N. Albogami, and A. Albeshri, “Data fusion and IoT for smart ubiquitous environments: A survey,” IEEE Access, vol. 5, pp. 9533–9554, 2017, doi:10.1109/ACCESS.2017.2697839
S. B. Atitallah, M. Driss, W. Boulila, and H. B. Ghézala, “Leveraging deep learning and IoT big data analytics to support the smart cities development: Review and future directions,” Comput. Sci. Rev., vol. 38, Art. no. 100303, 2020, doi:10.1016/j.cosrev.2020.100303
C. Stergiou, K. E. Psannis, B. B. Gupta, and Y. Ishibashi, “Security, privacy and efficiency of sustainable cloud computing for big data and IoT,” Sustain. Comput. Inform. Syst., vol. 19, pp. 174–184, 2018, doi:10.1016/j.suscom.2018.06.003
M. Syafrudin, G. Alfian, N. L. Fitriyani, and J. Rhee, “Performance analysis of IoT-based sensor, big data processing, and machine learning model for real-time monitoring system in automotive manufacturing,” Sensors, vol. 18, no. 9, Art. no. 2946, 2018, doi:10.3390/s18092946
A. Ed-daoudy and K. Maalmi, “A new Internet of Things architecture for real-time prediction of various diseases using machine learning on big data environment,” J. Big Data, vol. 6, no. 1, Art. no. 104, 2019, doi:10.1186/s40537-019-0271-7
L. Mishra, S. D. Chouhan, and S. Varma, “Energy efficient smart working environment using IoT,” in Proc. IEEE 89th Veh. Technol. Conf. (VTC2019-Spring), 2019, pp. 1–5.
H. Nasiri, S. Nasehi, and M. Goudarzi, “Evaluation of distributed stream processing frameworks for IoT applications in smart cities,” J. Big Data, vol. 6, no. 1, Art. no. 52, 2019, doi:10.1186/s40537-019-0215-2
T. Sirisakdiwan and N. Nupairoj, “Spark framework for real-time analytic of multiple heterogeneous data streams,” in Proc. 2nd Int. Conf. Commun. Eng. Technol. (ICCET), 2019, pp. 1–5, doi:10.1109/ICCET.2019.8726886
Y. Tu, Y. Lu, G. Chen, J. Zhao, and F. Yi, “Architecture design of distributed medical big data platform based on Spark,” in Proc. IEEE 8th Joint Int. Inf. Technol. Artif. Intell. Conf. (ITAIC), 2019, pp. 682–685, doi:10.1109/ITAIC.2019.8785620
A. Akanbi and M. Masinde, “A distributed stream processing middleware framework for real-time analysis of heterogeneous data on big data platform: Case of environmental monitoring,” Sensors, vol. 20, no. 11, Art. no. 3166, 2020, doi: 10.3390/s20113166
A. Akanbi, “ESTEMD: A distributed processing framework for environmental monitoring based on Apache Kafka streaming engine,” in Proc. 4th Int. Conf. Big Data Res., 2020, pp. 18–25, doi:10.48550/arXiv.2104.01082
A. M. Fernández, D. Gutiérrez-Avilés, A. Troncoso, and F. Martínez-Alvarez, “Real-time big data analytics in smart cities from LoRa-based IoT networks,” in Proc. 14th Int. Conf. Soft Comput. Models Ind. Environ. Appl. (SOCO), 2020, pp. 91–100, doi:10.1007/978-3-030-20055-8_9
F. Hassan, M. E. Shaheen, and R. Sahal, “Real-time healthcare monitoring system using online machine learning and Spark streaming,” Int. J. Adv. Comput. Sci. Appl., vol. 11, no. 9, pp. 651–658, 2020, doi:10.14569/IJACSA.2020.0110977
C. Lehmann, L. G. Huber, T. Horisberger, G. Scheiba, A. C. Sima, and K. Stockinger, “Big data architecture for intelligent maintenance: A focus on query processing and machine learning algorithms,” J. Big Data, vol. 7, no. 1, Art. no. 61, 2020, doi:10.1186/s40537-020-00340-7
A. Roukh, F. N. Fote, S. A. Mahmoudi, and S. Mahmoudi, “Big data processing architecture for smart farming,” Procedia Comput. Sci., vol. 177, pp. 78–85, 2020, doi:10.1016/j.procs.2020.10.014
A. Cakir, O. Akın, H. F. Deniz, and A. Yılmaz, “Enabling real time big data solutions for manufacturing at scale,” J. Big Data, vol. 9, no. 1, Art. no. 118, 2022, doi:10.1186/s40537-022-00672-6
I. Dimitriadis, I. Mavroudopoulos, S. Kyrama, T. Toliopoulos, A. Gounaris, A. Vakali, A. Billis, and P. Bamidis, “Scalable real-time health data sensing and analysis enabling collaborative care delivery,” Soc. Netw. Anal. Min., vol. 12, no. 1, Art. no. 63, 2022, doi:10.1007/s13278-022-00891-y
A. I. Ebada, I. Elhenawy, C.-W. Jeong, Y. Nam, H. Elbakry, and S. Abdelrazek, “Applying Apache Spark on streaming big data for health status prediction,” Comput. Mater. Continua, vol. 70, no. 2, pp. 3511–3527, 2022, doi:10.32604/cmc.2022.019458
E. Mehmood and T. Anees, “Distributed real-time ETL architecture for unstructured big data,” Knowl. Inf. Syst., vol. 64, no. 12, pp. 3419–3445, 2022, doi:10.1007/s10115-022-01757-7
N. B. Oğur, M. Al-Hubaishi, and C. Çeken, “IoT data analytics architecture for smart healthcare using RFID and WSN,” ETRI J., vol. 44, no. 1, pp. 135–146, 2022, doi:10.4218/etrij.2020-0036
M. S. Rahman and R. K. Das, “RTID: On-demand real-time data processing for IoT network,” Mater. Today Proc., vol. 62, pp. 4721–4725, 2022, doi:10.1016/j.matpr.2022.03.168
B. M. Alencar, J. P. Canário, R. L. Neto, C. Prazeres, A. Bifet, and R. A. Rios, “Fog-DeepStream: A new approach combining LSTM and concept drift for data stream analytics on fog computing,” Internet Things, vol. 22, Art. no. 100731, 2023, doi:10.1016/j.iot.2023.100731
A. Ed-daoudy, K. Maalmi, and A. El Ouaazizi, “A scalable and real-time system for disease prediction using big data processing,” Multimedia Tools Appl., vol. 82, no. 20, pp. 30405–30434, 2023, doi:10.1007/s11042-023-14562-3
M. E. M. El Aissi, S. Benjelloun, Y. Lakhrissi, and S. Ali, “A scalable smart farming big data platform for real-time and batch processing based on lambda architecture,” J. Syst. Manag. Sci., vol. 13, no. 2, pp. 17–30, 2023.
A. M. Fernandez-Gomez, D. Gutiérrez-Avilés, A. Troncoso, and F. Martínez-Alvarez, “A new Apache Spark-based framework for big data streaming forecasting in IoT networks,” J. Supercomput., vol. 79, no. 10, pp. 11078–11100, 2023, doi:10.1007/s11227-023-05100-x
J. A. H. Castro, A. L. Najera, F. L. Orozco, and B. A. P. Rodríguez, “Acquisition, processing and visualization of meteorological data in real-time using Apache Flink,” in Data analytics and computational intelligence: Novel models, algorithms and applications. Cham, Switzerland: Springer, 2023, pp. 65–96, doi:10.1007/978-3-031-38325-0_4
X. Jiao, Z. Hou, M. Zhang, D. Feng, and Z. Cai, “Application of integrated energy data processing based on real-time stream processing platform,” in Proc. 4th Int. Conf. Comput. Sci. Manag. Technol., 2023, pp. 615–619, doi:10.1145/3644523.3644635
K. Khettabi, Z. Kouahla, B. Farou, H. Seridi, and M. A. Ferrag, “Efficient method for continuous IoT data stream indexing in the fog-cloud computing level,” Big Data Cogn. Comput., vol. 7, no. 2, Art. no. 119, 2023, doi:10.3390/bdcc7020119
A. Nuthalapati, “Building scalable data lakes for Internet of Things (IoT) data management,” Educ. Adm. Theory Pract., vol. 29, no. 1, pp. 412–424, 2023, doi:10.53555/kuey.v29i1.7323
A. Sadeghi-Nasab, H. Ghaffarian, and M. Rahmani, “Apache Flink and clustering-based framework for fast anonymization of IoT stream data,” Intell. Syst. Appl., vol. 20, Art. no. 200267, 2023, doi:10.1016/j.iswa.2023.200267
J. Zang and P. You, “An industrial IoT-enabled smart healthcare system using big data mining and machine learning,” Wireless Netw., vol. 29, no. 2, pp. 909–918, 2023, doi:10.1007/s11276-022-03129-z
Z. Cai, Z. Chen, X. Chen, R. Ma, H. Guan, and R. Buyya, “SPSC: Stream processing framework atop serverless computing for industrial big data,” IEEE Trans. Cybern., 2024, doi:10.1109/TCYB.2024.3407886
S. Mehdi, F. Khunjush, and J. Dogani, “Streaming traffic classification: A hybrid deep learning and big data approach,” Cluster Comput., vol. 27, no. 4, pp. 5165–5193, 2024, doi: 10.1007/s10586-023-04234-0
G. Iancu, S. N. Ciolofan, and M. Drăgoicea, “Real-time IoT architecture for water management in smart cities,” Discover Appl. Sci., vol. 6, no. 4, Art. no. 191, 2024, doi:10.1007/s42452-024-05855-9
S. S. Kumar, R. Chandra, and S. Agarwal, “A real-time approach for smart building operations prediction using rule-based complex event processing and SPARQL query,” J. Supercomput., vol. 80, no. 15, pp. 21569–21591, 2024, doi: 10.1007/s11227-024-06276-6

Details

Primary Language

English

Subjects

Software Architecture

Journal Section

Review

Authors

Timoteos Onur Özçelik ^*
0000-0002-7241-2018
Türkiye

Sultan Nezihe Turhan
0000-0001-9763-0882
Türkiye

Early Pub Date

June 17, 2026

Publication Date

June 17, 2026

Submission Date

April 7, 2025

Acceptance Date

November 24, 2025

Published in Issue

Year 2026 Volume: 9 Number: 2

DOI

https://doi.org/10.35377/saucis...1671167

IZ

https://izlik.org/JA94FB76JK

Cite

RIS / Bibtex

APA

Özçelik, T. O., & Turhan, S. N. (2026). IoT Generated Real-Time Big Data Analytics: A Systematic Literature Review. Sakarya University Journal of Computer and Information Sciences, 9(2), 634-649. https://doi.org/10.35377/saucis...1671167

AMA

1.Özçelik TO, Turhan SN. IoT Generated Real-Time Big Data Analytics: A Systematic Literature Review. SAUCIS. 2026;9(2):634-649. doi:10.35377/saucis.1671167

Chicago

Özçelik, Timoteos Onur, and Sultan Nezihe Turhan. 2026. “IoT Generated Real-Time Big Data Analytics: A Systematic Literature Review”. Sakarya University Journal of Computer and Information Sciences 9 (2): 634-49. https://doi.org/10.35377/saucis. 1671167.

EndNote

Özçelik TO, Turhan SN (June 1, 2026) IoT Generated Real-Time Big Data Analytics: A Systematic Literature Review. Sakarya University Journal of Computer and Information Sciences 9 2 634–649.

IEEE

[1]T. O. Özçelik and S. N. Turhan, “IoT Generated Real-Time Big Data Analytics: A Systematic Literature Review”, SAUCIS, vol. 9, no. 2, pp. 634–649, June 2026, doi: 10.35377/saucis...1671167.

ISNAD

Özçelik, Timoteos Onur - Turhan, Sultan Nezihe. “IoT Generated Real-Time Big Data Analytics: A Systematic Literature Review”. Sakarya University Journal of Computer and Information Sciences 9/2 (June 1, 2026): 634-649. https://doi.org/10.35377/saucis. 1671167.

JAMA

1.Özçelik TO, Turhan SN. IoT Generated Real-Time Big Data Analytics: A Systematic Literature Review. SAUCIS. 2026;9:634–649.

MLA

Özçelik, Timoteos Onur, and Sultan Nezihe Turhan. “IoT Generated Real-Time Big Data Analytics: A Systematic Literature Review”. Sakarya University Journal of Computer and Information Sciences, vol. 9, no. 2, June 2026, pp. 634-49, doi:10.35377/saucis. 1671167.

Vancouver

1.Timoteos Onur Özçelik, Sultan Nezihe Turhan. IoT Generated Real-Time Big Data Analytics: A Systematic Literature Review. SAUCIS. 2026 Jun. 1;9(2):634-49. doi:10.35377/saucis. 1671167