Research Article

Comprehensive Analysis of Provenance-Based APT Detection: An Evaluation-First Modeling Perspective

Volume: 9 Number: 1 February 16, 2026

Comprehensive Analysis of Provenance-Based APT Detection: An Evaluation-First Modeling Perspective

Abstract

Advanced Persistent Threats (APTs) are multi-stage campaigns whose stealthy activity can be surfaced using system-level provenance. Although many provenance-based intrusion detection systems (PIDS) have been proposed, their evaluations remain difficult to compare because studies report results at different granularities, use inconsistent stage language and metrics, and frequently omit the denominators needed to interpret campaign-level claims. This paper presents an evaluation-first perspective on peer-reviewed provenance-based APT detection research by synthesizing 76 studies published in 2017--2025, normalizing analysis and alerting to canonical evidence units (node, subgraph, and graph), aligning stage descriptions to a MITRE ATT&CK--consistent taxonomy, and tracing how methodological choices map to Security Operations Center (SOC) functions and analyst-facing outputs. The synthesis indicates that anomaly-driven learning dominates detection-oriented pipelines, while triage and storyline support center on node-level artifacts in one-twelfth of studies each (within the subset with mappable alert units), and it highlights pervasive reporting gaps in alert units, operational metrics, robustness testing, and end-to-end evaluation assumptions that limit reproducibility and operational interpretation. To enable campaign-level comparability, Campaign Recall (CR) is introduced as a standardized campaign-breadth measure with a reproducible denominator protocol grounded in observable stages derived from documented scenario mappings and an explicit evidence rule. Finally, leakage-aware evaluation guidance, dataset--metric compatibility notes, and a concise reporting checklist are provided to improve comparability and SOC relevance in future provenance-based APT detection studies.

Keywords

Advanced persistent threats, Campaign recall, Evaluation protocol, Graph modeling, Intrusion detection, MITRE ATT&CK, Security operations center, System provenance

References

  1. [1] M. Zipperle, F. Gottwalt, E. Chang, et al., Provenance-based intrusion detection systems: A survey, ACM Comput. Surv., 55(7) (2022), 1–36, Article ID 135. https://doi.org/10.1145/3539605
  2. [2] Y. Lv, S. Qin, Z. Zhu, et al., A review of provenance graph based APT attack detection: Applications and developments, In: Proceedings of the 7th IEEE International Conference on Data Science in Cyberspace (DSC), (2022), pp. 498–505. https://doi.org/10.1109/DSC55868.2022.00075
  3. [3] B. Zhang, Y. Gao, B. Kuang, et al., A survey on advanced persistent threat detection: A unified framework, challenges, and countermeasures, ACM Comput. Surv., 57(3) (2025), 1–36, Article ID 62. https://doi.org/10.1145/3700749
  4. [4] MITRE Corporation, Enterprise ATT&CK matrix, (2025). Available at: https://attack.mitre.org/matrices/enterprise/. Accessed September 25, 2025.
  5. [5] X. Han, T. F. J.-M. Pasquier, A. Bates, et al., UNICORN: Runtime provenance-based detector for advanced persistent threats, In: Proceedings of the Network and Distributed System Security Symposium (NDSS), (2020). https://doi.org/10.14722/ndss.2020.24046
  6. [6] C. Xiong, T. Zhu, W. Dong, et al., CONAN: A practical real-time APT detection system with high accuracy and efficiency, IEEE Trans. Dependable Secure Comput., 19(1) (2022), 551–565. https://doi.org/10.1109/TDSC.2020.2971484
  7. [7] T. Zhu, J. Yu, C. Xiong, et al., APTSHIELD: A stable, efficient and real-time APT detection system for Linux hosts, IEEE Trans. Dependable Secure Comput., 20(6) (2023), 5247–5264. https://doi.org/10.1109/TDSC.2023.3243667
  8. [8] Q. Liu, K. Bao, V. Hagenmeyer, COMMANDER: A robust cross-machine multi-phase advanced persistent threat detector via provenance analytics, J. Inf. Secur. Appl., 91 (2025), Article ID 104057. https://doi.org/10.1016/j.jisa.2025.104057
  9. [9] Z. Cheng, Q. Lv, J. Liang, et al., KAIROS: Practical intrusion detection and investigation using whole-system provenance, In: Proceedings of the IEEE Symposium on Security and Privacy (SP), (2024), pp. 3533–3551. https://doi.org/10.1109/SP54263.2024.00005
  10. [10] Md. N. Hossain, S. M. Milajerdi, J. Wang, et al., SLEUTH: Real-time attack scenario reconstruction from COTS audit data, In: Proceedings of the 26th USENIX Security Symposium (USENIX Security 17), (2017), pp. 487–504. https://doi.org/10.48550/arXiv.1801.02062
APA
İpekbayrak, M., & Gürkaş Aydın, Z. (2026). Comprehensive Analysis of Provenance-Based APT Detection: An Evaluation-First Modeling Perspective. Journal of Mathematical Sciences and Modelling, 9(1), 13-26. https://doi.org/10.33187/jmsm.1825484
AMA
1.İpekbayrak M, Gürkaş Aydın Z. Comprehensive Analysis of Provenance-Based APT Detection: An Evaluation-First Modeling Perspective. Journal of Mathematical Sciences and Modelling. 2026;9(1):13-26. doi:10.33187/jmsm.1825484
Chicago
İpekbayrak, Mustafa, and Zeynep Gürkaş Aydın. 2026. “Comprehensive Analysis of Provenance-Based APT Detection: An Evaluation-First Modeling Perspective”. Journal of Mathematical Sciences and Modelling 9 (1): 13-26. https://doi.org/10.33187/jmsm.1825484.
EndNote
İpekbayrak M, Gürkaş Aydın Z (March 1, 2026) Comprehensive Analysis of Provenance-Based APT Detection: An Evaluation-First Modeling Perspective. Journal of Mathematical Sciences and Modelling 9 1 13–26.
IEEE
[1]M. İpekbayrak and Z. Gürkaş Aydın, “Comprehensive Analysis of Provenance-Based APT Detection: An Evaluation-First Modeling Perspective”, Journal of Mathematical Sciences and Modelling, vol. 9, no. 1, pp. 13–26, Mar. 2026, doi: 10.33187/jmsm.1825484.
ISNAD
İpekbayrak, Mustafa - Gürkaş Aydın, Zeynep. “Comprehensive Analysis of Provenance-Based APT Detection: An Evaluation-First Modeling Perspective”. Journal of Mathematical Sciences and Modelling 9/1 (March 1, 2026): 13-26. https://doi.org/10.33187/jmsm.1825484.
JAMA
1.İpekbayrak M, Gürkaş Aydın Z. Comprehensive Analysis of Provenance-Based APT Detection: An Evaluation-First Modeling Perspective. Journal of Mathematical Sciences and Modelling. 2026;9:13–26.
MLA
İpekbayrak, Mustafa, and Zeynep Gürkaş Aydın. “Comprehensive Analysis of Provenance-Based APT Detection: An Evaluation-First Modeling Perspective”. Journal of Mathematical Sciences and Modelling, vol. 9, no. 1, Mar. 2026, pp. 13-26, doi:10.33187/jmsm.1825484.
Vancouver
1.Mustafa İpekbayrak, Zeynep Gürkaş Aydın. Comprehensive Analysis of Provenance-Based APT Detection: An Evaluation-First Modeling Perspective. Journal of Mathematical Sciences and Modelling. 2026 Mar. 1;9(1):13-26. doi:10.33187/jmsm.1825484