Privacy-Aware Customer Analytics in Physical Stores Using an Edge-Cloud Hybrid Artificial Intelligence System
Abstract
Customer analytics in physical stores must operate under three simultaneous constraints that are absent or weaker in online retail: limited on-site computation, strict personal-data privacy obligations, and the lack of a natural digital record of customer behavior. This study proposes an end-to-end edge-cloud hybrid artificial intelligence (AI) system that addresses these constraints jointly. On the edge side, an NVIDIA Jetson Nano device equipped with a Sony IMX477 camera performs motion detection, face detection, person detection, person re-identification, and demographic and affective attribute extraction (age, gender, ethnicity, emotion). Faces are detected and masked on the edge device, so unmasked facial biometrics are never transmitted to or stored in the cloud; person re-identification feature vectors are held only in volatile memory and purged daily. On the cloud side, scheduled batch tasks extract clothing, style, and color using Mask R-CNN, a VGG network, and k-means clustering with nearest-neighbor color mapping. Age, gender, and ethnicity are recognized by a single multi-task ResNet50 model trained on a merged UTKFace and FairFace dataset; emotion is recognized by a compact custom convolutional network trained on FER-2013. The system was validated end-to-end in a 45-participant in-store pilot study; per-class accuracy, precision, recall, and F1 values are reported with 95% confidence intervals given the pilot's small sample. The two core pipeline capabilities, person detection and person re-identification, reached 93% and 61% respectively under in-store conditions; the seven secondary demographic, affective, and fashion attributes (age, gender, ethnicity, emotion, clothing, color, and style) ranged from 57% to 88% accuracy. Face detection and masking succeeded on 100% of pipeline detections, so the privacy safeguard held under field conditions. During the pilot's 91.4-minute motion-gated monitoring session, chip temperature peaked at 51.5°C and memory briefly neared its 4 GB ceiling before settling well below it; sustained continuous-load behavior was not tested. The architecture’s principal contribution is that the edge-cloud split itself enforces data minimization, instead of relying on a compliance layer added after the fact. Limitations, including the small validation sample, illumination sensitivity, and domain mismatch in style detection, are reported transparently.
Keywords
References
- Aljami, H. M., Alrowais, N. A., AlAwajy, A. M., Alhrgan, S. O., Aldwaani, R. A., Alsawadi, M. S., Saqib, N. U., Alam, S. S., & Alsubaie, R. (2026). Benchmarking YOLOv8 variants for object detection efficiency on Jetson Orin NX for edge computing applications. Computers, 15(2), 74. https://doi.org/10.3390/computers15020074
- Aouayeb, M., Hamidouche, W., Soladie, C., Kpalma, K., & Seguier, R. (2021). Learning vision transformer with squeeze and excitation for facial expression recognition. https://doi.org/10.48550/arXiv.2107.03107
- Bradski, G. (2000). The OpenCV library. Dr. Dobb’s Journal of Software Tools, 25(11), 120-125.
- Brazauskas, J., Jensen, C., Danish, M., Lewis, I., & Mortier, R. (2024). Cerberus: Privacy-preserving crowd counting and localisation using face detection in edge devices. In: Proceedings of the 7th International Workshop on Edge Systems, Analytics and Networking (EdgeSys’24), (pp. 25-30), 22 April 2024, Athens, Greece. https://doi.org/10.1145/3642968.3654817
- Cavoukian, A. (2009). Privacy by design: The 7 foundational principles. Implementation and Mapping of Fair Information Practices. Information and Privacy Commissioner of Ontario, Canada.
- Chia, P. J., Attanasio, G., Bianchi, F., Terragni, S., Magalhães, A. R., Goncalves, D., Greco, C., & Tagliabue, J. (2022). Contrastive language and vision learning of general fashion concepts. Scientific Reports, 12(1), 18958. https://doi.org/10.1038/s41598-022-23052-9
- Deng, J., Guo, J., Ververas, E., Kotsia, I., & Zafeiriou, S. (2020). RetinaFace: Single-shot multi-level face localization in the wild. In: Proceedings of the 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), (pp. 5202-5211), 13-19 June 2020, Seattle, WA, USA. https://doi.org/10.1109/CVPR42600.2020.00525
- EUR-Lex, European Parliament & Council of the European Union. (2016). Regulation (EU) 2016/679 of the European Parliament and of the Council (General Data Protection Regulation). Official Journal of the European Union, L119, 1-88. https://eur-lex.europa.eu/eli/reg/2016/679/oj
Details
Primary Language
English
Subjects
Cloud Computing, Edge Computing, Artificial Intelligence (Other)
Journal Section
Research Article
Early Pub Date
September 24, 2026
Publication Date
September 30, 2026
Submission Date
May 16, 2026
Acceptance Date
July 27, 2026
Published in Issue
Year 2026 Volume: 13 Number: 3