MU-Net-optLSTM - Two-Stream Spatial–Temporal Feature Extraction and Classification Architecture

Oct 28, 2026

Networked cameras continuously capturing video create strong demand for hybrid edge-to-cloud systems that can process live streams in real time. Although art museum environments are seldom studied, visual analysis is crucial for distinguishing individuals and crowds in smart surveillance. This research presents a deep learning framework for detecting abnormal behavior from museum video, combining U-Net-based spatial feature extraction, MobileNetV2 encoding, improved optimized LSTM for temporal features, and optical flow for motion tracking. Results reach 97.67±1.23% average accuracy on video datasets, offering efficiency and stronger generalization than prior work.

LanguageEnglish

CategoryResearch & Report

FormatPDF

Pages18

Reading Time45 min

AccessFree to download

Introduction

Related work and motivation

TSINGHUA SCIENCE AND TECHNOLOGY ISSN 1007-0214 23/23 pp2304−2321 DOI: 10 . 26599/TST . 2024 . 9010003 Volume 31 , Number 4 , August 2026 Research Article MU-Net-optLSTM: Two-Stream Spatial–Temporal Feature Extraction and Classification Architecture for Automatic Monitoring of Crowded Art Museums Mukun Wang, Rongju Yao, and Khosro Rezaee* Abstract: Networked cameras that continuously capture video data have generated a high demand for hybrid edge-to-cloud servers that can process live videos in real time. The environment of art museums is rarely studied, but visual analysis is an important factor in categorizing and distinguishing individuals and crowds through smart surveillance systems. This paper demonstrates how video surveillance data from art museums can be analyzed to identify abnormal behavior using an innovative deep learning framework. To enhance the extracted features, a spatial feature extraction method based on the U-Net architecture is applied, along with the encoder component of the proposed approach, MobileNetV2 . Additionally, we propose an improved LongShort-Term Memory (LSTM) algorithm for extracting temporal features. Optical flow enhances surveillance in art museums by tracking individuals and crowds. Our approach yields an average accuracy of 97.67±1 .23% when applied to a collection of video datasets. Using U-Net, MobileNetV2, and optimized LSTM algorithms, the model recognizes patterns in video data, such as crowd motion in museums. Consequently, this methodology generates reliable results as well as being computationally efficient. Compared to the state-of-the-art, the proposed method is more comprehensive and generalizable for analyzing atypical museum visitor behavior. Key words: art museums; automatic monitoring ; deep learning ; long short-term memory; U-Net architecture ; MobileNetV2 ; optical flow 1 Introduction Efficient Video surveillance technology is employed by security professionals to evaluate collective behavior Mukun Wang is with Department of Design, Graduate School, Dongseo University, Busan 47011, Republic of Korea, and also with Tianshui Normal University, Tianshui 741000, China. [E-mail: miachiyu2022@gmail.com](E-mail: miachiyu2022@gmail.com). Rongju Yao is with Shandong Provincial University Laboratory for Protected Horticulture, Weifang University of Science and Technology, Weifang 262700, China. E-mail: yaorongju8@ [wfust.edu.cn](wfust.edu.cn). Khosro Rezaee is with Department of Biomedical Engineering, Meybod University, Yazd 89195, Iran. E-mail: [kh.rezaee@meybod.ac.ir](kh.rezaee@meybod.ac.ir). * To whom correspondence should be addressed. Manuscript received: 2023-11-24; revised: 2023-12-18; accepted: 2023-12-29 in public spaces[1, 2] . In recent years, the significance of employing many smart cameras in an edge-fog-cloud infrastructure for continuous surveillance of individuals and crowds has increased[3, 4] . Data-driven crowd simulations[4, 5] and advanced driving assistance systems[6, 7] heavily depend on multi-person and multicamera tracking techniques. Among the significant places that require surveillance and video analysis are art museums[8] . Insufficient research has been conducted to assess the effectiveness of automated video surveillance and crowd analysis in art museum environment However, art museums and other organizations responsible for safeguarding precious artifacts are legally obligated to implement all essential measures to protect data confidentiality[9] . Maintaining records of surveillance actions inside monitored zones © The author(s) 2026. The articles published in this open access journal are distributed under the terms of the Creative Commons Attribution 4.0 International License ([http://creativecommons.org/licenses/by/4.0/](http://creativecommons.org/licenses/by/4.0/)). Mukun Wang et al.: MU-Net-optLSTM: Two-Stream Spatial–Temporal Feature Extraction and Classification... 2305 is difficult, and recording and

FAQs

What problem does the paper address in crowded art museums?

It targets abnormal-behavior identification from continuously captured video in crowded art museum settings, where real-time analysis is required for reliable monitoring.

Which deep learning components are combined in the proposed MU-Net-optLSTM framework?

The method uses U-Net for spatial feature extraction, MobileNetV2 as the encoder, and an improved optimized LSTM for temporal feature extraction, enhanced by optical flow.

How is performance evaluated and what accuracy is reported?

The approach is tested on a collection of video datasets, achieving an average accuracy of 97.67±1.23%, with claims of computational efficiency and broader generalizability versus state-of-the-art methods.

Oct 28, 2026

Upload by Margaret