INTELLIGENT RECOGNITION OF HUMAN ACTIVITIES THROUGH MOTION SENSOR PATTERNS FOR CONTEXT-AWARE SYSTEMS
DOI:
https://doi.org/10.67772/1x2bty75Keywords:
Human Activity Recognition, ; IMU Sensors, Accelerometer, Gyroscope, Machine LearningAbstract
The automatic interpretation of human motion via wearable and mobile sensor technologies has become an important part of the Human Activity Recognition (HAR) topic, which is one of the most important issues in context-aware intelligent systems. This study designed a machine learning-based recognition framework for human activities from a dataset of inertial motion sensors (IMU), including 15,980 observations, 6 sensor variables and 6 activity classes. The features used were three-axis accelerometer readings (ax, ay, az) and three-axis gyroscope readings (gx, gy, gz), as well as added magnitude features of the accelerometers and gyroscopes. In order to test the six supervised classifiers, an 80:20 stratified train-test split was used with 5-fold cross-validation. The accuracy, precision, recall, F1-score, specificity, ROC-AUC, and confusion-matrix analysis were used for the evaluation of performance. K-Nearest Neighbors had the highest overall accuracy score of 87.95% and macro F1 score of 87.09%, while Random Forest had the highest ROC-AUC of 0.981. Class 4 and Class 5 had the highest recognition and Class 3 had comparatively higher classification difficulty. The feature importance analysis results show that the most important features for the classification were ax, az and gz, which again demonstrates the complementary importance of both acceleration and rotational motion information. The results showed that compact IMU measurements can be used to successfully enable the reliable detection of human activity in smart home, healthcare monitoring, wearable and smart mobile applications.
References
1.Abedin, A., Ehsanpour, M., Shi, Q., Rezatofighi, H., & Ranasinghe, D. C. (2021). Attend and Discriminate: Beyond the State-of-the-Art for Human Activity Recognition Using Wearable Sensors. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, 5(1), 1–22. https://doi.org/10.1145/3448083
2.Ascioglu, G., & Senol, Y. (2020). Design of a wearable wireless multi-sensor monitoring system and application for activity recognition using deep learning. IEEE Access, 8, 169183–169195.
3.Chen, K., Zhang, D., Yao, L., Guo, B., Yu, Z., & Liu, Y. (2022). Deep Learning for Sensor-based Human Activity Recognition: Overview, Challenges, and Opportunities. ACM Computing Surveys, 54(4), 1–40. https://doi.org/10.1145/3447744
4.Chung, S., Lim, J., Noh, K. J., Kim, G., & Jeong, H. (2019). Sensor data acquisition and multimodal sensor fusion for human activity recognition using deep learning. Sensors, 19(7), 1716.
5.Demrozi, F., Pravadelli, G., Bihorac, A., & Rashidi, P. (2020). Human activity recognition using inertial, physiological and environmental sensors: A comprehensive survey. IEEE Access, 8, 210816–210836.
6.Dirgová Luptáková, I., Kubovčík, M., & Pospíchal, J. (2022). Wearable sensor-based human activity recognition with transformer model. Sensors, 22(5), 1911.
7.Fan, C., & Gao, F. (2021). Enhanced human activity recognition using wearable sensors via a hybrid feature selection method. Sensors, 21(19), 6434.
8.Fridriksdottir, E., & Bonomi, A. G. (2020). Accelerometer-based human activity recognition for patient monitoring using a deep neural network. Sensors, 20(22), 6424.
9.Gholamiangonabadi, D., Kiselov, N., & Grolinger, K. (2020). Deep neural networks for human activity recognition with wearable sensors: Leave-one-subject-out cross-validation for model selection. Ieee Access, 8, 133982–133994.
10.Gil-Martín, M., San-Segundo, R., Fernandez-Martinez, F., & Ferreiros-López, J. (2020). Improving physical activity recognition using a new deep learning architecture and post-processing techniques. Engineering Applications of Artificial Intelligence, 92, 103679.
11.Haresamudram, H., Essa, I., & Plötz, T. (2021). Contrastive Predictive Coding for Human Activity Recognition. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, 5(2), 1–26. https://doi.org/10.1145/3463506
12.Ihianle, I. K., Nwajana, A. O., Ebenuwa, S. H., Otuka, R. I., Owa, K., & Orisatoki, M. O. (2020). A deep learning approach for human activities recognition from multimodal sensing devices. Ieee Access, 8, 179028–179038.
13.Lawal, I. A., & Bano, S. (2019). Deep human activity recognition using wearable sensors. Proceedings of the 12th ACM International Conference on PErvasive Technologies Related to Assistive Environments, 45–48. https://doi.org/10.1145/3316782.3321538
14.Lawal, I. A., & Bano, S. (2020). Deep human activity recognition with localisation of wearable sensors. IEEE Access, 8, 155060–155070.
15.Leite, C. F. S., & Xiao, Y. (2020). Improving cross-subject activity recognition via adversarial learning. IEEE Access, 8, 90542–90554.
16.Nouriani, A., McGovern, R. A., & Rajamani, R. (2022). Deep-learning-based human activity recognition using wearable sensors. IFAC-PapersOnLine, 55(37), 1–6.
17.Nweke, H. F., Teh, Y. W., Al-Garadi, M. A., & Alo, U. R. (2018). Deep learning algorithms for human activity recognition using mobile and wearable sensor networks: State of the art and research challenges. Expert Systems with Applications, 105, 233–261.
18.Nweke, H. F., Teh, Y. W., Mujtaba, G., & Al-Garadi, M. A. (2019). Data fusion and multiple classifier systems for human activity detection and health monitoring: Review and open research directions. Information Fusion, 46, 147–170.
19.Ramanujam, E., Perumal, T., & Padmavathi, S. (2021). Human activity recognition with smartphone and wearable sensors using deep learning techniques: A review. IEEE Sensors Journal, 21(12), 13029–13040.
20.Sousa Lima, W., Souto, E., El-Khatib, K., Jalali, R., & Gama, J. (2019). Human activity recognition using inertial sensors in a smartphone: An overview. Sensors, 19(14), 3213.
21.Straczkiewicz, M., James, P., & Onnela, J.-P. (2021). A systematic review of smartphone-based human activity recognition methods for health research. NPJ Digital Medicine, 4(1), 148.
22.Tahir, Y., & Hamarash, I. I. (2025). IMU-based Human Activity Recognition Dataset. 3. https://doi.org/10.17632/fcnmmsn857.3
23.Uddin, M. Z., & Soylu, A. (2021). Human activity recognition using wearable sensors, discriminant analysis, and long short-term memory-based neural structured learning. Scientific Reports, 11(1), 16455.
24.Wang, H., Zhao, J., Li, J., Tian, L., Tu, P., Cao, T., An, Y., Wang, K., & Li, S. (2020). Wearable Sensor-Based Human Activity Recognition Using Hybrid Deep Learning Techniques. Security and Communication Networks, 2020, 1–12. https://doi.org/10.1155/2020/2132138
25.Wang, J., Chen, Y., Hao, S., Peng, X., & Hu, L. (2019). Deep learning for sensor-based activity recognition: A survey. Pattern Recognition Letters, 119, 3–11.
26.Wang, Y., Cang, S., & Yu, H. (2019). A survey on wearable sensor modality centred human activity recognition in health care. Expert Systems with Applications, 137, 167–190.
27.Webber, M., & Rojas, R. F. (2021). Human activity recognition with accelerometer and gyroscope: A data fusion approach. IEEE Sensors Journal, 21(15), 16979–16989.
28.Yen, C.-T., Liao, J.-X., & Huang, Y.-K. (2020). Human daily activity recognition performed using wearable inertial sensors combined with deep learning algorithms. Ieee Access, 8, 174105–174114.
29.Zhang, S., Li, Y., Zhang, S., Shahabi, F., Xia, S., Deng, Y., & Alshurafa, N. (2022). Deep learning in human activity recognition with wearable sensors: A review on advances. Sensors, 22(4), 1476.
