Toggle Main Menu Toggle Search

Open Access padlockePrints

ConvNet-based performers attention and supervised contrastive learning for activity recognition

Lookup NU author(s): Dr Rebeen Hamad, Dr Wai Lok Woo, Dr Bo WeiORCiD



This work is licensed under a Creative Commons Attribution 4.0 International License (CC BY 4.0).


© 2022, The Author(s).Human activity recognition based on generated sensor data plays a major role in a large number of applications such as healthcare monitoring and surveillance system. Yet, accurately recognizing human activities is still challenging and active research due to people’s tendency to perform daily activities in a different and multitasking way. Existing approaches based on the recurrent setting for human activity recognition have some issues, such as the inability to process data parallelly, the requirement for more memory and high computational cost albeit they achieved reasonable results. Convolutional Neural Network processes data parallelly, but, it breaks the ordering of input data, which is significant to build an effective model for human activity recognition. To overcome these challenges, this study proposes causal convolution based on performers-attention and supervised contrastive learning to entirely forego recurrent architectures, efficiently maintain the ordering of human daily activities and focus more on important timesteps of the sensors’ data. Supervised contrastive learning is integrated to learn a discriminative representation of human activities and enhance predictive performance. The proposed network is extensively evaluated for human activities using multiple datasets including wearable sensor data and smart home environments data. The experiments on three wearable sensor datasets and five smart home public datasets of human activities reveal that our proposed network achieves better results and reduces the training time compared with the existing state-of-the-art methods and basic temporal models.

Publication metadata

Author(s): Hamad RA, Yang L, Woo WL, Wei B

Publication type: Article

Publication status: Published

Journal: Applied Intelligence

Year: 2023

Volume: 53

Issue: 8

Pages: 8809-8825

Print publication date: 01/04/2023

Online publication date: 03/08/2022

Acceptance date: 24/06/2022

Date deposited: 16/05/2023

ISSN (print): 0924-669X

ISSN (electronic): 1573-7497

Publisher: Springer


DOI: 10.1007/s10489-022-03937-y


Altmetrics provided by Altmetric