Toggle Main Menu Toggle Search

Open Access padlockePrints

Ubi-sleepnet: Advanced multimodal fusion techniques for three-stage sleep classification using ubiquitous sensing

Lookup NU author(s): Dr Bing Zhai, Dr Yu GuanORCiD, Professor Mike Catt


Full text for this publication is not currently held within this repository. Alternative links are provided below where available.


© 2021 ACM.Sleep is a fundamental physiological process that is essential for sustaining a healthy body and mind. The gold standard for clinical sleep monitoring is polysomnography(PSG), based on which sleep can be categorized into five stages, including wake/rapid eye movement sleep (REM sleep)/Non-REM sleep 1 (N1)/Non-REM sleep 2 (N2)/Non-REM sleep 3 (N3). However, PSG is expensive, burdensome and not suitable for daily use. For long-term sleep monitoring, ubiquitous sensing may be a solution. Most recently, cardiac and movement sensing has become popular in classifying three-stage sleep, since both modalities can be easily acquired from research-grade or consumer-grade devices (e.g., Apple Watch). However, how best to fuse the data for greatest accuracy remains an open question. In this work, we comprehensively studied deep learning (DL)-based advanced fusion techniques consisting of three fusion strategies alongside three fusion methods for three-stage sleep classification based on two publicly available datasets. Experimental results demonstrate important evidences that three-stage sleep can be reliably classified by fusing cardiac/movement sensing modalities, which may potentially become a practical tool to conduct large-scale sleep stage assessment studies or long-term self-tracking on sleep. To accelerate the progression of sleep research in the ubiquitous/wearable computing community, we made this project open source, and the code can be found at:

Publication metadata

Author(s): Zhai B, Guan Y, Catt M, Plotz T

Publication type: Article

Publication status: Published

Journal: Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies

Year: 2021

Volume: 5

Issue: 4

Online publication date: 30/12/2021

Acceptance date: 02/04/2018

ISSN (electronic): 2474-9567

Publisher: Association for Computing Machinery


DOI: 10.1145/3494961


Altmetrics provided by Altmetric