Comparison of Machine Learning and Deep Learning Methods Based on Recurrence Analysis for Obstructive Sleep Apnea Detection

Daniele Padovano1, Arturo Martínez-Rodrigo1, José Pastor1, Jose J Rieta2, Raul Alcaraz1
1University of Castilla-La Mancha, 2BioMIT.org, Universitat Politecnica Valencia


Abstract

Obstructive sleep apnea (OSA) is linked to severe cardiovascular diseases, but it remains undiagnosed in general population. To facilitate OSA detection in clinical practice, a variety of algorithms based on combining features from heart rate variability (HRV) with machine learning techniques have been proposed in the last years. Features derived from recurrence quantification analysis (RQA) have reported promising results in previous works, however there is still limited research on the use of that approach for detecting OSA episodes using deep learning methods. Hence, this study aims to compare the performance of traditional machine learning methods and a modern deep learning approach based on RQA for OSA detection.

Methods. The study enrolled three publicly available databases from Physionet. ECG recordings were segmented into one-minute intervals, and the general recurrence plot (GRP) and common RQA features were extracted from the HRV. Support vectors machine (SVM), k-nearest neighbors (KNN), and tree-decision classifier (TREE) were trained on common RQA features, while a pre-trained version of AlexNet was inputted with GRPs. The performance of the methods was determined following the TRIPOD guidelines, i.e., using a database for training and the remaining for testing.

Results. As the table below shows, the performance in terms of accuracy (Ac), sensitivity (Se), and specificity (Sp) was better using the deep learning scheme than traditional machine learning models. The AlexNet-based model also reported more balanced values of Se and Sp than common classifiers.

Conclusions. The deep learning model presented a higher generalization ability than machine learning algorithms to detect OSA from the HRV analysis using RQA. Although the values of Ac obtained by AlexNet were still moderate, they were also greater than those reported by previous machine learning models based on HRV features different from RQA and under the TRIPOD guidelines, thus drawing an interesting line research for OSA detection.