Enhanced contextual based deep learning model for niqab face detection
Human face detection is one of the most investigated areas in computer vision which plays a fundamental role as the first step for all face processing and facial analysis systems, such as face recognition, security monitoring, and facial emotion recognition. Despite the great impact of Deep Learning...
| 第一著者: | |
|---|---|
| フォーマット: | 学位論文 |
| 言語: | 英語 |
| 出版事項: |
2022
|
| 主題: | |
| オンライン・アクセス: | http://eprints.utm.my/101529/1/AlAshbiPSC2022.pdf |
| _version_ | 1846218772998782976 |
|---|---|
| author | Al-Ashbi, Abdulaziz |
| author_facet | Al-Ashbi, Abdulaziz |
| author_sort | Al-Ashbi, Abdulaziz |
| description | Human face detection is one of the most investigated areas in computer vision which plays a fundamental role as the first step for all face processing and facial analysis systems, such as face recognition, security monitoring, and facial emotion recognition. Despite the great impact of Deep Learning Convolutional neural network (DL-CNN) approaches on solving many unconstrained face detection problems in recent years, the low performance of current face detection models when detecting highly occluded faces remains a challenging problem and worth of investigation. This challenge tends to be higher when the occlusion covers most of the face which dramatically reduce the number of learned representative features that are used by Feature Extraction Network (FEN) to discriminate face parts from the background. The lack of occluded face dataset with sufficient images for heavily occluded faces is another challenge that degrades the performance. Therefore, this research addressed the issue of low performance and developed an enhanced occluded face detection model for detecting and localizing heavily occluded faces. First, a highly occluded faces dataset was developed to provide sufficient training examples incorporated with contextual-based annotation technique, to maximize the amount of facial salient features. Second, using the training half of the dataset, a deep learning-CNN Occluded Face Detection model (OFD) with an enhanced feature extraction and detection network was proposed and trained. Common deep learning techniques, namely transfer learning and data augmentation techniques were used to speed up the training process. The false-positive reduction based on max-in-out strategy was adopted to reduce the high false-positive rate. The proposed model was evaluated and benchmarked with five current face detection models on the dataset. The obtained results show that OFD achieved improved performance in terms of accuracy (average 37%), and average precision (16.6%) compared to current face detection models. The findings revealed that the proposed model outperformed current face detection models in improving the detection of highly occluded faces. Based on the findings, an improved contextual based labeling technique has been successfully developed to address the insufficient functionalities of current labeling technique.
Faculty of Engineering - School of Computing183http://dms.library.utm.my:8080/vital/access/manager/Repository/vital:150777
Deep Learning Convolutional neural network (DL-CNN), Feature Extraction Network (FEN), Occluded Face Detection model (OFD) |
| format | Thesis |
| id | uthm-101529 |
| institution | Universiti Teknologi Malaysia |
| language | English |
| publishDate | 2022 |
| record_format | eprints |
| spelling | uthm-1015292023-06-21T10:33:50Z http://eprints.utm.my/101529/ Enhanced contextual based deep learning model for niqab face detection Al-Ashbi, Abdulaziz QA75 Electronic computers. Computer science Human face detection is one of the most investigated areas in computer vision which plays a fundamental role as the first step for all face processing and facial analysis systems, such as face recognition, security monitoring, and facial emotion recognition. Despite the great impact of Deep Learning Convolutional neural network (DL-CNN) approaches on solving many unconstrained face detection problems in recent years, the low performance of current face detection models when detecting highly occluded faces remains a challenging problem and worth of investigation. This challenge tends to be higher when the occlusion covers most of the face which dramatically reduce the number of learned representative features that are used by Feature Extraction Network (FEN) to discriminate face parts from the background. The lack of occluded face dataset with sufficient images for heavily occluded faces is another challenge that degrades the performance. Therefore, this research addressed the issue of low performance and developed an enhanced occluded face detection model for detecting and localizing heavily occluded faces. First, a highly occluded faces dataset was developed to provide sufficient training examples incorporated with contextual-based annotation technique, to maximize the amount of facial salient features. Second, using the training half of the dataset, a deep learning-CNN Occluded Face Detection model (OFD) with an enhanced feature extraction and detection network was proposed and trained. Common deep learning techniques, namely transfer learning and data augmentation techniques were used to speed up the training process. The false-positive reduction based on max-in-out strategy was adopted to reduce the high false-positive rate. The proposed model was evaluated and benchmarked with five current face detection models on the dataset. The obtained results show that OFD achieved improved performance in terms of accuracy (average 37%), and average precision (16.6%) compared to current face detection models. The findings revealed that the proposed model outperformed current face detection models in improving the detection of highly occluded faces. Based on the findings, an improved contextual based labeling technique has been successfully developed to address the insufficient functionalities of current labeling technique. Faculty of Engineering - School of Computing183http://dms.library.utm.my:8080/vital/access/manager/Repository/vital:150777 Deep Learning Convolutional neural network (DL-CNN), Feature Extraction Network (FEN), Occluded Face Detection model (OFD) 2022 Thesis NonPeerReviewed application/pdf en http://eprints.utm.my/101529/1/AlAshbiPSC2022.pdf Al-Ashbi, Abdulaziz (2022) Enhanced contextual based deep learning model for niqab face detection. PhD thesis, Universiti Teknologi Malaysia. http://dms.library.utm.my:8080/vital/access/manager/Repository/vital:150777 |
| spellingShingle | QA75 Electronic computers. Computer science Al-Ashbi, Abdulaziz Enhanced contextual based deep learning model for niqab face detection |
| title | Enhanced contextual based deep learning model for niqab face detection |
| title_full | Enhanced contextual based deep learning model for niqab face detection |
| title_fullStr | Enhanced contextual based deep learning model for niqab face detection |
| title_full_unstemmed | Enhanced contextual based deep learning model for niqab face detection |
| title_short | Enhanced contextual based deep learning model for niqab face detection |
| title_sort | enhanced contextual based deep learning model for niqab face detection |
| topic | QA75 Electronic computers. Computer science |
| url | http://eprints.utm.my/101529/1/AlAshbiPSC2022.pdf |
| url-record | http://eprints.utm.my/101529/ http://dms.library.utm.my:8080/vital/access/manager/Repository/vital:150777 |
| work_keys_str_mv | AT alashbiabdulaziz enhancedcontextualbaseddeeplearningmodelforniqabfacedetection |