Hybrid ACO and SVM algorithm for pattern classification

Ant Colony Optimization (ACO) is a metaheuristic algorithm that can be used to solve a variety of combinatorial optimization problems. A new direction for ACO is to optimize continuous and mixed (discrete and continuous) variables. Support Vector Machine (SVM) is a pattern classification approach o...

Description complète

Détails bibliographiques
Auteur principal: Alwan, Hiba Basim
Format: Thèse
Langue:anglais
anglais
Publié: 2013
Sujets:
Accès en ligne:https://etd.uum.edu.my/4419/1/s92846.pdf
https://etd.uum.edu.my/4419/7/s92846_abstract.pdf
_version_ 1846512509520969728
author Alwan, Hiba Basim
author_facet Alwan, Hiba Basim
author_sort Alwan, Hiba Basim
description Ant Colony Optimization (ACO) is a metaheuristic algorithm that can be used to solve a variety of combinatorial optimization problems. A new direction for ACO is to optimize continuous and mixed (discrete and continuous) variables. Support Vector Machine (SVM) is a pattern classification approach originated from statistical approaches. However, SVM suffers two main problems which include feature subset selection and parameter tuning. Most approaches related to tuning SVM parameters discretize the continuous value of the parameters which will give a negative effect on the classification performance. This study presents four algorithms for tuning the SVM parameters and selecting feature subset which improved SVM classification accuracy with smaller size of feature subset. This is achieved by performing the SVM parameters’ tuning and feature subset selection processes simultaneously. Hybridization algorithms between ACO and SVM techniques were proposed. The first two algorithms, ACOR-SVM and IACOR-SVM, tune the SVM parameters while the second two algorithms, ACOMV-R-SVM and IACOMV-R-SVM, tune the SVM parameters and select the feature subset simultaneously. Ten benchmark datasets from University of California, Irvine, were used in the experiments to validate the performance of the proposed algorithms. Experimental results obtained from the proposed algorithms are better when compared with other approaches in terms of classification accuracy and size of the feature subset. The average classification accuracies for the ACOR-SVM, IACOR-SVM, ACOMV-R and IACOMV-R algorithms are 94.73%, 95.86%, 97.37% and 98.1% respectively. The average size of feature subset is eight for the ACOR-SVM and IACOR-SVM algorithms and four for the ACOMV-R and IACOMV-R algorithms. This study contributes to a new direction for ACO that can deal with continuous and mixed-variable ACO.
format Thesis
id oai:etd.uum.edu.my:4419
institution Universiti Utara Malaysia
language English
English
publishDate 2013
record_format eprints
spelling oai:etd.uum.edu.my:44192023-01-25T01:06:21Z https://etd.uum.edu.my/4419/ Hybrid ACO and SVM algorithm for pattern classification Alwan, Hiba Basim QA71-90 Instruments and machines Ant Colony Optimization (ACO) is a metaheuristic algorithm that can be used to solve a variety of combinatorial optimization problems. A new direction for ACO is to optimize continuous and mixed (discrete and continuous) variables. Support Vector Machine (SVM) is a pattern classification approach originated from statistical approaches. However, SVM suffers two main problems which include feature subset selection and parameter tuning. Most approaches related to tuning SVM parameters discretize the continuous value of the parameters which will give a negative effect on the classification performance. This study presents four algorithms for tuning the SVM parameters and selecting feature subset which improved SVM classification accuracy with smaller size of feature subset. This is achieved by performing the SVM parameters’ tuning and feature subset selection processes simultaneously. Hybridization algorithms between ACO and SVM techniques were proposed. The first two algorithms, ACOR-SVM and IACOR-SVM, tune the SVM parameters while the second two algorithms, ACOMV-R-SVM and IACOMV-R-SVM, tune the SVM parameters and select the feature subset simultaneously. Ten benchmark datasets from University of California, Irvine, were used in the experiments to validate the performance of the proposed algorithms. Experimental results obtained from the proposed algorithms are better when compared with other approaches in terms of classification accuracy and size of the feature subset. The average classification accuracies for the ACOR-SVM, IACOR-SVM, ACOMV-R and IACOMV-R algorithms are 94.73%, 95.86%, 97.37% and 98.1% respectively. The average size of feature subset is eight for the ACOR-SVM and IACOR-SVM algorithms and four for the ACOMV-R and IACOMV-R algorithms. This study contributes to a new direction for ACO that can deal with continuous and mixed-variable ACO. 2013 Thesis NonPeerReviewed text en https://etd.uum.edu.my/4419/1/s92846.pdf text en https://etd.uum.edu.my/4419/7/s92846_abstract.pdf Alwan, Hiba Basim (2013) Hybrid ACO and SVM algorithm for pattern classification. PhD. thesis, Universiti Utara Malaysia.
spellingShingle QA71-90 Instruments and machines
Alwan, Hiba Basim
Hybrid ACO and SVM algorithm for pattern classification
title Hybrid ACO and SVM algorithm for pattern classification
title_full Hybrid ACO and SVM algorithm for pattern classification
title_fullStr Hybrid ACO and SVM algorithm for pattern classification
title_full_unstemmed Hybrid ACO and SVM algorithm for pattern classification
title_short Hybrid ACO and SVM algorithm for pattern classification
title_sort hybrid aco and svm algorithm for pattern classification
topic QA71-90 Instruments and machines
url https://etd.uum.edu.my/4419/1/s92846.pdf
https://etd.uum.edu.my/4419/7/s92846_abstract.pdf
url-record https://etd.uum.edu.my/4419/
work_keys_str_mv AT alwanhibabasim hybridacoandsvmalgorithmforpatternclassification