Choosing the Right Kernel A Meta-Learning Approach to Kernel Selection in Support Vector Machines
| dc.contributor.advisor | Vilalta, Ricardo | |
| dc.contributor.committeeMember | Eick, Christoph F. | |
| dc.contributor.committeeMember | Tsekos, Nikolaos V. | |
| dc.contributor.committeeMember | Shi, Weidong | |
| dc.contributor.committeeMember | Kaiser, Klaus | |
| dc.creator | Valerio Molina, Roberto 1983- | |
| dc.creator.orcid | 0000-0002-4508-9788 | |
| dc.date.accessioned | 2017-04-30T04:59:15Z | |
| dc.date.available | 2017-04-30T04:59:15Z | |
| dc.date.created | May 2015 | |
| dc.date.issued | 2015-05 | |
| dc.date.submitted | May 2015 | |
| dc.date.updated | 2017-04-30T04:59:15Z | |
| dc.description.abstract | In recent years Support Vector Machines (SVM) have gained increasing popularity over other classification algorithms due to their ability to produce a flexible boundary over non-linearly separable datasets. Such an ability is feasible thanks to the kernel trick. The kernel trick allows SVMs to perform an implicit transformation of the non-linearly separable original input space into a higher dimensional feature space where a linear separation of the dataset can be found. By creating an implicit transformation of the original feature space we gain efficiency in terms of time complexity. However, we lose information since we do not know what the feature space looks like, but we obtain relative positions in the feature space thanks to the kernel function used to perform this transformation. Since different kernel functions yield different transformations of the feature space, there is a need for a mechanism that selects the best kernel function for a specific problem. Previous work has focused on generating metrics from the kernel matrix (a pairwise matrix that stores the relative positions of all the pairs of points). Three metrics have been used to extract information from the kernel matrix: Fisher's discriminant, Bregman's divergence and Homoscedasticity analysis, which even when combined together do not provide enough prediction power to perform kernel selection. By introducing new meta-features, Distance Ratio (capturing inter-class and intra-class distances in the feature space) and Class Similarity (computing inter-class and intra-class similarity in the feature space), we yield substantial improvements to the kernel selection process. | |
| dc.description.department | Computer Science, Department of | |
| dc.format.digitalOrigin | born digital | |
| dc.format.mimetype | application/pdf | |
| dc.identifier.uri | http://hdl.handle.net/10657/1745 | |
| dc.language.iso | eng | |
| dc.rights | The author of this work is the copyright owner. UH Libraries and the Texas Digital Library have their permission to store and provide access to this work. Further transmission, reproduction, or presentation of this work is prohibited except with permission of the author(s). | |
| dc.subject | Machine learning | |
| dc.subject | Kernel Methods | |
| dc.subject | Kernel Selection | |
| dc.subject | Support Vector Machines | |
| dc.title | Choosing the Right Kernel A Meta-Learning Approach to Kernel Selection in Support Vector Machines | |
| dc.type.dcmi | Text | |
| dc.type.genre | Thesis | |
| thesis.degree.college | College of Natural Sciences and Mathematics | |
| thesis.degree.department | Computer Science, Department of | |
| thesis.degree.discipline | Computer Science | |
| thesis.degree.grantor | University of Houston | |
| thesis.degree.level | Doctoral | |
| thesis.degree.name | Doctor of Philosophy |