Robust multicategory support vector machines using difference convex algorithm |
| |
Authors: | Chong Zhang Minh Pham Sheng Fu Yufeng Liu |
| |
Affiliation: | 1.Department of Statistics and Actuarial Science,University of Waterloo,Waterloo,Canada;2.Statistical and Applied Mathematical Sciences Institute (SAMSI),Durham,USA;3.Department of Statistics,University of Virginia,Charlottesville,USA;4.University of Chinese Academy of Sciences,Beijing,China;5.Department of Statistics and Operations Research, Department of Genetics, Department of Biostatistics,Carolina Center for Genome Sciences, Lineberger Comprehensive Cancer Center, University of North Carolina at Chapel Hill,Chapel Hill,USA |
| |
Abstract: | The support vector machine (SVM) is one of the most popular classification methods in the machine learning literature. Binary SVM methods have been extensively studied, and have achieved many successes in various disciplines. However, generalization to multicategory SVM (MSVM) methods can be very challenging. Many existing methods estimate k functions for k classes with an explicit sum-to-zero constraint. It was shown recently that such a formulation can be suboptimal. Moreover, many existing MSVMs are not Fisher consistent, or do not take into account the effect of outliers. In this paper, we focus on classification in the angle-based framework, which is free of the explicit sum-to-zero constraint, hence more efficient, and propose two robust MSVM methods using truncated hinge loss functions. We show that our new classifiers can enjoy Fisher consistency, and simultaneously alleviate the impact of outliers to achieve more stable classification performance. To implement our proposed classifiers, we employ the difference convex algorithm for efficient computation. Theoretical and numerical results obtained indicate that for problems with potential outliers, our robust angle-based MSVMs can be very competitive among existing methods. |
| |
Keywords: | |
本文献已被 SpringerLink 等数据库收录! |
|