Variable selection using SVM-based criteria. (English) Zbl 1102.68583

Summary: We propose new methods to evaluate variable subset relevance with a view to variable selection. Relevance criteria are derived from support vector machines and are based on weight vector \(\|{\mathbf w}\|^2\) or generalization error bounds sensitivity with respect to a variable. Experiments on linear and nonlinear toy problems and real-world datasets have been carried out to assess the effectiveness of these criteria. Results show that the criterion based on weight vector derivative achieves good results and performs consistently well over the datasets we used.


68T05 Learning and adaptive systems in artificial intelligence
68T10 Pattern recognition, speech recognition
Full Text: DOI