Making Large-Scale SVM Learning Practical

Abstract

Training a support vector machine SVM leads to a quadratic optimization problem with bound constraints and one linear equality constraint. Despite the fact that this type of problem is well understood, there are many issues to be considered in designing an SVM learner. In particular, for large learning tasks with many training examples on the shelf optimization techniques for general quadratic programs quickly become intractable in their memory and time requirements. SVM light is an implementation of an SVM learner which addresses the problem of large tasks. This chapter presents algorithmic and computational results developed for SVM light V 2.0, which make large-scale SVM training more practical. The results give guidelines for the application of SVMs to large domains.

Keywords

Support vector machineComputer scienceQuadratic programmingRanking SVMMachine learningConstraint (computer-aided design)Artificial intelligenceQuadratic equationScale (ratio)Mathematical optimizationMathematics

Related Publications

Fast Training of Support Vector Machines Using Sequential Minimal Optimization

John Platt

This chapter describes a new algorithm for training Support Vector Machines: Sequential Minimal Optimization, or SMO. Training a Support Vector Machine (SVM) requires the soluti...

1998 The MIT Press eBooks 5457 citations

An improved training algorithm for support vector machines

E. Osuna , Robert M. Freund , Federico Girosi

We investigate the problem of training a support vector machine (SVM) on a very large database in the case in which the number of support vectors is also very large. Training a ...

2002 1065 citations

Asymptotic Behaviors of Support Vector Machines with Gaussian Kernel

S. Sathiya Keerthi , Chih‐Jen Lin

Support vector machines (SVMs) with the gaussian (RBF) kernel have been popular for practical use. Model selection in this class of SVMs involves two hyper parameters: the penal...

2003 Neural Computation 1590 citations

Applications of Support Vector Machine (SVM) Learning in Cancer Genomics

Shujun Huang , Nianguang Cai , P. Pacheco +3 more

Machine learning with maximization (support) of separating margin (vector), called support vector machine (SVM) learning, is a powerful classification tool that has been used fo...

2018 Cancer Genomics & Proteomics 1489 citations

Advances in kernel methods: support vector learning

Bernhard Schölkopf , Christopher J. C. Burges , Alexander J. Smola

Introduction to support vector learning roadmap. Part 1 Theory: three remarks on the support vector method of function estimation, Vladimir Vapnik generalization performance of ...

1999 International Conference on Neural In... 5814 citations

Publication Info

Year: 2006
Type: article
Citations: 4316
Access: Closed

External Links

View on DOI.org

Social Impact

Altmetric

Making Large-Scale SVM Learning Practical

PlumX Metrics

Social media, news, blog, policy document mentions

Citation Metrics

4316

OpenAlex

Cite This

APA Style

                            
                                    Thorsten Joachims
                                
                            (2006). 
                            Making Large-Scale SVM Learning Practical. 
                            Technical reports
                            
                            .
                            https://doi.org/10.17877/de290r-14262

Identifiers

DOI: 10.17877/de290r-14262