Abstract
Large-scale logistic regression arises in many applications such as document classification and natural language processing. In this paper, we apply a trust region Newton method to maximize the log-likelihood of the logistic regression model. The proposed method uses only approximate Newton steps in the beginning, but achieves fast convergence in the end. Experiments show that it is faster than the commonly used quasi Newton approach for logistic regression. We also compare it with linear SVM implementations.
Keywords
Logistic regressionComputer scienceScale (ratio)Convergence (economics)Logistic model treeNewton's methodSupport vector machineRegressionArtificial intelligenceStatisticsMachine learningMathematicsNonlinear systemGeography
Affiliated Institutions
Related Publications
Trust Region Newton Method for Logistic Regression
Large-scale logistic regression arises in many applications such as document classification and natural language processing. In this paper, we apply a trust region Newton method...
The Conjugate Gradient Method and Trust Regions in Large Scale Optimization
Algorithms based on trust regions have been shown to be robust methods for unconstrained optimization problems. All existing methods, either based on the dogleg strategy or Hebd...
Numerical Methods for Unconstrained Optimization and Nonlinear Equations
Preface 1. Introduction. Problems to be considered Characteristics of 'real-world' problems Finite-precision arithmetic and measurement of error Exercises 2. Nonlinear Problems ...
A globally convergent primal-dual interior point method for constrained optimization
Abstract This paper proposes a primal-dual interior point method for solving general nonlinearly constrained optimization problems. The method is based on solving the Barrier Ka...
Deep Ordinal Regression Network for Monocular Depth Estimation
Monocular depth estimation, which plays a crucial role in understanding 3D scene geometry, is an ill-posed problem. Recent methods have gained significant improvement by explori...
Publication Info
- Year
- 2007
- Type
- article
- Pages
- 561-568
- Citations
- 286
- Access
- Closed
External Links
Social Impact
Altmetric
PlumX Metrics
Social media, news, blog, policy document mentions
Citation Metrics
286
OpenAlex
Cite This
Chih‐Jen Lin,
Ruby C. Weng,
S. Sathiya Keerthi
(2007).
Trust region Newton methods for large-scale logistic regression.
, 561-568.
https://doi.org/10.1145/1273496.1273567
Identifiers
- DOI
- 10.1145/1273496.1273567