Multiplicative Gradient Method for Log-Homogeneous Optimization: A Unified Mirror-Descent Framework
Abstract
Consider the problems of computing ℓp-Lewis weights, Kelly portfolios, D-optimal designs, general equilibria in Fisher markets, and optimal error exponents for channel coding in information theory. All of them can be formulated as optimization problems over the probability simplex, but except for the last one, the associated objective functions are neither Lipschitz continuous nor smooth, rendering existing first-order optimization algorithms and their guarantees not directly applicable. Nevertheless, first-order algorithms for solving these problems do exist in the literature and, perhaps surprisingly, look very similar, even though their interpretations, derivations, and analyses mostly appear unrelated. In this paper, we develop a framework unifying these results that captures their common problem structure through log-homogeneity and a novel second-order condition on the objective function, and identifies their common algorithmic pattern as multiplicative gradient methods. The framework recovers known algorithms and their optimization error guarantees for computing Kelly portfolios, D-optimal designs, optimal error exponents for channel coding in classical communication, ℓp-Lewis weights with p < 2, and general equilibria in Fisher markets. To illustrate the insights provided by the framework, we further show that multiplicative gradient methods yield state-of-the-art performance guarantees for computing ℓp-Lewis weights with p > 2 and optimal error exponents in classical-quantum communication. Both results are novel to the best of our knowledge.
Related
- A Unified Efficient Gradient-Based Heuristic For Box-Constrained Expectation-Related and Risk-Averse Stochastic Optimization Problems
- A unified framework for original energy dissipation of equilibrium-preserving exponential Runge--Kutta methods for L2 gradient flows
- Centered Weak Discrete Riemannian Gradients: A Unified Framework for Riemannian Optimization
- A Unified Framework for Assortment Optimization and Matching under MNL Choice
- Initial condition recovery in nonlinear damped viscous photoacoustic tomography using a convolutional neural network-guided gradient-free optimization framework
BibTeX
@misc{chu2026multiplicative,
title = {{Multiplicative Gradient Method for Log-Homogeneous Optimization: A Unified Mirror-Descent Framework}},
author = {Chun-Neng Chu and Yen-Huan Li},
howpublished = {arXiv},
year = {2026},
month = oct,
doi = {10.48550/arxiv.2610.16335},
eprint = {2610.16335},
archivePrefix = {arXiv},
url = {https://arxiv.org/abs/2610.16335},
}
RIS
TY - UNPB
TI - Multiplicative Gradient Method for Log-Homogeneous Optimization: A Unified Mirror-Descent Framework
AU - Chun-Neng Chu
AU - Yen-Huan Li
PY - 2026
DA - 2026/10/12
PB - arXiv
DO - 10.48550/arxiv.2610.16335
UR - https://arxiv.org/abs/2610.16335
AB - Consider the problems of computing ℓ_p-Lewis weights, Kelly portfolios, D-optimal designs, general equilibria in Fisher markets, and optimal error exponents for channel coding in information theory. All of them can be formulated as optimization problems over the probability simplex, but except for the last one, the associated objective functions are neither Lipschitz continuous nor smooth, rendering existing first-order optimization algorithms and their guarantees not directly applicable. Nevertheless, first-order algorithms for solving these problems do exist in the literature and, perhaps surprisingly, look very similar, even though their interpretations, derivations, and analyses mostly appear unrelated. In this paper, we develop a framework unifying these results that captures their common problem structure through log-homogeneity and a novel second-order condition on the objective function, and identifies their common algorithmic pattern as multiplicative gradient methods. The framework recovers known algorithms and their optimization error guarantees for computing Kelly portfolios, D-optimal designs, optimal error exponents for channel coding in classical communication, ℓ_p-Lewis weights with p < 2, and general equilibria in Fisher markets. To illustrate the insights provided by the framework, we further show that multiplicative gradient methods yield state-of-the-art performance guarantees for computing ℓ_p-Lewis weights with p > 2 and optimal error exponents in classical-quantum communication. Both results are novel to the best of our knowledge.
ER -