A projected descent method for minimization of weakly semismooth functions over polyhedral sets
Abstract
This study develops a projection-based descent method for minimizing weakly semismooth functions over polyhedral sets, taking an initial step toward extending projection-based descent algorithms to nonsmooth, nonconvex optimization problems. At each iteration, the method considers an inner approximation of the Clarke ε-subdifferential at the current iterate over the feasible region and uses its least-norm element to generate a search direction. An exponential limited backtracking line search is then developed to assess the quality of the generated direction, while a projected variant of Mifflin's line search is proposed to identify nonredundant subgradients that enrich the Clarke ε-subdifferential approximation when necessary. To quantify stationarity, a characterization of stationary points based on the projection operator yields a computable optimality measure for the proposed method. The convergence properties of the proposed method are established under mild assumptions. If the algorithm generates infinitely many serious steps, we identify two subsequences such that every cluster point of each subsequence is stationary. If the number of serious steps is finite, we show that the final serious step generates a stationary point. Numerical experiments demonstrate the efficiency and broad applicability of the proposed method across a wide range of test problems, including applications in image denoising, multiobjective optimization, and data clustering. To extend the applicability of the proposed method to problems with general smooth nonlinear constraints, we propose a heuristic approach based on sequential linearization.
Related
- Exact Theory and Optimal Stepsizes for Stochastic Gradient Descent in Smooth Convex Minimization
- Broximal Gradient Descent: A Projection-Free Sister of Projected Gradient Descent
- Projected Riemannian Gradient Descent for the Bures-Wasserstein Barycenter: Dimension-Independent Linear Convergence at Unit Step Size
- A method for global minimization of nonconvex quadratic functions
- Minimax optimality for sequential gradient-free minimization of smooth functions and their derivatives
BibTeX
@misc{maleknia2026projected,
title = {{A projected descent method for minimization of weakly semismooth functions over polyhedral sets}},
author = {Morteza Maleknia and Majid Soleimani-damaneh},
howpublished = {arXiv},
year = {2026},
month = sep,
doi = {10.48550/arxiv.2609.36282},
eprint = {2609.36282},
archivePrefix = {arXiv},
url = {https://arxiv.org/abs/2609.36282},
}
RIS
TY - UNPB
TI - A projected descent method for minimization of weakly semismooth functions over polyhedral sets
AU - Morteza Maleknia
AU - Majid Soleimani-damaneh
PY - 2026
DA - 2026/09/28
PB - arXiv
DO - 10.48550/arxiv.2609.36282
UR - https://arxiv.org/abs/2609.36282
AB - This study develops a projection-based descent method for minimizing weakly semismooth functions over polyhedral sets, taking an initial step toward extending projection-based descent algorithms to nonsmooth, nonconvex optimization problems. At each iteration, the method considers an inner approximation of the Clarke ε-subdifferential at the current iterate over the feasible region and uses its least-norm element to generate a search direction. An exponential limited backtracking line search is then developed to assess the quality of the generated direction, while a projected variant of Mifflin's line search is proposed to identify nonredundant subgradients that enrich the Clarke ε-subdifferential approximation when necessary. To quantify stationarity, a characterization of stationary points based on the projection operator yields a computable optimality measure for the proposed method. The convergence properties of the proposed method are established under mild assumptions. If the algorithm generates infinitely many serious steps, we identify two subsequences such that every cluster point of each subsequence is stationary. If the number of serious steps is finite, we show that the final serious step generates a stationary point. Numerical experiments demonstrate the efficiency and broad applicability of the proposed method across a wide range of test problems, including applications in image denoising, multiobjective optimization, and data clustering. To extend the applicability of the proposed method to problems with general smooth nonlinear constraints, we propose a heuristic approach based on sequential linearization.
ER -