Skip to content
DraconiticResearch
Search Sources API
182,460 studies31 sourcesUpdated 19 min ago
PreprintarXiv licencearXiv

Finite Recovery by Extrapolation for the Douglas--Rachford Method on Affine Subspaces

Abstract

We completely describe the dynamics of the Douglas--Rachford (DR) method for solving affine subspace feasibility. We characterise the affine hull of the resulting iterates, and we show how the corresponding search space's dimension is an explicit function of the number of distinct nontrivial principal angles. This dimension can be much smaller than the ambient dimension, helping to explain why extrapolation can be so effective. Using this characterisation, we extend the Lyapunov surrogate method (LSM) to higher extrapolation orders and prove that it recovers the DR limit exactly from finitely many iterates. We show that LSM and a least-squares extrapolation (LeSE) share the affine search spaces used by the generalized minimal residual method (GMRES) applied to the DR fixed-point equation (DR-GMRES). The dimension characterisation gives bounds on the number of steps required for exact recovery by all three methods. We develop adaptive implementations that estimate the search-space dimension from differences between successive DR iterates and use this estimate to select the extrapolation order. Numerical experiments show how ill-conditioning affects recovery accuracy, and we identify cases where adaptive extrapolation runs faster than DR-GMRES.

Related

  1. The Douglas--Rachford algorithm for normal cones converges only weakly
    Minh N. Bùi, Honglin Luo, Xianfu Wang
    arXivPreprintarXiv licenceFull textOptimisation & controlarXiv
  2. A Convex Feasibility Problem for Which Douglas-Rachford Converges Only Weakly
    Jan Quan, Panagiotis Patrinos
    arXivPreprintCC BY-NC-ND 4.0Full textOptimisation & controlarXiv
  3. Douglas-Rachford splitting method for nonconvex stochastic optimal control
    François Caffier, Paul Malisani, Laurent Pfeiffer
    HALPreprintCC BY 4.0Full textOptimisation & controlHALarXiv
  4. Inertial parameterized Douglas-Rachford for generalized DC programming problems
    Avinash Dixit, Pankaj Gautam, Sorin-Mihai Grad
    arXivPreprintCC BY 4.0Full textOptimisation & controlarXiv
  5. GPU-Accelerated Bregman Douglas-Rachford Splitting for Discrete Optimal Transport
    Yifan Xu, Shiqian Ma
    arXivPreprintarXiv licenceFull textOptimisation & controlarXiv
BibTeX
@misc{collard2026finite,
  title = {{Finite Recovery by Extrapolation for the Douglas--Rachford Method on Affine Subspaces}},
  author = {Jordan Collard and Scott B. Lindstrom},
  howpublished = {arXiv},
  year = {2026},
  month = nov,
  doi = {10.48550/arxiv.2611.02694},
  eprint = {2611.02694},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2611.02694},
}
RIS
TY  - UNPB
TI  - Finite Recovery by Extrapolation for the Douglas--Rachford Method on Affine Subspaces
AU  - Jordan Collard
AU  - Scott B. Lindstrom
PY  - 2026
DA  - 2026/11/02
PB  - arXiv
DO  - 10.48550/arxiv.2611.02694
UR  - https://arxiv.org/abs/2611.02694
AB  - We completely describe the dynamics of the Douglas--Rachford (DR) method for solving affine subspace feasibility. We characterise the affine hull of the resulting iterates, and we show how the corresponding search space's dimension is an explicit function of the number of distinct nontrivial principal angles. This dimension can be much smaller than the ambient dimension, helping to explain why extrapolation can be so effective. Using this characterisation, we extend the Lyapunov surrogate method (LSM) to higher extrapolation orders and prove that it recovers the DR limit exactly from finitely many iterates. We show that LSM and a least-squares extrapolation (LeSE) share the affine search spaces used by the generalized minimal residual method (GMRES) applied to the DR fixed-point equation (DR-GMRES). The dimension characterisation gives bounds on the number of steps required for exact recovery by all three methods. We develop adaptive implementations that estimate the search-space dimension from differences between successive DR iterates and use this estimate to select the extrapolation order. Numerical experiments show how ill-conditioning affects recovery accuracy, and we identify cases where adaptive extrapolation runs faster than DR-GMRES.
ER  -