JEPADepth: Self-Supervised Monocular Depth Estimation via Joint-Embedding Predictive Architectures
- 1Department of Computers and Information Technology, Politehnica University of Timișoara, 300223 Timișoara, Romania
Abstract
We propose JEPADepth, a self-supervised monocular depth estimation framework that augments photometric view synthesis with an auxiliary masked-prediction loss computed in the representation space of a pretrained DINOv3 Vision Transformer (ViT), following the Image Joint-Embedding Predictive Architecture (I-JEPA) principle. A predictor infers target-region embeddings from visible context-region embeddings under structured masking; the predictor and target encoder are discarded at inference, so the deployed 24 M-parameter model costs no more than the photometric-only baseline. On the KITTI Eigen split, adding the JEPA objective to an identical DINOv3 photometric baseline lowers absolute relative error from 0.105 to 0.101 and raises δ1 from 0.891 to 0.898, a gain roughly four times the run-to-run standard deviation measured over five random seeds. On the improved ground truth, it reaches 0.075 absolute relative error, matching the best transformer competitor while using 11% fewer inference parameters. Under zero-shot transfer without fine-tuning, it obtains the best absolute relative error on Make3D (0.275) and ties the best on Cityscapes (0.143) while leading on five of seven metrics. Training overhead is ∼16%; inference cost is unchanged.
Related
- Array Rotation in Near-Field ISAC: Communication, Detection, and Estimation Under Low-Complexity Transmit Architectures
- Is Spectral Self-Supervised Learning a Minimax Optimal Method of Density Ratio Estimation?
- Grouped Semi-Supervised Estimation of Two-Sample Functionals via Single-Index Conditional Imputation
- Log predictive density score estimation in the presence of outliers
- Robust variance estimation for multiple imputation using predictive mean matching or parametric imputation models
BibTeX
@article{grigoreatimuţ2026jepadepth,
title = {{JEPADepth: Self-Supervised Monocular Depth Estimation via Joint-Embedding Predictive Architectures}},
author = {Ionuţ-Orlando Grigore-Atimuţ and Călin-Adrian Popa},
journal = {Mathematics},
year = {2026},
month = oct,
doi = {10.3390/math14213846},
url = {https://www.mdpi.com/2227-7390/14/21/3846},
note = {CC BY 4.0},
}
RIS
TY - JOUR
TI - JEPADepth: Self-Supervised Monocular Depth Estimation via Joint-Embedding Predictive Architectures
AU - Ionuţ-Orlando Grigore-Atimuţ
AU - Călin-Adrian Popa
PY - 2026
DA - 2026/10/22
JO - Mathematics
DO - 10.3390/math14213846
UR - https://www.mdpi.com/2227-7390/14/21/3846
AB - We propose JEPADepth, a self-supervised monocular depth estimation framework that augments photometric view synthesis with an auxiliary masked-prediction loss computed in the representation space of a pretrained DINOv3 Vision Transformer (ViT), following the Image Joint-Embedding Predictive Architecture (I-JEPA) principle. A predictor infers target-region embeddings from visible context-region embeddings under structured masking; the predictor and target encoder are discarded at inference, so the deployed 24 M-parameter model costs no more than the photometric-only baseline. On the KITTI Eigen split, adding the JEPA objective to an identical DINOv3 photometric baseline lowers absolute relative error from 0.105 to 0.101 and raises δ1 from 0.891 to 0.898, a gain roughly four times the run-to-run standard deviation measured over five random seeds. On the improved ground truth, it reaches 0.075 absolute relative error, matching the best transformer competitor while using 11% fewer inference parameters. Under zero-shot transfer without fine-tuning, it obtains the best absolute relative error on Make3D (0.275) and ties the best on Cityscapes (0.143) while leading on five of seven metrics. Training overhead is ∼16%; inference cost is unchanged.
SN - 2227-7390
ER -