The Role of Environmental Information and the Limitations of Predictability with Transformer-based Time-Series Models for complex Astrocyte Trajectories
- 1Kanagawa Institute of Technology
Abstract
Morphogenesis is the process by which an organism develops from a single cell into a complex organism, and one factor contributing to this complexity is the interaction between cells and their environment. In heterogeneous environments comprising differing cell types and polymeric structures, the observed complexity appears to approach an infinite value. Recent developments in imaging tools and deep learning for image analysis enable the extraction of meaning from terabyte-scale images at a realistic computational cost. In this paper, we used a Transformer-based model to predict the migration trajectories of astrocytes during mouse brain development, aiming to quantitatively elucidate (i) what makes prediction difficult, i.e., the structure of predictability and its theoretical limit, and (ii) to what extent environmental information (vascular structure) and multimodal modeling of the predictive distribution can improve prediction. Based on a bivariate Gaussian distribution (μ, σ, ρ) at each time point, we predicted future positions while accounting for uncertainty and evaluate the quality of the predictive distribution. We report three main findings. First, point-prediction accuracy reached a fundamental limit set by the irreducibility of the movement direction; the error curve was described with high accuracy by the mean-squared-displacement law of a persistent random walk. Second, extending the predictive distribution from a single bivariate Gaussian to a continuous mixture (mixture density network, MDN) captured the run/rest bimodality without discretization and substantially improved the quality of the predictive distribution (negative log-likelihood, NLL) while preserving point-prediction accuracy. Third, a model that integrated vascular environmental information into this multimodal model achieved the best performance in point-prediction accuracy, consistently across three training seeds, showing that environmental information contributes to prediction in combination with multimodal output. This study presents both an improvement of the predictive distribution for complex cell migration and a framework for quantifying the limit of predictability based on movement statistics.
Related
- The Youth-GEMs project: genetic and environmental interactions underlying trajectories of youth mental health
- Conditional Generative Adversarial Network for the simulation of seabird trajectories based on environmental data
- An Information Geometry approach to model topological trajectories and Gene Expression Radius from UMAP geometry.
- Maturation of Auditory Stream Segregation in School-Age Children: Effects of Signal Repetition and Frequency Predictability
- Hierarchical permutation entropy regression identifies decadal decline in the intrinsic predictability of butterfly populations
BibTeX
@misc{takahashi2026role,
title = {{The Role of Environmental Information and the Limitations of Predictability with Transformer-based Time-Series Models for complex Astrocyte Trajectories}},
author = {K. Takahashi and K. Zama and Y. Shibata and S. Endo and H. Tabata and K. Nakajima and N. F. Hiroi},
howpublished = {bioRxiv},
year = {2026},
month = oct,
doi = {10.64898/2026.10.15.759300},
url = {https://www.biorxiv.org/content/10.64898/2026.10.15.759300v1},
note = {CC BY},
}
RIS
TY - UNPB
TI - The Role of Environmental Information and the Limitations of Predictability with Transformer-based Time-Series Models for complex Astrocyte Trajectories
AU - K. Takahashi
AU - K. Zama
AU - Y. Shibata
AU - S. Endo
AU - H. Tabata
AU - K. Nakajima
AU - N. F. Hiroi
PY - 2026
DA - 2026/10/15
PB - bioRxiv
DO - 10.64898/2026.10.15.759300
UR - https://www.biorxiv.org/content/10.64898/2026.10.15.759300v1
AB - Morphogenesis is the process by which an organism develops from a single cell into a complex organism, and one factor contributing to this complexity is the interaction between cells and their environment. In heterogeneous environments comprising differing cell types and polymeric structures, the observed complexity appears to approach an infinite value. Recent developments in imaging tools and deep learning for image analysis enable the extraction of meaning from terabyte-scale images at a realistic computational cost. In this paper, we used a Transformer-based model to predict the migration trajectories of astrocytes during mouse brain development, aiming to quantitatively elucidate (i) what makes prediction difficult, i.e., the structure of predictability and its theoretical limit, and (ii) to what extent environmental information (vascular structure) and multimodal modeling of the predictive distribution can improve prediction. Based on a bivariate Gaussian distribution (μ, σ, ρ) at each time point, we predicted future positions while accounting for uncertainty and evaluate the quality of the predictive distribution. We report three main findings. First, point-prediction accuracy reached a fundamental limit set by the irreducibility of the movement direction; the error curve was described with high accuracy by the mean-squared-displacement law of a persistent random walk. Second, extending the predictive distribution from a single bivariate Gaussian to a continuous mixture (mixture density network, MDN) captured the run/rest bimodality without discretization and substantially improved the quality of the predictive distribution (negative log-likelihood, NLL) while preserving point-prediction accuracy. Third, a model that integrated vascular environmental information into this multimodal model achieved the best performance in point-prediction accuracy, consistently across three training seeds, showing that environmental information contributes to prediction in combination with multimodal output. This study presents both an improvement of the predictive distribution for complex cell migration and a framework for quantifying the limit of predictability based on movement statistics.
ER -