BettaAI: a machine-learning object detection model for the quantification of aggressive displays in the Siamese fighting fish Betta splendens
- 1William James Center for Research, ISPA Instituto Universitario, Lisbon, Portugal
Abstract
The Siamese fighting fish (Betta splendens) is well-known for its high levels of aggression and complex, stereotyped displays, making it an ideal model for testing deep learning-based tools for high-throughput, unbiased quantification of aggressive behaviour. A deep-learning object recognition model (BettaAI) was developed to detect the species' aggressive displays, including threat (opercula opening and fin distension), attack (bites) behaviours, as well as surface air breathing, a behaviour correlated with the frequency and intensity of aggression. Videos of males confronting their mirror image were acquired simultaneously with synchronised top and side cameras. Two separate models were trained, with some behaviours identified from top-view frames and others from side-view frames; outputs from both models were combined and post-processed for final quantification. BettaAI performed with high accuracy: F1 scores were 0.99 for the top-view model and 0.93 for the side-view model. Average Precision (AP) at 0.5 IoU exceeded 0.98 for all categories except bites, a rare behaviour in the dataset, which reached 0.865. Comparisons with a manually curated "ground-truth" dataset from videos of 10 males showed strong concordance between automated quantification and manual annotations by expert observers across all behaviours. A case study on 461 males reacting either to a mirror or to a video playback of a conspecific demonstrated the high-throughput and unbiased advantages of BettaAI, with threat displays being more frequent toward the mirror image and attack rates not differing between treatments. This work underscores the potential of BettaAI for automated, bias-free quantification of aggressive displays in B. splendens.
Related
- Quantification of total fish eDNA concentration to optimize the detection of rare species and sampling effort
- Detection and quantification of grapevine downy mildew oospores in soil using digital PCR
- VesiScope: A stand-alone tool for the automatic detection, quantification and size analysis of GUVs from phase contrast microscopy images
- qPyCR: A qPCR Data Analyzer for Template Quantification and the Detection of Performance Outliers
- Predation of Toxorhynchites splendens on Aedes larvae under laboratory conditions and insights into its ecological role as a regulator
BibTeX
@misc{cardoso2026bettaai,
title = {{BettaAI: a machine-learning object detection model for the quantification of aggressive displays in the Siamese fighting fish Betta splendens}},
author = {S. D. Cardoso and B. Fusani and A. Ramos and J. M. Maria and D. M. Goncalves},
howpublished = {bioRxiv},
year = {2026},
month = sep,
doi = {10.64898/2026.09.30.755682},
url = {https://www.biorxiv.org/content/10.64898/2026.09.30.755682v1},
note = {CC BY},
}
RIS
TY - UNPB
TI - BettaAI: a machine-learning object detection model for the quantification of aggressive displays in the Siamese fighting fish Betta splendens
AU - S. D. Cardoso
AU - B. Fusani
AU - A. Ramos
AU - J. M. Maria
AU - D. M. Goncalves
PY - 2026
DA - 2026/09/30
PB - bioRxiv
DO - 10.64898/2026.09.30.755682
UR - https://www.biorxiv.org/content/10.64898/2026.09.30.755682v1
AB - The Siamese fighting fish (Betta splendens) is well-known for its high levels of aggression and complex, stereotyped displays, making it an ideal model for testing deep learning-based tools for high-throughput, unbiased quantification of aggressive behaviour. A deep-learning object recognition model (BettaAI) was developed to detect the species' aggressive displays, including threat (opercula opening and fin distension), attack (bites) behaviours, as well as surface air breathing, a behaviour correlated with the frequency and intensity of aggression. Videos of males confronting their mirror image were acquired simultaneously with synchronised top and side cameras. Two separate models were trained, with some behaviours identified from top-view frames and others from side-view frames; outputs from both models were combined and post-processed for final quantification. BettaAI performed with high accuracy: F1 scores were 0.99 for the top-view model and 0.93 for the side-view model. Average Precision (AP) at 0.5 IoU exceeded 0.98 for all categories except bites, a rare behaviour in the dataset, which reached 0.865. Comparisons with a manually curated "ground-truth" dataset from videos of 10 males showed strong concordance between automated quantification and manual annotations by expert observers across all behaviours. A case study on 461 males reacting either to a mirror or to a video playback of a conspecific demonstrated the high-throughput and unbiased advantages of BettaAI, with threat displays being more frequent toward the mirror image and attack rates not differing between treatments. This work underscores the potential of BettaAI for automated, bias-free quantification of aggressive displays in B. splendens.
ER -