{
  "abstract": "In real-world surveillance, situations arise in which two people wear nearly identical clothing or in which identifying features are obscured by heavy occlusions and shifting poses. In these environments, traditional uni-modal systems that rely on static appearance do not perform well and often produce false matches. This paper presents a multi-modal Re-ID framework that combines appearance, facial features, and gait to accurately perform this task. In the first stage, robust person tracklets are extracted from video using a YOLOv8 detector and a DeepSORT tracker. A multi-modal feature extractor is then applied to each person crop through three parallel streams. A custom GaitSet-inspired network produces a 256-dimensional gait embedding from RGB tracklet frames. An OSNet backbone is used to get a 1024-dimensional omni-scale appearance embedding. For facial biometrics, a Multi-Task Cascaded Convolutional Network (MTCNN) is used to explicitly detect the face and five-point landmarks followed by a facial landmark regression model. Each crop is aligned to a landmark and the aligned face is sent to FaceNet for computing the 128 dimensional facial embedding. In the last step, an Ensemble Concatenation module merges these three normalised embeddings into a single $$\\mathbb {R}^{1408}$$ identity descriptor ( $$1024 + 256 + 128$$ ). The discriminability is significantly improved through the combination of facial features and temporal motion cues. Furthermore, the fusion strategy prevents any single modality from causing identity leakage, thereby providing a strong defense against appearance-based identity errors.",
  "abstract_shown": true,
  "affiliations": [
    "Department of Computer Engineering, Pimpri Chinchwad College of Engineering",
    "Department of Computer Science, Applied College, Princess Nourah bint Abdulrahman University",
    "School of Computer Sciences, University of Petroleum and Energy Studies (UPES)",
    "Department of Computer Science, King Khalid University"
  ],
  "article_type": null,
  "arxiv": null,
  "author_total": 8,
  "authors": [
    {
      "affs": [
        0
      ],
      "name": "Swati Shinde"
    },
    {
      "affs": [
        0
      ],
      "name": "Sahil Hirve"
    },
    {
      "affs": [
        0
      ],
      "name": "Tushar Badlani"
    },
    {
      "affs": [
        0
      ],
      "name": "Shashank Dhudhane"
    },
    {
      "affs": [
        0
      ],
      "name": "Saurabh Dhakite"
    },
    {
      "affs": [
        1
      ],
      "name": "Lubna A. Gabralla"
    },
    {
      "affs": [
        2
      ],
      "name": "Tanupriya Choudhury"
    },
    {
      "affs": [
        3
      ],
      "name": "Minakshi Singh"
    }
  ],
  "bibtex": "https://research.draconitic.com/paper/dnyf42zgk9fx4.bib",
  "cited_by": 0,
  "doi": "10.1038/s41598-026-69393-7",
  "fulltext_url": "https://doi.org/10.1038/s41598-026-69393-7",
  "id": "dnyf42zgk9fx4",
  "issns": [
    "2045-2322"
  ],
  "landing_url": "https://doi.org/10.1038/s41598-026-69393-7",
  "language": "en",
  "licence": "CC-BY",
  "licence_label": "CC BY",
  "licence_source": "journal",
  "licence_url": "https://creativecommons.org/licenses/by/4.0/",
  "metadata_licence": null,
  "native_subjects": [
    [
      "lcc",
      "Q"
    ],
    [
      "lcc",
      "R"
    ],
    [
      "openalex",
      "1707|Video Surveillance and Tracking Methods"
    ]
  ],
  "openalex": "W7207848314",
  "pdf_url": "https://www.nature.com/articles/s41598-026-69393-7_reference.pdf",
  "pmcid": null,
  "pmid": null,
  "published": "2026-09-01",
  "publisher": "Nature Portfolio",
  "ris": "https://research.draconitic.com/paper/dnyf42zgk9fx4.ris",
  "sources": [
    {
      "first_seen": "2026-10-30T13:45:57Z",
      "native_id": "82fc878823dc48d9876f36848f0ad162",
      "source": "doaj",
      "url": "https://doi.org/10.1038/s41598-026-69393-7"
    }
  ],
  "subjects": [
    {
      "field": "medicine",
      "origin": "lcc:R",
      "subfield": "general"
    }
  ],
  "title": "An end-to-end multi-modal pipeline for person search in unconstrained CCTV environments",
  "title_text": "An end-to-end multi-modal pipeline for person search in unconstrained CCTV environments",
  "type": "peer-reviewed",
  "updated_at": "2026-10-30T13:45:57Z",
  "url": "https://research.draconitic.com/paper/dnyf42zgk9fx4",
  "venue": "Scientific Reports",
  "versions": []
}