{
  "abstract": "Textbooks, diagrams, and recorded lectures often provide complementary accounts of the same concept. Conversational learning assistants can retrieve relevant material, yet learners still need a way to inspect the original source of a generated statement.\n\nThis preprint presents the system architecture and interaction design of a multimodal retrieval-augmented learning prototype that indexes textbook passages, descriptions of textbook figures, and timestamped descriptions of sampled lecture-video frames. Its central contribution is a provenance-to-viewer mapping that connects retrieved evidence with inspectable document pages and video timestamps through an explicit source registry.\n\nThe accompanying Python and Streamlit research prototype incorporates dense semantic retrieval, an evidence-first split-pane interface, structured evidence controls, and handling for missing or invalid source references. The paper distinguishes implemented mechanisms from design intentions and identifies limitations concerning speech transcription, claim-level attribution, and end-to-end navigation verification.\n\nWe describe this approach as verifiable interaction: enabling learners to move from AI-generated explanations or retrieved references toward original materials for independent inspection. This is a system and interaction-design contribution, not a controlled evaluation of retrieval accuracy, usability, or learning outcomes.\n\nResearch context\n\nA preliminary version of this work was included in Spotlight Presentations II at the AIED 2026 Workshop on Designing and Evaluating Next-Generation Learning Interfaces. This October 2026 revision is an independent system and interaction-design preprint, not a separately peer-reviewed proceedings publication.\n\nCode repository: https://github.com/William-Turing/multimodal-rag-verifiable-tutor\n\nWorkshop programme: https://extendedhorizon.com/aied2026ws-ai-hci-ls/program/",
  "abstract_shown": true,
  "affiliations": [
    "University of Reading"
  ],
  "article_type": null,
  "arxiv": null,
  "author_total": 1,
  "authors": [
    {
      "affs": [
        0
      ],
      "name": "Rongyu Wang"
    }
  ],
  "bibtex": "https://research.draconitic.com/paper/etxp0actz4znq.bib",
  "cited_by": 0,
  "doi": "10.5281/zenodo.23418230",
  "fulltext_url": null,
  "id": "etxp0actz4znq",
  "issns": [],
  "landing_url": "https://zenodo.org/records/23418230",
  "language": "eng",
  "licence": "CC-BY-4.0",
  "licence_label": "CC BY 4.0",
  "licence_source": "article",
  "licence_url": "https://creativecommons.org/licenses/by/4.0/",
  "metadata_licence": null,
  "native_subjects": [],
  "openalex": null,
  "pdf_url": "https://zenodo.org/api/records/23418230/files/Wang_2026_Verifiable_Interaction_Revised_Preprint.pdf/content",
  "pmcid": null,
  "pmid": null,
  "published": "2026-10-16",
  "publisher": null,
  "ris": "https://research.draconitic.com/paper/etxp0actz4znq.ris",
  "sources": [
    {
      "first_seen": "2026-10-30T12:17:43Z",
      "native_id": "23418230",
      "source": "zenodo",
      "url": "https://zenodo.org/records/23418230"
    }
  ],
  "subjects": [],
  "title": "Designing Temporally Grounded Multimodal Learning Interfaces for Verifiable Interaction",
  "title_text": "Designing Temporally Grounded Multimodal Learning Interfaces for Verifiable Interaction",
  "type": "preprint",
  "updated_at": "2026-10-30T12:33:41Z",
  "url": "https://research.draconitic.com/paper/etxp0actz4znq",
  "venue": "Zenodo",
  "versions": []
}