{
  "abstract": "Large language models (LLMs) are commonly enhanced through additional data, parameter optimization, architectural modifications, preference optimization, and increased computational resources. However, improvement does not necessarily require adding information, parameters, components, or computational operations. In some circumstances, the removal of selected objects may improve a model by reducing redundancy, eliminating interference, simplifying computation, or changing the distribution of learning signals. This paper proposes a general conceptual framework for enhancing large language models through deletion performed before training, during training, and after training. The framework treats deletion as a broad class of operations rather than restricting it to the removal of training examples, previously learned knowledge, or any single established technique. Potential deletion targets include data, information, parameters, architectural components, connections, internal representations, behavioral patterns, computational pathways, training objectives, auxiliary mechanisms, memory structures, and other removable objects associated with model development and operation. The framework organizes deletion along three dimensions: lifecycle stage, target category, and deletion strategy. It further introduces a formal representation of deletion operations, a target-selection principle based on expected marginal contribution, and an evaluation framework that considers capability, efficiency, reliability, generalization, and the preservation of useful functionality. A central proposition is that appropriately selected deletion operations may improve selected aspects of model performance when the benefits of removing an object exceed the costs of its removal. The paper develops a research agenda for investigating this proposition through controlled experiments, cross-stage comparisons, interaction analysis, and multi-objective evaluation. The proposed framework does not assume that deletion is inherently beneficial or that all deletion targets are technically removable. Instead, it establishes deletion as a general design dimension for systematic investigation across the lifecycle of large language models.",
  "abstract_shown": true,
  "affiliations": [],
  "article_type": null,
  "arxiv": null,
  "author_total": 1,
  "authors": [
    {
      "name": "Jincheng Zhang",
      "orcid": "0009-0005-1860-0009"
    }
  ],
  "bibtex": "https://research.draconitic.com/paper/5sfyw80gjg9tb.bib",
  "cited_by": 0,
  "doi": "10.5281/zenodo.23464143",
  "fulltext_url": null,
  "id": "5sfyw80gjg9tb",
  "issns": [],
  "landing_url": "https://zenodo.org/records/23464143",
  "language": null,
  "licence": "CC-BY-4.0",
  "licence_label": "CC BY 4.0",
  "licence_source": "article",
  "licence_url": "https://creativecommons.org/licenses/by/4.0/",
  "metadata_licence": null,
  "native_subjects": [],
  "openalex": null,
  "pdf_url": "https://zenodo.org/api/records/23464143/files/Enhancing%20Large%20Language%20Models%20Through%20Pre-Training,%20In-Training,%20and%20Post-Training%20Deletion.pdf/content",
  "pmcid": null,
  "pmid": null,
  "published": "2026-10-19",
  "publisher": null,
  "ris": "https://research.draconitic.com/paper/5sfyw80gjg9tb.ris",
  "sources": [
    {
      "first_seen": "2026-11-02T12:21:53Z",
      "native_id": "23464143",
      "source": "zenodo",
      "url": "https://zenodo.org/records/23464143"
    }
  ],
  "subjects": [],
  "title": "Enhancing Large Language Models Through Pre-Training, In-Training, and Post-Training Deletion",
  "title_text": "Enhancing Large Language Models Through Pre-Training, In-Training, and Post-Training Deletion",
  "type": "preprint",
  "updated_at": "2026-11-02T12:21:53Z",
  "url": "https://research.draconitic.com/paper/5sfyw80gjg9tb",
  "venue": "Zenodo",
  "versions": []
}