This study addresses the methodological and epistemological implications of employing artificial intelligence in the study of severely damaged manuscripts, proposing a paradigm shift from traditional Handwritten Text Recognition (HTR) systems that fail under regimes of severe material degradation. Three reference computer vision architectures are compared on the multispectral MADAM dataset: object detection (Faster R-CNN), semantic segmentation (U-Net), and instance segmentation (Mask R-CNN), evaluated on incremental training subsets ranging from 6 to 84 patches. Semantic segmentation outperforms both object detection and instance segmentation across most metrics, achieving stable performance from 24 annotated patches; conversely, Faster R-CNN and Mask R-CNN architectures require larger datasets to avoid divergence during training (Carcagnì et al. 2026). However, U-Net encounters a structural limitation in case of thin or nearly transparent strokes where residual ink is insufficient to support segmentation; under such conditions, textual completion requires the expert’s judgment. This work, therefore, justifies a human-in-the-loop (HITL) approach in which algorithmic analytical capabilities and philological, linguistic, and semiotic expertise operate in a complementary manner throughout the entire recognition pipeline. A new hermeneutic paradigm, where the acronym AI alludes to a necessary collaboration between Artificial Intelligence and Artisan Intelligence –for the safeguarding of Artistic Intelligence of humankind.

Reading the Unreadable: Artificial Intelligence for Text Interpretation in Degraded Manuscripts

Scutelnic, Dumitru
;
Trovati, Anna;Daffara, Claudia
2026-01-01

Abstract

This study addresses the methodological and epistemological implications of employing artificial intelligence in the study of severely damaged manuscripts, proposing a paradigm shift from traditional Handwritten Text Recognition (HTR) systems that fail under regimes of severe material degradation. Three reference computer vision architectures are compared on the multispectral MADAM dataset: object detection (Faster R-CNN), semantic segmentation (U-Net), and instance segmentation (Mask R-CNN), evaluated on incremental training subsets ranging from 6 to 84 patches. Semantic segmentation outperforms both object detection and instance segmentation across most metrics, achieving stable performance from 24 annotated patches; conversely, Faster R-CNN and Mask R-CNN architectures require larger datasets to avoid divergence during training (Carcagnì et al. 2026). However, U-Net encounters a structural limitation in case of thin or nearly transparent strokes where residual ink is insufficient to support segmentation; under such conditions, textual completion requires the expert’s judgment. This work, therefore, justifies a human-in-the-loop (HITL) approach in which algorithmic analytical capabilities and philological, linguistic, and semiotic expertise operate in a complementary manner throughout the entire recognition pipeline. A new hermeneutic paradigm, where the acronym AI alludes to a necessary collaboration between Artificial Intelligence and Artisan Intelligence –for the safeguarding of Artistic Intelligence of humankind.
2026
Multispectral imaging, damaged manuscripts, semantic segmentation, deep learning, human-in-the-loop, interepistemic paradigm
File in questo prodotto:
File Dimensione Formato  
Scutelnic Trovati De Michiel Daffara UmanisticaDigitale2026.pdf

accesso aperto

Descrizione: Reading the Unreadable - Artificial Intelligence for Text Interpretation in Degraded Manuscripts - Scutelnic Trovati De Michiel Daffara UmanisticaDigitale2026
Tipologia: Versione dell'editore
Licenza: Creative commons
Dimensione 1.29 MB
Formato Adobe PDF
1.29 MB Adobe PDF Visualizza/Apri

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11562/1208647
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus ND
  • ???jsp.display-item.citation.isi??? ND
social impact