Transformer language models reveal distinct patterns in aphasia subtypes and longitudinal change

Language impairments in aphasia are characterized by various representational disruptions that may be reflected in discourse production. This research examines the capacity of transformer-based language models, particularly GPT-2, to serve as a computational framework for analyzing variations in aphasic narrative speech. A longitudinal dataset of narrative speech samples collected at six time points from individuals with aphasia (N = 47; baseline cross-sectional sample N = 57) was utilized as part of an intervention study.

All transcripts were processed via the GPT-2 language model to obtain activation values from each of the 12 transformer layers. Statistically significant differences in activation values across aphasia subtypes were found at every layer (all p < .001), with the most pronounced effects in the deeper layers. Pairwise Tukey HSD tests revealed consistent distinctions between Broca’s aphasia and both Anomic and Wernicke’s aphasia, suggesting a shared activation profile between the latter two.

Longitudinal tests revealed significant changes over time, especially in the final three layers (10–12). These findings suggest that transformer-based activation patterns reflect meaningful variation in aphasic discourse and may align with clinical observations. Overall, GPT-2 provides a scalable tool to model representational dynamics in aphasia and may offer exploratory insights into language representation in aphasic discourse.

National Institute on Deafness and Other Communication Disorders (DC014664; PI J. Department of Communication Sciences and Disorders, University of South Carolina, Columbia, SC, USA S. Saeed Ahmadi, Julius Fridriksson & Dirk B. den Ouden Department of Communication Sciences and Disorders, Chapman University, Orange, CA, USA The authors declare no competing interests.

The study involved secondary analysis of clinical speech data and was approved by the Institutional Review Board of the University of South Carolina. All procedures were conducted in accordance with relevant ethical guidelines. Informed consent was obtained from all participants or their legally authorized representatives.

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations. Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material.