Cognitive Plausibility in Natural Language Processing

Lisa Beinborn, Nora Hollenstein (Autoren)

Buch | Hardcover

XI, 158 Seiten

2023 | 1st ed. 2024
Springer International Publishing (Verlag)
978-3-031-43259-0 (ISBN)

Artikel merken

This book explores the cognitive plausibility of computational language models and why it's an important factor in their development and evaluation. The authors present the idea that more can be learned about cognitive plausibility of computational language models by linking signals of cognitive processing load in humans to interpretability methods that allow for exploration of the hidden mechanisms of neural models. The book identifies limitations when applying the existing methodology for representational analyses to contextualized settings and critiques the current emphasis on form over more grounded approaches to modeling language. The authors discuss how novel techniques for transfer and curriculum learning could lead to cognitively more plausible generalization capabilities in models. The book also highlights the importance of instance-level evaluation and includes thorough discussion of the ethical considerations that may arise throughout the various stages of cognitive plausibility research.

Lisa Beinborn is an Assistant Professor for Natural Language Processing at the Computational Linguistics and Text Mining Lab at Vrije Universiteit Amsterdam. She studied Computational Linguistics in Saarbrücken, Barcelona, and Bolzano, and obtained her PhD in Computer Science at TU Darmstadt. Her research focuses on cognitively plausible language processing and cross-lingual models. She works on the interpretability of representational transfer and is interested in educational applications of NLP.
Nora Hollenstein is currently working at the Center for Language Technology of the University of Copenhagen and at the Department of Computational Linguistics of the University of Zurich. She obtained her PhD from ETH Zurich working on cognitively inspired NLP. The focus of her research lies in improving and evaluating natural language processing applications with cognitive signals such as eye-tracking and brain activity recordings. She is especially interested in multilingual and multimodal NLP

Acknowledgments.- Chapter 1 Introduction.- Chapter 2 Foundations of Language Modeling.- Chapter 3 Cognitive Signals of Language Processing.- Chapter 4 Behavioral Patterns.- Chapter 5 Representational Structure.- Chapter 6 Procedural Strategies.- Chapter 7 Towards Cognitively More Plausible Models.- Bibliography.

Erscheinungsdatum	01.11.2023
Reihe/Serie	Synthesis Lectures on Human Language Technologies
Zusatzinfo	XI, 158 p. 3 illus., 2 illus. in color.
Verlagsort	Cham
Sprache	englisch
Maße	168 x 240 mm
Gewicht	458 g
Themenwelt	Mathematik / Informatik ► Informatik
Schlagworte	Cognitive Plausibility • Cognitive Signals • Interpretability • Language models • machine learning • Natural Language Processing
ISBN-10	3-031-43259-2 / 3031432592
ISBN-13	978-3-031-43259-0 / 9783031432590
Zustand	Neuware