Automatic Language Identification in Texts (eBook)

This book provides readers with a brief account of the history of Language Identification (LI) research and a survey of the features and methods most used in LI literature. LI is the problem of determining the language in which a document is written and is a crucial part of many text processing pipelines. The authors use a unified notation to clarify the relationships between common LI methods. The book introduces LI performance evaluation methods and takes a detailed look at LI-related shared tasks. The authors identify open issues and discuss the applications of LI and related tasks and proposes future directions for research in LI.

Tommi Jauhiainen, Ph.D., is a Post-doctoral Researcher at The University of Helsinki. He wrote his master's thesis on automatic language identification and continued his research on the same subject as a doctoral student. Dr. Jauhiainen organized the first shared task in Cuneiform Language Identification (CLI) in 2019 as well as the Uralic Language Identification (ULI) shared tasks in 2020 and 2021. He is the first author of approximately 20 peer-reviewed publications on language identification.