Charles Explorer logo
🇬🇧

Introduction to Text Processing and Analysis

Class at Faculty of Arts |
AMLV00067

Syllabus

File formats related to textual data

Plain text: Encoding, data and metadata

Extensible Markup Language or XML

Regular expressions

Tokenization and corpus-data formats

Morphological analysis: principles and tools

Syntactic and semantic annotation

Corpus exploration and analysis

Querying corpus data with CQL

Text alignment and parallel corpora

Annotation

The main objective of the course is to provide beginner-level digital linguistics students with all the necessary information on text processing and analysis. Starting with basic topics, such as characteristics of a plain text format and the difference between data and metadata, the course goes on to explain the specifics of XML and different types of text annotation, to introduce the process of tokenization, segmentation and morphological analysis, to describe the limits and possibilities of syntactic and semantic tagging and, finally, to summarize the principles of

CQL and corpus querying, including the use of regular expressions and querying parallel corpora.