Syllabus
File formats related to textual data
Plain text: Encoding, data and metadata
Extensible Markup Language or XML
Regular expressions
Tokenization and corpus-data formats
Morphological analysis: principles and tools
Syntactic and semantic annotation
Corpus exploration and analysis
Querying corpus data with CQL
Text alignment and parallel corpora
Annotation
The main objective of the course is to provide beginner-level digital linguistics students with all the necessary information on text processing and analysis. Starting with basic topics, such as characteristics of a plain text format and the difference between data and metadata, the course goes on to explain the specifics of XML and different types of text annotation, to introduce the process of tokenization, segmentation and morphological analysis, to describe the limits and possibilities of syntactic and semantic tagging and, finally, to summarize the principles of
CQL and corpus querying, including the use of regular expressions and querying parallel corpora.