1 – 23. 2. Introduction

Intro lecture; multimodality in communication and linguistics; gesture studies

2 – 2. 3. Multimodal corpora

Review of corpora; methods of data-gathering; sign language corpora; ethical issues

3 – 9. 3. Annotation

Annotation practices and schemes; inter-coder reliability; tools

4 – 16. 3. Annotation

Intro to ELAN annotation sw

5 – 23. 3. Gesture and speech

Co-speech gestures: types, phases, and functions

6 – 30. 3. Gesture and speech

Relation of gesture and prosody; integrating PRAAT and ELAN

7 – 6. 4. Multimodal grammar

Fitting gesture in grammatical frameworks

8 – 13. 4. Multimodal grammar

Multimodal constructions

9 – 20. 4. Case study I

Verbs and gesture in Czech and English

10 – 27. 4. Case study II

Information structure and gesture in Czech and English

11 – 4. 5. Analysis

Analysing and modeling multimodal data

12 – 11. 5. Final discussion I

Project presentation and discussion

13 – 18. 5. Final discussion II

Project presentation and discussion

* assignments
Each student receives a short video extract of spontaneous production from an existing multimodal corpus (own recordings are also possible if available). Commencing meeting 3, students will be regularly assigned minor tasks: first of all to handle the annotation software, than to apply particular aspects of work with multimodal data addressed in the seminar. At the final meeting, students’ projects will be presented and discussed.

Multimodal communication

Osoba