Skip to main content

CETAPS Hybrid Research Workshop

Researching picturebook read-aloud sessions: Tools for multimodal annotation and data analysis

by Elisa Bertoldi (University of Udine)

Date: 6 July, 2022

Time: 10.00 – 11.30 (BST)

Venue: Colégio Almada Negreiros, Campus Campolide, FCSH/UNL, Lisbon

Virtual attendance: Zoom Meeting

Read-aloud sessions are complex multimodal communicative events: participants (children and storytellers) orchestrate ensembles of semiotic resources (Kress et al., 2001) such as verbal language, voice features, facial expressions, gaze and gesture in order to make meaning and interact during the performance (Ellis & Mourão, 2021). Researchers need tools to annotate, analyse, visualize, interpret and discuss multimodal data (Flewitt et al., 2017) collected through video-recordings and observations conducted during read-aloud sessions.

This workshop offers researchers an overview of two tools for multimodal annotation and data analysis. The first part of the workshop focuses on ELAN, a software for multi-tier, time-aligned annotation developed by the Max Planck Institute for Psycholinguistics (Nijmegen, The Netherlands). The session is addressed to researchers using ELAN for the first time, or for users who only have a basic experience of the software. In the second part of the workshop, the TMA application will be presented. TMA (developed as part of my PhD thesis in collaboration with a computer developer) is a new web application that can be used to identify data structures and visualize correlations and patterns in data. TMA serves as a tool that elaborates ELAN raw data and offers researchers functionalities and affordances to identify recurrent patterns of modes within specific time spans. Examples of the use of ELAN and TMA will be presented to show their main functionalities and use in context. Hands-on activities will offer participants the opportunity to explore the ELAN software interface and the TMA dashboard.

The workshop will cover:

  • ELAN: time-aligned annotations, creation of controlled vocabulary, multi-tier annotation, setting of tier hierarchy and merging of annotations.

  •  TMA: loading, extracting, analysing and visualising data.

Registation

Deadline for registration is Thursday 30 June 2022