MultiCo-Hub: a corpus of multimodal enrichments with motion-trajectory annotation
Użyj poniższego opisu do cytowania zasobu albo wyeksportuj go w wybranym formacie:
Klessa, Katarzyna; Karpiński, Maciej; Jarmołowicz-Nowikow, Ewa; Sawicka-Stępińska, Brygida and Klessa, Wojciech, 2025,
MultiCo-Hub: a corpus of multimodal enrichments with motion-trajectory annotation, CLARIN-PL Repository,
http://hdl.handle.net/11321/964.
Autorzy
Data
2025
Rozmiar
10 other,
1 other
Języki
Opis
MultiCo-Hub is a multimodal dataset including 11 zipped subsets (henceforth: sessions) of time-aligned audio, video and motion-capture–derived BVH data, together with multi-layered Annotation Pro files (ANTx) extended with automatically extracted motion-trajectory layers.
The dataset includes a dedicated training session demonstrating body movement (TESM_001).
The video and audio files included in remaining 10 sessions are derived from the MultiCo corpus (http://hdl.handle.net/11321/942). The original MultiCo sessions were enriched by means of:
- full audio, video and BVH streams synchronization to enhance precise multimodal analysis;
- motion-capture (BVH) data normalization, conversion, and integration directly into the annotation files as layers describing trajectories of selected body parts (positions, speeds, gesture-space coordinates).
Furthermore, for each session, the corpus provides a composite multi-view video file showing all four camera angles simultaneously. This makes the dataset easier to inspect and substantially more accessible for users working on standard-performance computers.
MultiCo-Hub offers a compact, ready-to-use resource for research and education in the areas of speech–gesture coordination, gesture space, temporal properties of movement, communicative alignment of interlocutors, and multimodal interaction.
Export to common formats (TextGrid, EAF, CSV, etc.) is supported via Annotation Pro, facilitating downstream statistical analysis, visualization and interoperability.
The MultiCo-Hub set also served as input for developing a set of R and C# applications and scripts that support the analysis and visualization of gesture space, temporal movement properties, and communicative alignment in dialogue.
Finansowanie
Krajowy Plan Odbudowy (KPO) / European funds for Poland’s recovery and resilience plan (KPO)
Numer projektu:KPOD.01.18-IW.03-0013/23
Nazwa projektu:Cyfrowa Infrastruktura Badawcza dla Humanistyki i Nauk o Sztuce DARIAH-PL
Program Operacyjny Inteligentny Rozwój 2014-2020 w obszarze Rozwój nowoczesnej infrastruktury badawczej sektora nauki / Intelligent Development Operational Program 2014-2020, Polish National Center for Research and Development
Numer projektu:POIR.04.02.00-00-D006/20
Nazwa projektu:Cyfrowa Infrastruktura Badawcza dla Humanistyki i Nauk o Sztuce DARIAH-PL / Digital Research Infrastructure for the Humanities and
Kolekcje
Ten zasób jestPublicznie dostępnyi został udostępniony na licencji:Creative Commons - Attribution-NonCommercial-NoDerivatives 4.0 International (CC BY-NC-ND 4.0)
Pliki w tym zasobie
- Nazwa
- TESM_001.zip
- Rozmiar
- 212.73 MB
- Format
- application/zip
- Opis
- Training session demonstrating body movement
- Suma kontrolna MD5
- 1ece9665861188d6c92f1d542bd5fcf6
The file preview has not been generated yet. Please try again later or contact the system administrator dspace@clarin-pl.eu
- Nazwa
- ASMB_003.zip
- Rozmiar
- 370.64 MB
- Format
- application/zip
- Opis
- Dialog session (audio, video, annotation with movement trajectories, synchronized BVH)
- Suma kontrolna MD5
- 140c89a42624efe87c177947d2589e48
The file preview has not been generated yet. Please try again later or contact the system administrator dspace@clarin-pl.eu
- Nazwa
- MJAB_003.zip
- Rozmiar
- 530.13 MB
- Format
- application/zip
- Opis
- Dialog session (audio, video, annotation with movement trajectories, synchronized BVH)
- Suma kontrolna MD5
- cf53f9d93fe20a33caed3d03e9eab205
The file preview has not been generated yet. Please try again later or contact the system administrator dspace@clarin-pl.eu
- Nazwa
- JSKZ_003.zip
- Rozmiar
- 536.92 MB
- Format
- application/zip
- Opis
- Dialog session (audio, video, annotation with movement trajectories, synchronized BVH)
- Suma kontrolna MD5
- 023a4b13234badf5a5921bc532170172
The file preview has not been generated yet. Please try again later or contact the system administrator dspace@clarin-pl.eu
- Nazwa
- JUPS_003.zip
- Rozmiar
- 536.42 MB
- Format
- application/zip
- Opis
- Dialog session (audio, video, annotation with movement trajectories, synchronized BVH)
- Suma kontrolna MD5
- ab57a95bb989224f1d0a30438711d838
The file preview has not been generated yet. Please try again later or contact the system administrator dspace@clarin-pl.eu
- Nazwa
- JWJS_003.zip
- Rozmiar
- 531.79 MB
- Format
- application/zip
- Opis
- Dialog session (audio, video, annotation with movement trajectories, synchronized BVH)
- Suma kontrolna MD5
- 2927dd83a7c8373d5f9e4d49f01cb5f3
The file preview has not been generated yet. Please try again later or contact the system administrator dspace@clarin-pl.eu
- Nazwa
- KKWC_003.zip
- Rozmiar
- 531.24 MB
- Format
- application/zip
- Opis
- Dialog session (audio, video, annotation with movement trajectories, synchronized BVH)
- Suma kontrolna MD5
- 8de30769965b78aae71c430fed577e60
The file preview has not been generated yet. Please try again later or contact the system administrator dspace@clarin-pl.eu
- Nazwa
- LCMT_003.zip
- Rozmiar
- 537.07 MB
- Format
- application/zip
- Opis
- Dialog session (audio, video, annotation with movement trajectories, synchronized BVH)
- Suma kontrolna MD5
- 233583186018448f32f70454030a5a2e
The file preview has not been generated yet. Please try again later or contact the system administrator dspace@clarin-pl.eu
- Nazwa
- MMMP_003.zip
- Rozmiar
- 529 MB
- Format
- application/zip
- Opis
- Dialog session (audio, video, annotation with movement trajectories, synchronized BVH)
- Suma kontrolna MD5
- ef826fe81da0e788cc9cc912d27e3897
The file preview has not been generated yet. Please try again later or contact the system administrator dspace@clarin-pl.eu
- Nazwa
- OKWS_003.zip
- Rozmiar
- 532.91 MB
- Format
- application/zip
- Opis
- Dialog session (audio, video, annotation with movement trajectories, synchronized BVH)
- Suma kontrolna MD5
- 323fd3b137144d375dba45470eda6a96
The file preview has not been generated yet. Please try again later or contact the system administrator dspace@clarin-pl.eu
- Nazwa
- TSRT_003.zip
- Rozmiar
- 531.39 MB
- Format
- application/zip
- Opis
- Dialog session (audio, video, annotation with movement trajectories, synchronized BVH)
- Suma kontrolna MD5
- 6e350feccd807cfd3b54dec698624fb0
The file preview has not been generated yet. Please try again later or contact the system administrator dspace@clarin-pl.eu