MultiCo-Hub: a corpus of multimodal enrichments with motion-trajectory annotation

Klessa, Katarzyna

Użyj poniższego opisu do cytowania zasobu albo wyeksportuj go w wybranym formacie:

Klessa, Katarzyna; Karpiński, Maciej; Jarmołowicz-Nowikow, Ewa; Sawicka-Stępińska, Brygida and Klessa, Wojciech, 2025, MultiCo-Hub: a corpus of multimodal enrichments with motion-trajectory annotation, CLARIN-PL Repository, http://hdl.handle.net/11321/964.

dc.contributor.author	Klessa, Katarzyna
dc.contributor.author	Karpiński, Maciej
dc.contributor.author	Jarmołowicz-Nowikow, Ewa
dc.contributor.author	Sawicka-Stępińska, Brygida
dc.contributor.author	Klessa, Wojciech
dc.date.accessioned	2025-12-04T08:06:08Z
dc.date.available	2025-12-04T08:06:08Z
dc.date.issued	2025
dc.description	MultiCo-Hub is a multimodal dataset including 11 zipped subsets (henceforth: sessions) of time-aligned audio, video and motion-capture–derived BVH data, together with multi-layered Annotation Pro files (ANTx) extended with automatically extracted motion-trajectory layers. The dataset includes a dedicated training session demonstrating body movement (TESM_001). The video and audio files included in remaining 10 sessions are derived from the MultiCo corpus (http://hdl.handle.net/11321/942). The original MultiCo sessions were enriched by means of: - full audio, video and BVH streams synchronization to enhance precise multimodal analysis - motion-capture (BVH) data normalization, conversion, and integration directly into the annotation files as layers describing trajectories of selected body parts (positions, speeds, gesture-space coordinates). Furthermore, for each session, the corpus provides a composite multi-view video file showing all four camera angles simultaneously. This makes the dataset easier to inspect and substantially more accessible for users working on standard-performance computers. MultiCo-Hub offers a compact, ready-to-use resource for research and education in the areas of speech–gesture coordination, gesture space, temporal properties of movement, communicative alignment of interlocutors, and multimodal interaction. Export to common formats (TextGrid, EAF, CSV, etc.) is supported via Annotation Pro, facilitating downstream statistical analysis, visualization and interoperability. The MultiCo-Hub set also served as input for developing a set of R and C# applications and scripts that support the analysis and visualization of gesture space, temporal movement properties, and communicative alignment in dialogue.
dc.identifier.uri	http://hdl.handle.net/11321/964
dc.language.iso	pol
dc.publisher	Adam Mickiewicz University, Poznan
dc.relation	https://clarin-pl.eu/dspace/bitstream/handle/11321/964/TESM_001.zip?sequence=1&isAllowed=y
dc.relation	https://clarin-pl.eu/dspace/bitstream/handle/11321/964/ASMB_003.zip?sequence=13&isAllowed=y
dc.relation	https://clarin-pl.eu/dspace/bitstream/handle/11321/964/MJAB_003.zip?sequence=2&isAllowed=y
dc.relation	https://clarin-pl.eu/dspace/bitstream/handle/11321/964/JSKZ_003.zip?sequence=11&isAllowed=y
dc.relation	https://clarin-pl.eu/dspace/bitstream/handle/11321/964/JUPS_003.zip?sequence=8&isAllowed=y
dc.relation	https://clarin-pl.eu/dspace/bitstream/handle/11321/964/JWJS_003.zip?sequence=9&isAllowed=y
dc.relation	https://clarin-pl.eu/dspace/bitstream/handle/11321/964/KKWC_003.zip?sequence=5&isAllowed=y
dc.relation	https://clarin-pl.eu/dspace/bitstream/handle/11321/964/LCMT_003.zip?sequence=7&isAllowed=y
dc.relation	https://clarin-pl.eu/dspace/bitstream/handle/11321/964/MMMP_003.zip?sequence=3&isAllowed=y
dc.relation	https://clarin-pl.eu/dspace/bitstream/handle/11321/964/OKWS_003.zip?sequence=12&isAllowed=y
dc.relation	https://clarin-pl.eu/dspace/bitstream/handle/11321/964/TSRT_003.zip?sequence=4&isAllowed=y
dc.rights	Creative Commons - Attribution-NonCommercial-NoDerivatives 4.0 International (CC BY-NC-ND 4.0)
dc.rights.label	PUB
dc.rights.uri	https://creativecommons.org/licenses/by-nc-nd/4.0/
dc.subject	multimodal communication
dc.subject	BVH
dc.subject	Annotation Pro
dc.subject	speech and movement
dc.subject	ANTx
dc.subject	multilayer annotation
dc.title	MultiCo-Hub: a corpus of multimodal enrichments with motion-trajectory annotation
dc.type	corpus
local.contact.person	Katarzyna Klessa katarzyna@klessa.pl Adam Mickiewicz University, Poznan
local.files.count	11
local.files.size	5641586239
local.has.files	yes
local.language.name	Polish
local.size.info	10 other
local.size.info	1 other
local.sponsor	euFunds KPOD.01.18-IW.03-0013/23 Krajowy Plan Odbudowy (KPO) / European funds for Poland’s recovery and resilience plan (KPO) Cyfrowa Infrastruktura Badawcza dla Humanistyki i Nauk o Sztuce DARIAH-PL
local.sponsor	euFunds POIR.04.02.00-00-D006/20 Program Operacyjny Inteligentny Rozwój 2014-2020 w obszarze Rozwój nowoczesnej infrastruktury badawczej sektora nauki / Intelligent Development Operational Program 2014-2020, Polish National Center for Research and Development Cyfrowa Infrastruktura Badawcza dla Humanistyki i Nauk o Sztuce DARIAH-PL / Digital Research Infrastructure for the Humanities and
metashare.ResourceInfo#ContentInfo.mediaType	video

Kolekcje

MultiCo

Ten zasób jestPublicznie dostępnyi został udostępniony na licencji:Creative Commons - Attribution-NonCommercial-NoDerivatives 4.0 International (CC BY-NC-ND 4.0)

Pliki w tym zasobie

Nazwa: TESM_001.zip
Rozmiar: 212.73 MB
Format: application/zip
Opis: Training session demonstrating body movement
Suma kontrolna MD5: 1ece9665861188d6c92f1d542bd5fcf6