Multimodal Corpus

Linguistic Data

Definitions of terms

Contextual usage of the term in sentences or texts

Terminological relations such as synonymy, antonymy, hyponymy, and collocations

Grammatical information about the terms.

Phonetics deals with the sounds of human speech production and transmition.

Morphology refers to knowledge about the internal structure of words.

Syntactic information refers to the structural properties of language.

Lexical information is about the form of words in a language.

Semantic information refers to the meaning conveyed by words.

The impact of social aspects of language on the way people interact.

Audio materials where applicable for terms related to sounds or processes.

Gesture or posture recordings if relevant for certain specialized domains.

Refers to the original sound recordings before feature extraction.

Are numerical representations extracted from raw waveform.

Labels added to raw data to indicate its meaning, or tructure.

The aspects of speech that convey meaning beyond the literal words.

Refers to contextual information about the audio Features

Any data about the audio that provides context beyond the transcript.

Images depicting the concept or term to represent entities, events, properties, or processes

Diagrams or animations illustrating dynamic processes or relationships

Pictures, diagrams, or photographs that are associated with text.

Frames video metadata (like timestamps, scene changes).

Includes visual representations of data or trends

Images of handwritten or printed text that need OCR

Data extracted from images to align with textual embeddings.

Positions, shapes, and arrangement of visual elements