oru.sePublications
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • harvard1
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Cognitive media studies: Potentials for spatial cognition and AI research
Örebro University, School of Science and Technology. University of Bremen, Bremen, Germany.ORCID iD: 0000-0002-6290-5492
2018 (English)In: Cognitive Processing, ISSN 1612-4782, E-ISSN 1612-4790, Vol. 19, no Suppl. 1, p. S6-S6Article in journal, Meeting abstract (Other academic) Published
Abstract [en]

Cognitive media studies has developed as an area of research at the interface of disciplines as diverse as aesthetics, psychology, neuroscience, film theory, and cognitive science. In this context, the focus of this talk is on the foundational significance of artificial intelligence and visuo-spatial cognition and computation for the design of inte-grated analytical–empirical methods for the (multi-modal) analysis of human behaviour data vis-a-vis a range of digital visuo-auditory narrative media (e.g., narrative film). The presentation focusses on the methodological foundations and assistive technologies for systematic formalization and empirical analyses aimed at, for instance, the generation of evidence, establishing and characterizing correlates between principles for the synthesis of the moving image (e.g., from a cinematographic viewpoint), and its perceptual recipient effects and influence on observers.

In the backdrop a range of completed and ongoing experiments, we emphasize the core results on the semantic interpretation of human behaviour vis-a-vis narrative film and its visuo-auditory reception. We demonstrate the manner in which AI-based models for machine coding of narrative, and relational inference and learning serves as basis to externalize explicit and inferred knowledge about embodied visuo-auditory reception, e.g., using modalities such as diagrammatic representations, natural language, complex (dynamic) data visualizations.

Demonstration: The presentation will particularly showcase methods and tools developed to perform perceptual narrativisation or sensemaking with multi-modal, dynamic human-behaviour data (combining visuo-spatial imagery such as film/video, eye-tracking, head-tracking during a perception task) for a chosen set of experimental material based on existing films, as well as lab-developed experimental content.

Place, publisher, year, edition, pages
Springer Berlin/Heidelberg, 2018. Vol. 19, no Suppl. 1, p. S6-S6
National Category
Psychology
Identifiers
URN: urn:nbn:se:oru:diva-68757DOI: 10.1007/s10339-018-0884-3ISI: 000442849900015OAI: oai:DiVA.org:oru-68757DiVA, id: diva2:1246888
Available from: 2018-09-10 Created: 2018-09-10 Last updated: 2018-09-10Bibliographically approved

Open Access in DiVA

No full text in DiVA

Other links

Publisher's full text

Authority records BETA

Bhatt, Mehul

Search in DiVA

By author/editor
Bhatt, Mehul
By organisation
School of Science and Technology
In the same journal
Cognitive Processing
Psychology

Search outside of DiVA

GoogleGoogle Scholar

doi
urn-nbn

Altmetric score

doi
urn-nbn
Total: 140 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • harvard1
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf