oru.sePublications
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Semantic Question-Answering with Video and Eye-Tracking Data: AI Foundations for Human Visual Perception Driven Cognitive Film Studies
Human-Centred Cognitive Assistance, University of Bremen, Bremen, Germany.
Human-Centred Cognitive Assistance, University of Bremen, Bremen, Germany. (AASS)ORCID iD: 0000-0002-6290-5492
2016 (English)In: Proceedings of the Twenty-Fifth International Joint Conference on Artificial Intelligence (IJCAI 2016), International Joint Conference on Artificial Intelligence , 2016, p. 2633-2639Conference paper, Published paper (Refereed)
Abstract [en]

We present a computational framework for the grounding and semantic interpretation of dynamic visuo-spatial imagery consisting of video and eyetracking data. Driven by cognitive film studies and visual perception research, we demonstrate key technological capabilities aimed at investigating attention and recipient effects vis-a-vis the motion picture; this encompasses high-level analysis of subject's visual fixation patterns and correlating this with (deep) semantic analysis of the dynamic visual data (e.g., fixation on movie characters, influence of cinematographic devices such as cuts). The framework and its application as a general AI-based assistive technology platform -integrating vision and KR- for cognitive film studies is highlighted.

Place, publisher, year, edition, pages
International Joint Conference on Artificial Intelligence , 2016. p. 2633-2639
Series
International Joint Conference on Artificial Intelligence, ISSN 1045-0823
National Category
Computer Sciences
Identifiers
URN: urn:nbn:se:oru:diva-63597Scopus ID: 2-s2.0-85006147319OAI: oai:DiVA.org:oru-63597DiVA, id: diva2:1168914
Conference
25th International Joint Conference on Artificial Intelligence (IJCAI 2016), New York, United States, July 9-15, 2016
Available from: 2017-12-21 Created: 2017-12-21 Last updated: 2018-07-24Bibliographically approved

Open Access in DiVA

No full text in DiVA

Other links

ScopusSemantic Question-Answering with Video and Eye-Tracking Data

Authority records BETA

Bhatt, Mehul

Search in DiVA

By author/editor
Bhatt, Mehul
Computer Sciences

Search outside of DiVA

GoogleGoogle Scholar

urn-nbn

Altmetric score

urn-nbn
Total: 134 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf