Related Experiment Video
Updated: Jun 5, 2026

The (Spatial) Memory Game: Testing the Relationship Between Spatial Language, Object Knowledge, and Spatial Cognition
Published on: February 19, 2018
Interpreting spatial language in image captions
Mark M Hall1, Philip D Smart, Christopher B Jones
1Cardiff School of Computer Science & Informatics, Cardiff University, Queen's Buildings 5, The Parade, Roath, Cardiff, CF24 3AA, UK. M.M.Hall@cs.cardiff.ac.uk
Abstract:
The map as a tool for accessing data has become very popular in recent years, but a lot of data do not have the necessary spatial meta-data to allow for that. Some data such as photographs however have spatial information in their captions and if this could be extracted, then they could be made available via map-based interfaces. Towards this goal, we introduce a model and spatio-linguistic reasoner for interpreting the spatial information in image captions that is based upon quantitative data about spatial language use acquired directly from people. Spatial language is inherently vague, and both the model and reasoner have been designed to incorporate this vagueness at the quantitative level and not only qualitatively.
More Related Videos
07:36Eye Tracking During Visually Situated Language Comprehension: Flexibility and Limitations in Uncovering Visual Context Effects
Published on: November 30, 2018
09:27Using Eye Movements Recorded in the Visual World Paradigm to Explore the Online Processing of Spoken Language
Published on: October 13, 2018
Related Concept Videos
Depth Perception and Spatial Vision
Selected Data About Geographic Locations
Gestalt Principles of Perception
Manipulation and Analysis