Three dimensional spatial memory and learning in real and virtual environments

Human orientation and spatial cognition partlydepends on our ability to remember sets ofvisual landmarks and imagine their relationshipto us from a different viewpoint. We normallymake large body rotations only about a singleaxis which is aligned with gravity. However,astronauts who try to recognize environmentsrotated in 3 dimensions report that theirterrestrial ability to imagine the relativeorientation of remembered landmarks does noteasily generalize. The ability of humansubjects to learn to mentally rotate a simplearray of six objects around them was studied in1-G laboratory experiments. Subjects weretested in a cubic chamber (n = 73) and aequivalent virtual environment (n = 24),analogous to the interior of a space stationnode module. A picture of an object waspresented at the center of each wall. Subjectshad to memorize the spatial relationships amongthe six objects and learn to predict thedirection to a specific object if their bodywere in a specified 3D orientation. Percentcorrect learning curves and response times weremeasured. Most subjects achieved high accuracyfrom a given viewpoint within 20 trials,regardless of roll orientation, and learned asecond view direction with equal or greaterease. Performance of the subject group thatused a head mounted display/head tracker wasqualitatively similar to that of the secondgroup tested in a physical node simulator. Body position with respect to gravity had asignificant but minor effect on performance ofeach group, suggesting that results may alsoapply to weightless situations. A correlationwas found between task performance measures andconventional paper-and-pencil tests of fieldindependence and 2&3 dimensional figurerotation ability.     

Wayfinding Through Orientation

Dominant approaches in computer-assisted wayfinding support adhere to the deeply problematic principles of turn-by-turn navigation. In this article, we suggest a new approach called “Wayfinding Through Orientation,” which supports the acquisition of spatial knowledge and cognitive mapping for advancing the user’s spatial orientation. Being oriented on one’s way is a prerequisite to enabling people to verify instructions and to incorporate new spatial information into their existing knowledge structure. In three studies described in this article we first present empirical evidence that people can be supported in survey knowledge acquisition through suitable wayfinding instructions. Consequently, we explore orientation information in human wayfinding instructions. Finally, we outline how orientation information can be communicated within a prototypically implemented navigation assistance system.     

Editorial: Cognitive Semantics and Spatio-Temporal Ontologies

How do people describe the location of a target object to another? This task requires a reference object or frame and terms of reference. Traditional linguistic analyses have loosely organized perspectives around people, objects, or environments as reference objects, using reference terms based on a viewpoint or the intrinsic sides of an object, such as left, right, front, and back or based on the environment, such as north, south, east, and west. In actual communication, social, spatial, and cognitive factors may also affect perspective choice. We examine those factors by varying the spatial information (landmarks and cardinal directions), the communication task (relative cognitive burden to speakers and addressees), and the culture of participants (American and Japanese). Speakers used addressees' perspectives more when addressees had the greater cognitive burden. They also used landmarks and cardinal directions when they were available, especially to avoid difficult discriminations like left/right. Some cases appearing to be perspective taking can be interpreted as using a person as a landmark. Finally, terms like near indicating close proximity were preferred to far and to terms requiring projection of directions. Globally, perspective choices of American and Japanese samples were strikingly similar; that is, Japanese did not select addressees' perspectives more than Americans. The traditional linguistic analyses need to be enhanced to account for effects of cognitive, situational, and social factors.     

Path visualization: a method for objective measurement of spatial visualization

ABSTRACT

The ability to mentally represent spatial information is a fundamental cognitive process. To many people, this process feels a bit like visual perception, hence the term ‘spatial visualization’. In this paper, we describe a method for measuring the accuracy of spatial visualization, specifically visualization of a complex path in imaginary space. A critical feature of this method (called Path Visualization) is that it relies on the detection of intersections in a visualized path. Intersection detection is an inherently spatial task that requires a spatial representation. In this paper, we show how the Path Visualization method works, and how it can be customized to address several key research issues in human spatial cognition.     

Children's control of reference systems in spatial tasks: Foundations of spatial cognitive skill?

Two experiments are presented, one that focused on the abilities of 3- through 8-year-old children to use frames of reference as means for solving a search task in a small-scale perceived space and one that focused on the abilities of 8- through 11-year-old children to use different frames of reference to answer questions about the locations of objects in an environment they had read about. Experiment 1 revealed developmental improvement in the consistent application of object-, place-, and viewer-based frames of reference, with scale of space impacting the pattern of age-related improvement. Experiment 2 showed that young readers' first successes with switching from one reference system to another in representational space involved a vantage point perspective, a viewer-based ``gaze tour' of a small-scale area. Although disparate in focus and method, the studies point to the need for a new theoretical framework for examining developmental issues in the application of spatial frames of reference.     

The Space within Fisherman's Folly: Playing with a Puzzle in Mereotopology

Abstract

In this paper we propose a spatial ontology for reasoning about holes, rigid objects and a string, taking a classical puzzle as a motivating example. In this ontology the domain is composed of spatial regions whereby a theory about holes is defined over a mereotopological basis. Within this theory we define a data structure, named chain, that facilitates a clear and efficient representation of the puzzle states and its solution.     

Reasoning about Depth and Motion from an Observer's Viewpoint

ABSTRACT

The goal of this paper is to present a logic-based formalism for representing knowledge about objects in space and their movements, and show how this knowledge could be built up from the viewpoint of an observer immersed in a dynamic world. In this paper space is represented using functions that extract attributes of depth, size and distance from snapshots of the world. These attributes compose a novel spatial reasoning system named Depth Profile Calculus (DPC). Transitions between qualitative relations involving these attributes are represented by an extension of this calculus called Dynamic Depth Profile Calculus (DDPC). We argue that knowledge about objects in the world could be built up via a process of abduction on DDPC relations.     

Combining Locations from Working Memory and Long-Term Memory into a Common Spatial Image

Abstract

This research uses a novel integration paradigm to investigate whether target locations read in from long-term memory (LTM) differ from perceptually encoded inputs in spatial working-memory (SWM) with respect to systematic spatial error and/or noise, and whether SWM can simultaneously encompass both of these sources. Our results provide evidence for a composite representation of space in SWM derived from both perception and LTM, albeit with a loss in spatial precision of locations retrieved from LTM. More generally, the data support the concept of a spatial image in working memory and extend its potential sources to representations retrieved from LTM.     

Role of the current young generation within the space exploration sector

The space sector gathers together people from a variety of fields who work in the industry on different levels and with different expertise. What is often forgotten is the impact and role of the current young generation. Their engagement is of great importance as undeniably today's young ‘space generation’ will be defining the direction of future space exploration.Today's vision of future human and robotic space exploration has been set out in the Global Exploration Roadmap (GER). This focuses on sustainable, affordable and productive long-term goals. The strategy begins with the International Space Station (ISS) and then expands human presence into the solar system, including a human mission to Mars.This paper presents a general overview of the role of today's youth within the space exploration sector and the challenges to overcome. To complete this perspective, we present results from a survey made among students and young professionals about their levels of awareness of the GER. The respondents presented their opinion about current aspects of the GER and prioritised the GER's objectives. It is hoped that the paper will bring a new perspective into the GER and a contribution to the current GER strategy.     

Revisiting Perspective-Taking: Can People Maintain Imagined Perspectives?

Abstract

Three experiments were conducted to examine whether people can adopt and maintain imagined perspectives in the absence of target information. The task used entailed providing information about an imagined perspective in advance of target information to examine whether this would facilitate perspective-taking performance and reduce or eliminate alignment effects that are commonly reported in the literature. The three experiments employed different types of spatial environments: an environment learned from navigating a computer screen (Experiment 1), and an immersive environment that was either remote (Experiment 2) or immediate (Experiment 3) at the time of retrieval. Across the three experiments, results showed that information about an imagined perspective can be utilized ahead of target information. Furthermore, they suggested that alignment effects can be reduced as a result of processing information about perspective ahead of target information, but only when reasoning about specific nonimmediate spatial relations (Experiments 1 and 2). Results are discussed in connection with previous findings on spatial updating and the organizational structure of spatial memory.     

Human Four-Dimensional Spatial Judgments of Hyper-Volume

The dimensionality limitation of human spatial representations has been a long-lasting, unsolved issue in psychology, mathematics, and philosophy. The present study examined the possibility of human four-dimensional spatial representations using a spatial judgment task on hyper-volume, a novel property unique to higher dimensional space. Observers studied visual simulations of random wireframe hyper-tetrahedrons (4-simplexes) rotating around the y-z plane and judged their hyper-volume by adjusting the size of a 4-D block. Multiple regression analyses showed a significant correlation between the responses and the actual hyper-volume but not the definition-based, lower-dimensional cues such as the mean 3-D volume, providing empirical evidence of human 4-D spatial representations that can support judgments of certain novel, high-dimensional properties.     

Multiple Systems for Spatial Imagery: Transformations of Objects and Bodies

Problem-solving often requires imagining spatial changes. Object-based transformations allow imagining an object in a different orientation. Perspective transformations allow imagining changes in one's viewpoint. Three experiments tested the hypothesis that these two transformations are dissociable and specialized for different situations, by manipulating instructions and task parameters and measuring response times, errors, and introspective reports. Human experience with small objects such as telephones and clothes irons consists mostly of manipulation or observed manipulation, which is characterized by object-based transformations. Consistent with this experience, when participants made judgments about small manipulable objects, they showed a strong tendency to use object-based transformations. Experience with human bodies is more varied, including both object-like interactions and interactions in which one must estimate another's perspective. Accordingly, when making judgments about pictures of bodies, participants' selection of a spatial transformation depended on the type of judgment that needed to be made. When instructions violated these natural mappings, performance was impaired. These data argue for the view that multiple spatial transformation systems evolved to solve different spatial reasoning problems.     

Modelling Dynamic Spatial Systems in the Situation Calculus

Abstract

We propose and systematically formalise a dynamical spatial systems approach for the modelling of changing spatial environments. The formalisation adheres to the semantics of the situation calculus and includes a systematic account of key aspects that are necessary to realize a domain-independent qualitative spatial theory that may be utilised across diverse application domains. The spatial theory is primarily derivable from the all-pervasive generic notion of “qualitative spatial calculi” that are representative of differing aspects of space. In addition, the theory also includes aspects, both ontological and phenomenal in nature, that are considered inherent in dynamic spatial systems. Foundational to the formalisation is a causal theory that adheres to the representational and computational semantics of the situation calculus. This foundational theory provides the necessary (general) mechanism required to represent and reason about changing spatial environments and also includes an account of the key fundamental epistemological issues concerning the frame and the ramification problems that arise whilst modelling change within such domains. The main advantage of the proposed approach is that based on the structure and semantics of the proposed framework, fundamental reasoning tasks such as projection and explanation directly follow. Within the specialised spatial reasoning domain, these translate to spatial planning/re-configuration, causal explanation and spatial simulation. Our approach is based on the hypothesis that alternate formalisations of existing qualitative spatial calculi using high-level tools such as the situation calculus are essential for their utilisation in diverse application domains such as intelligent systems, cognitive robotics and event-based GIS.     

When gestures show us the way: Co-thought gestures selectively facilitate navigation and spatial memory

How does gesturing during route learning relate to subsequent spatial performance? We examined the relationship between gestures produced spontaneously while studying route directions and spatial representations of the navigated environment. Participants studied route directions, then navigated those routes from memory in a virtual environment, and finally had their memory of the environment assessed. We found that, for navigators with low spatial perspective-taking performance on the Spatial Orientation Test, more gesturing from a survey perspective predicted more accurate memory following navigation. Thus, co-thought gestures accompanying route learning relate to performance selectively, depending on the gesturers’ spatial ability and the perspective of their gestures. Survey gestures may help some individuals visualize an overall route that they can retain in memory.     

Approximate qualitative spatial reasoning

Qualitative relations between spatial regions play an importantrole in the representation and manipulation of spatial knowledge.The RCC5 and RCC8 systems of relations,used in the Region-Connection Calculus, are of fundamentalimportance. These two systems deal with ideal regions havingprecisely determined location. However,in many practical examples of spatial reasoning,regions are represented by finite approximations rather than known precisely.Approximations may be given by describing how a regionrelates to cells forming a partition of the space underconsideration. Although the RCC5 and RCC8 systems have beengeneralized to ``egg-yolk' regions, in order to modelcertain types of vagueness, their extension to regionsapproximated in this way has not been discussed before.This paper presents two methods, the syntactic and the semantic, by which the RCC5 and RCC8 systemsmay be defined for approximate regions. The syntactic uses algebraicoperations on approximate regions which generalize operations on preciseregions. The semantic method makes use of the set of preciseregions which could be the intended interpretation of anapproximate region. Relationships between these two methods arediscussed in detail.alternative to navigation training with a map.     

Spatial Metaphors of Web Use

When the web became popular, people had to develop ways to talk and think about it. In the mid-1990s, we analyzed spatial language in “web talk.” We found that people described pages as places, and search as motion, both passive and active motion. Here we investigate web talk nearly two decades later. Our analysis reveals that some spatial language has stayed the same, and some has changed. Of special interest is how far fewer motion verbs are used nowadays. We argue that people naturally produce spatial metaphors when talking about new technological domains, and that over time, the most useful elements persist.