Why do speakers mix perspectives?

Although considerations of discourse coherence and cognitive processing suggest that communicators should adopt consistent perspectives when describing spatial scenes, in many cases they switch perspectives. Ongoing research examining cognitive costs indicates that these are small and exacted in establishing a mental model of a scene but not in retrieving information from a well-known scene. A perspective entails a point of view, a referent object, and terms of reference. These may change within a perspective, exacting cognitive costs, so that the costs of switching perspective may not be greater than the costs of maintaining the same perspective. Another project investigating perspective choice for self and other demonstrates effects of salience of referent object and ease of terms of reference. Perspective is mixed not just in verbal communications but also in pictorial ones, suggesting that at times, switching perspective is more effective than maintaining a consistent one.     

Gesture in Spatial Cognition: Expressing,Communicating, and Thinking About Spatial Information

Do hand gestures play a role in spatial cognition? This paper reviews literature addressing the roles of gestures in (1) expressing spatial information, (2) communicating about spatial information, and (3) thinking about spatial information. Speakers tend to produce gestures when they produce linguistic units that contain spatial information, and they gesture more when talking about spatial topics than when talking about abstract or verbal ones. Thus, gestures are commonly used to express spatial information. Speakers use gestures more in situations when those gestures could contribute to communication, suggesting that they intend those gestures to communicate. Further, gestures influence addressees' comprehension of the speech they accompany, and addressees also detect information that is conveyed uniquely in gestures. Thus, gestures contribute to effective communication of spatial information. Gestures also play multiple roles in thinking about spatial information. There is evidence that gestures activate lexical and spatial representations, promote a focus on spatial information, and facilitate the packaging of spatial information in speech. Finally, some of the observed variation across tasks in gesture production is associated with task differences in demands on spatial cognitive processes, and individual differences in gesture production are associated with individual differences in spatial and verbal abilities. In sum, gestures appear to play multiple roles in spatial cognition. Central challenges for future research include: (1) better specification of the mental representations that give rise to gestures, (2) deeper understanding of the mechanisms by which gestures play a role in spatial thinking, and (3) greater knowledge of the sources of task and individual differences in gesture production.     

Spatial Memory Organized by Environmental Geometry

We investigated the simultaneous effects of different reference systems on spatial memory. Participants studied a configuration of objects surrounding them. During retrieval, they imagined themselves in the center of the object configuration facing a particular object, and then indicated the directions of other objects relative to this imagined heading. Besides strong effects of egocentric retrieval direction, retrieval was enhanced for objects and headings aligned with an object-centered reference system (triangular object configuration within a neutrally-shaped room), or with a sufficiently salient environmental reference system (triangular room surrounding a neutrally-shaped object configuration). Moreover, remembered object positions were spatially distorted by the object-centered reference system. Results suggest that object positions are accessed by imagining oneself within a topographical representation of objects which is preorganized in terms of both environmental and object-centered reference systems.     

The Effect of an Extra Object on the Linguistic Apprehension of the Spatial Relationship between Two Objects

A sentence describing a spatial relationship includes at least two objects: a located object and a reference object. The presence of an extra object in a scene that is recognized as neither a located nor a reference object, reduces the acceptability of spatial terms related to the spatial relationship between reference and located objects under given conditions (Carlson & Logan, 2001). However, it is still unclear how the overall acceptability distribution of a spatial term changes in a scene when an extra object is present in various locations. In this study, we examined this point, using the paired comparison method with Thurstone's law of judgment (Case V). The results showed that an extra object had both relative increase and reduction effects on the overall acceptability distribution of a spatial term. This suggests that our linguistic apprehension of the spatial relationship is biased intricately by the presence of extra objects.     

Exploring Regional Variation in Spatial Language Using Spatially Stratified Web-Sampled Route Direction Documents

Spatial language, such as route directions, can be analyzed to shed light on how humans communicate and conceptualize spatial knowledge. This article details a computational linguistic approach using route directions to study regional variations in spatial language. We developed a web-sourcing approach to collect human-generated route direction documents on a geographical scale. Specifically, we built the Spatially strAtified Route Direction (SARD) Corpus through automated scraping, classifying, and georeferencing of route directions. Based on semantic categories of cardinal and relative direction terms, the analysis of the SARD Corpus reveals significant differences and patterns on both national (United States, United Kingdom, and Australia) and regional (contiguous U.S. states) levels. Combining computational linguistics and georeferencing approaches offers the potential for extending classic spatial linguistic studies.     

Learning relative directions between landmarks in a desktop virtual environment

This study presents two experiments that examine howindividuals learn relative directions betweenlandmarks in a desktop virtual environment. Subjectswere presented snapshot images of different virtualenvironments containing distinguishing landmarks anda road network. Following the presentation of eachvirtual environment, subjects were given a relativedirection test. The relative direction test involvedindicating the direction of hidden landmarks fromdifferent vantage points in the environment. Half ofthese vantage points were presented during thelearning phase, while the other half were novel.Results showed that subjects learned relativedirections between landmarks equally well when sceneswere presented in either a sequential or random order.Furthermore, viewing a configuration of landmarks ina desktop virtual environment from multipleperspectives produced a viewpoint dependentrepresentation in memory. Subjects had significantlygreater response times for new viewing perspectives,as compared to previously viewed scenes. Thisviewpoint dependent representation of the environmentpersisted despite learning under conditions ofspatio-temporal discontinuity and changes to anenvironmental frame of reference.     

Implicit spatial reference systems using proximity and aligment knowledge

In this paper, we explore the situation where no cardinal directions or globally available orientations are available and no metric estimates are given. This corresponds to the way many people perceive their environment and carry out spatial reasoning tasks. We consider three kinds of locally available information – proximity (nearest neighbor), relevance (different sets of neighbors) and distribution (alignments) – and we limit our interest to a universe of point objects. We show how the theory of manifolds and sheaves can be applied to the problem of combining locally available information of a qualitative nature into a global model of an environmental space. We then explore the limitations of the resulting global model if information capture is incomplete or uncertain. Finally, we note that some indeterminacy in the global model does not entail difficulties for a user, provided the reasoning task is appropriately constrained or appropriate additional information is used, such as an external reference.     

Landmarks on the move: Producing and understanding references to moving landmarks

There is a general agreement that landmarks in route directions should be perceptually salient and stable objects. Yet, other attributes, such as (animated) motion, can also attract visual attention and make entities salient. In the present study, we investigate if and when speakers refer to moving entities in route directions and how listeners evaluate such instructions. We asked speakers to watch short videos of different crossroads with and without moving landmarks and give directions to listeners, who in turn had to choose a street on which to continue (Experiment 1) or choose the instruction they most preferred among three route directions (Experiment 2). Results reveal that speakers mentioned moving entities, especially when the trajectory was informative for the place where a turn should be taken (Experiment 1). Listeners had no problem understanding instructions with moving landmarks (Experiment 1). Yet, participants chose instructions with stable landmarks more often (Experiment 2). These results are discussed in relation to automatic route directions generation.     

Selection of Salient Features for Route Directions

People navigating in unfamiliar environments rely on wayfinding directions, either given by people familiar with the place, or given by maps or wayfinding services. The essential role of landmarks in human route communication is well-known. However, mapping the human ability to select landmarks ad hoc for route directions to a computational model was never tried before. Wayfinding services manage the problem by using predefined points of interest. These points are not automatically identified, and they are not related to any route. In contrast, here a computational model is presented that selects salient features along a route where needed, e.g., at decision points. We propose measures to formally specify the salience of a feature. The observed values of these measures are subject to stochastical tests in order to identify the most salient features from datasets. The proposed model is implemented and checked for computability with a use case from the city of Vienna. It is also crosschecked with a human subject survey for landmarks along a given route. The survey provides evidence that the proposed model selects features that are strongly correlated to human concepts of landmarks. Hence, integrating the selected salient features in wayfinding directions will produce directions with lower cognitive workload and higher success rates, compared to directions based only on geometry, or on geometry and static points of interest.     

Monitoring Object Orientation: Effects of Layout Complexity,Viewpoint Changes,and Object Function

Spatial short-term memory for single target positions is subject to distortions which depend on the spatial layout of visual landmarks. Here, participants had to reproduce the positions of briefly presented targets in the context of three-landmark configurations presented in various orientations. Symmetry properties of distortional patterns were determined by the intrinsic reference system of the landmark configuration as well as by the environment-or body-centered vertical axis. Symmetry was best about the cardinal axes of the landmark system irrespective of their orientation, but symmetry of non-cardinal axes was enhanced when these axes were aligned with the extrinsic vertical. Results are inconsistent with most current models of spatial memory distortions but in line with models explaining distortions in terms of attentional processes in topographical neuronal networks.     

Selecting a reference frame

Reference frames are representations that parse space. In the case of spatial terms, reference frames mediate the mapping of linguistic expressions onto spatial configurations of objects. In the sentence ``The fly is above the cat,' ``above' is defined with respect to a reference frame that is imposed on the cat. Different types of reference frames can be used to define spatial terms, each based on a different source of information. For example, gravity, the orientation of objects in the scene or the orientation of the viewer can all be used to set the orientation of a reference frame. When these reference frames disagree (because the viewer is reclining or because the objects in the scene are overturned), there are competing definitions for the spatial term, resulting in the need for reference frame selection. The purpose of this paper is to review a line of research that examines reference frame selection in the context of spatial language. This work shows that all reference frames are initially active and assign a direction to a spatial term. Moreover, this activation is automatic, and is followed by the selection of a single reference frame, with selection accompanied by inhibition of the non-selected frames. Parallels between reference frame selection in language and in perception and attention are discussed.     

Three dimensional spatial memory and learning in real and virtual environments

Human orientation and spatial cognition partlydepends on our ability to remember sets ofvisual landmarks and imagine their relationshipto us from a different viewpoint. We normallymake large body rotations only about a singleaxis which is aligned with gravity. However,astronauts who try to recognize environmentsrotated in 3 dimensions report that theirterrestrial ability to imagine the relativeorientation of remembered landmarks does noteasily generalize. The ability of humansubjects to learn to mentally rotate a simplearray of six objects around them was studied in1-G laboratory experiments. Subjects weretested in a cubic chamber (n = 73) and aequivalent virtual environment (n = 24),analogous to the interior of a space stationnode module. A picture of an object waspresented at the center of each wall. Subjectshad to memorize the spatial relationships amongthe six objects and learn to predict thedirection to a specific object if their bodywere in a specified 3D orientation. Percentcorrect learning curves and response times weremeasured. Most subjects achieved high accuracyfrom a given viewpoint within 20 trials,regardless of roll orientation, and learned asecond view direction with equal or greaterease. Performance of the subject group thatused a head mounted display/head tracker wasqualitatively similar to that of the secondgroup tested in a physical node simulator. Body position with respect to gravity had asignificant but minor effect on performance ofeach group, suggesting that results may alsoapply to weightless situations. A correlationwas found between task performance measures andconventional paper-and-pencil tests of fieldindependence and 2&3 dimensional figurerotation ability.     

Effects of Communication Methods on Communication Patterns and Performance in a Remote Spatial Orientation Task

Abstract

An experiment was conducted to examine the impact of communication methods (text-only, audio-only, and audio-plus-video) on communication patterns and effectiveness in a 2-person remote spatial orientation task. The task required a pair of participants to figure out the cardinal direction of a target object by communicating spatial information and perspectives. Results showed that overall effectiveness in the audio-only condition was better than the text-only and audio-plus-video conditions, and communication patterns were more predictive of errors than individual differences in spatial abilities. Discourse analysis showed that participants in the audio-plus-video condition performed less mental transformation of spatial information when communicating, which led to more interpretation errors by the listener. Participants in the text-only conditions performed less confirmation and made more errors by misreading their own display. Results suggested that speakers in the audio-plus-video condition minimized effort by communicating spatial information based on their own perspective but speakers in the audio-only and text-only conditions would more likely communicate transformed spatial information. Analysis of gestures in the audio-plus-video condition confirmed that iconic gestures tended to co-occur with spatial transformation. Iconic gesture rates were negatively correlated with transformation errors, indicating that iconic gestures more likely co-occurred with successful communication of spatial transformation. Results show that when visual interactive feedback is available, speakers tend to adopt egocentric spatial perspectives to minimize effort in mental transformation and rely on the feedback to ensure that the hearer correctly interprets the information. When visual interactive feedback is not available, speakers will put more effort in transforming spatial information to help the hearer to understand the information. The current result demonstrated that allowing two persons to see and communicate with each other during a remote spatial reasoning task can lead to more errors because of the use of a suboptimal communication strategy.     

Prioritized Spatial Updating in the Intrinsic Frame of Reference

In order to maintain valid situation awareness, people need to update the spatial representations of their surroundings as objects, including themselves, move. The present study investigates the properties of spatial updating in the intrinsic frame of reference, where spatial relations are represented with respect to an external object (other than the viewer self) with an intrinsic reference direction. Three experiments were conducted using a task of direction pointing. It was found that given a relatively stable intrinsic reference direction, responses to a small number of salient objects were faster than responses to non-salient objects (Experiment 1 and Experiment 3). The salience effect disappeared when the intrinsic reference direction was no longer stable (Experiment 2). Furthermore, all three experiments revealed a type of orientation dependence similar to that found in egocentric spatial updating. Our results indicate that spatial updating in the intrinsic reference system can be easy only if a fixed reference direction is maintained and the number of objects that need to be tracked is limited.     

Is Memory for Routes Enhanced by an Environment's Richness in Visual Landmarks?

We tested the hypothesis that a route's memorability is dependent on the frequency with which people are exposed to visual landmarks. Undergraduates learned either a route through an urban area lacking visually salient features, or a route in a neighborhood with many shops and urban objects. They were then asked to recall the learned route in the form of route directions and sketch maps. The results showed higher recall performance for the richer environment. When presented with photographs depicting scenes along the route, participants exposed to the richer environment had higher recognition scores and shorter response times than the others. The data confirm the functional role of landmarks in route memory and wayfinding.     

Is Route Learning More Than Serial Learning?

Abstract

The nature of route learning in terms of the memorizing of landmarks was investigated. In Experiment 1, participants memorized landmarks while being guided through a computer-simulated hallway (dynamic, with spatial context), or while viewing the landmarks one by one in front of a black background (static, without context). Two more conditions completed the 2 × 2 design. One condition preserved the dynamic landmark viewing properties (observers approached each object, passed it, turned to the next object, and so on), but the background was black (dynamic, without context). In the other condition the observer saw a stationary display of each object within a hallway, but did not approach the object (static, with context). Serial recall was much better after viewing the landmarks in the dynamic presentation format with spatial context than in the other conditions. Experiment 2 showed that the superior performance in the dynamic condition with context was abolished when all hallway segments were equally long. This implies that metric information is a component of route knowledge at a very early stage, which is incompatible with the dominant framework, but is compatible with the alternative framework for spatial microgenesis.