Multiple Systems for Spatial Imagery: Transformations of Objects and Bodies

Problem-solving often requires imagining spatial changes. Object-based transformations allow imagining an object in a different orientation. Perspective transformations allow imagining changes in one's viewpoint. Three experiments tested the hypothesis that these two transformations are dissociable and specialized for different situations, by manipulating instructions and task parameters and measuring response times, errors, and introspective reports. Human experience with small objects such as telephones and clothes irons consists mostly of manipulation or observed manipulation, which is characterized by object-based transformations. Consistent with this experience, when participants made judgments about small manipulable objects, they showed a strong tendency to use object-based transformations. Experience with human bodies is more varied, including both object-like interactions and interactions in which one must estimate another's perspective. Accordingly, when making judgments about pictures of bodies, participants' selection of a spatial transformation depended on the type of judgment that needed to be made. When instructions violated these natural mappings, performance was impaired. These data argue for the view that multiple spatial transformation systems evolved to solve different spatial reasoning problems.     

Effects of long-duration space flight on target acquisition

The purpose of the study was to explore the effects of long-duration space flight on the acquisition of specific visual targets in the horizontal plane. Seven cosmonauts (4 high performance pilots and 3 non-pilots) who had flown between 186–198 days on Mir served as subjects. Baseline testing was performed 4 times prior to launch and 4 times following landing at different intervals totrack recovery. During testing the subjects were required to acquire targets that were randomly presented with both a head and eye movement using a time optimal strategy. Prior to flight two unique head movement strategies, related primarily to piloting experience, were used for target acquisition. Non-pilots employed a Type-I strategy consisting of high velocity head movements with large peak amplitudes, while high performance pilots used primarily low velocity, small amplitude head movements (Type-II) to acquire the targets (p<0.02). For both strategies peak head velocities increased as the angular distance to the target increased (p<0.01) resulting in greater discrimination between strategies for the 60° targets. While preflight eye velocity between strategies did not reach statistical significance, postflight testing revealed a decrease in eye velocity for Type-I compared with their preflight performance (p<0.02) for the 60° targets. Postflight, the Type-I group showed a decrease in head velocity (p<0.20) while the Type-II group compensated by increasing head velocity (p<0.02). Variability for both of the head and eye parameters tended to increase postflight for both types of strategies.     

Egocentric frames of reference used for the retrieval of survey knowledge learned by map and navigation

Two experiments are reported that use a ``point-to-unseen-targets' task to study the role of egocentric reference frames in the retrieval of survey knowledge learned from either studying a map or navigating an environment. In Experiment 1, performance was generally consistent with the hypothesis that map knowledge is retrieved using a frame of reference centered on the eye, characterized by (a) a fixed orientation in a ``frontal representational plane' and (b) equal access to spatial relations both in front of, or above, and behind, or below, a right-left retrieval axis. The results of Experiment 2 were consistent with the hypothesis that environment knowledge is retrieved within a frame of reference centered on the body, characterized by (a) flexible orientation within a ``transverse representational plane' and (b) privileged access to spatial relations located in front of the right-left retrieval axis in representational space. Both types of knowledge function as if they preserve information about the Euclidean angles connecting elements in physical space.     

Wayfinding Performance in and the Spatial Knowledge of a Color-coded Building for Adults and Children

The study reported here investigates the effect color has on the performance in a wayfinding task,the wayfinding strategies used and the acquisition of survey knowledge of a total of sixty participants: twenty second graders,sixth graders, and adults each. All participants had to find their way to a goal in a virtual environment with either a colored or a gray ground. After that,they had to find the shortest way from the start position to the goal in two consecutive trials,to draw a sketch map of the maze,and to mark the position of the goal figure in an overview of the maze. The results showed that color helped all participants to improve their performance in the wayfinding task, influenced the use of some wayfinding strategies but did not improve the acquisition of survey knowledge. Furthermore, there was a developmental achievement from second graders to adults. The results implicate firstly that children and adults similarly rely on the structuring of space through color when navigating through an unfamiliar large-scale environment,and secondly that there is a dissociation between wayfinding behavior and spatial knowledge.     

List of reviewers

Studies of map-learning have suggested that viewing maps from several orientations results in orientation independent encoding. The present investigation examined this claim. Three groups of participants were presented with a map from one orientation, or four orientations, or with the map constantly rotating. Participants' spatial knowledge was then assessed in a pointing task. Response latencies were fastest following presentations of the map from a single orientation. Contrary to earlier results, multiple views led to orientation dependent encoding when account was taken of participants'preferred map orientations. The findings are consistent with the notion that similar mental representations are acquired following single and multiple map views.     

Learning to Reach to Locations Encoded from Imaging Displays

We examined the use of hand gestures while people solved spatial reasoning problem in which they had to infer motion from static diagrams (mental animation problems). In Experiment 1, participants were asked to think aloud while solving mental animation problems. They gestured on more than 90% of problems, and most gestures expressed information about the component motions that was not stated in words. Two further experiments examined whether the gestures functioned in the mechanical inference process, or whether they merely served functions of expressing or communicating the results of this process. In these experiments, we examined the effects of instructions to think aloud, restricting participants' hand motions, and secondary tasks on mental animation performance. Although participants who were instructed to think aloud gestured more than control groups, some gestures occurred even in control conditions. A concurrent spatial tapping task impaired performance on mechanical reasoning, whereas a simple tapping task and restricting hand motions did not. These results indicate that gestures are a natural way of expressing the results of mental animation processes and suggest that spatial working memory and premotor representations are involved in mental animation. They provide no direct evidence that gestures are functional in the thought process itself, but do not rule out a role for overt gestures in this type of spatial thinking.     

Mental Object Rotation and Egocentric Body Transformation: Two Dissociable Processes?

An important question in studies on mental rotation is whether the mental object rotation and the egocentric body transformation rely on dissociable mechanisms. We tested non-dancers and professional dancers as experts in the mental object rotation task (MORT, 3D-cubes used by Shepard & Metzler, 1971) and the mental body transformation task (MBRT, line drawings of human bodies similar to those used by Parsons, 1987). The cubes and body figures were presented in exactly the same rotation conditions; in the picture plane, 0 degree, 45 degrees, 90 degrees, 135 degrees, and 180 degrees, and in combination with a rotation in depth, 0 degree (the stimuli are rotated in the picture plane only) and 180 degrees. We could replicate the linear increase in RT with increasing angle for the cubes whereas the RT for rotated body figures increased for not depth-rotated bodies only (back view). Though, the RTs for inverted body figures were faster when they were rotated in depth (front view) compared to when they were rotated in the picture plane only (back view). This finding suggests that participants use different strategies depending on the perceived orientation of the stimulus. The results indicate impaired performance in the MORT for the experts.     

Which way is the bookstore? A closer look at the judgments of relative directions task

We present a detailed analysis of a widely used assay in human spatial cognition, the judgments of relative direction (JRD) task. We conducted three experiments involving virtual navigation interspersed with the JRD task, and included confidence judgments and map drawing as additional metrics. We also present a technique for assessing the similarity of the cognitive representations underlying performance on the JRD and map-drawing tasks. Our results support the construct validity of the JRD task and its connection to allocentric representation. Additionally, we found that chance performance on the JRD task depends on the distribution of the angles of participants’ responses, rather than being constant and 90 degrees. Accordingly, we present a method for better determining chance performance.     

Seeing the Forest or the Trees? Shifting Categorical Effects in Map Memory

People use spatial and nonspatial information to structure memory for an environment. Two experiments explored interactions between spatial and social categories on map memory when mediated by retrieval (Experiment 1) and encoding (Experiment 2) demands. Participants studied a map depicting business locations (including proprietors' race). In Experiment 1, participants completed two memory tasks, one globally focused and the other locally focused. The global task compressed, while the local task expanded, within-category similarity. Furthermore, processing styles carried over to the subsequent task. Experiment 2 emphasized either the spatial or social category during encoding, which increased that category's weighting in memory. These results extend the work of Maddox, Rapp, Brion, and Taylor, suggesting that retrieval and encoding demands can shift how these categories affect spatial memory.     

空间环境中的多处理器混合容错调度算法

为提高空间应用环境中混合实时任务的容错调度效率,提出基于空间环境的多处理器混合容错调度算法。算法在周期任务调度中采用基于分组的“最佳适应”分配策略,以少量增加的计算时间获得更为紧凑的任务调度结果,从而减少调度所需的处理器数目和任务执行时间;在非周期任务调度中,利用基于空闲时间片的方法完成动态调度,使得混合实时任务的容错调度效率有显著提高,能够更好地适应复杂空间环境的任务处理。仿真结果表明算法在改善混合实时任务容错调度性能上具有重要作用。     

Three dimensional spatial memory and learning in real and virtual environments

Human orientation and spatial cognition partlydepends on our ability to remember sets ofvisual landmarks and imagine their relationshipto us from a different viewpoint. We normallymake large body rotations only about a singleaxis which is aligned with gravity. However,astronauts who try to recognize environmentsrotated in 3 dimensions report that theirterrestrial ability to imagine the relativeorientation of remembered landmarks does noteasily generalize. The ability of humansubjects to learn to mentally rotate a simplearray of six objects around them was studied in1-G laboratory experiments. Subjects weretested in a cubic chamber (n = 73) and aequivalent virtual environment (n = 24),analogous to the interior of a space stationnode module. A picture of an object waspresented at the center of each wall. Subjectshad to memorize the spatial relationships amongthe six objects and learn to predict thedirection to a specific object if their bodywere in a specified 3D orientation. Percentcorrect learning curves and response times weremeasured. Most subjects achieved high accuracyfrom a given viewpoint within 20 trials,regardless of roll orientation, and learned asecond view direction with equal or greaterease. Performance of the subject group thatused a head mounted display/head tracker wasqualitatively similar to that of the secondgroup tested in a physical node simulator. Body position with respect to gravity had asignificant but minor effect on performance ofeach group, suggesting that results may alsoapply to weightless situations. A correlationwas found between task performance measures andconventional paper-and-pencil tests of fieldindependence and 2&3 dimensional figurerotation ability.     

Sources of Interference in Spatial Long-Term Memory Retrieval

Three experiments are reported that used an interference paradigm to test the extent to which perceptual orientation to a task environment interfered with retrieval from long-term spatial memory. Visual and spatial sources of interference were tested. The findings were consistent with a spatial locus of interference and showed that orientation to the task environment disrupted the accessibility of relative direction under two retrieval conditions: when the imagined viewpoint was 180 degrees misaligned with the actual viewpoint and when the actual body location was anterior to the imagined body location. While the former finding replicates previous reports of interference in perspective-taking tasks, the latter finding is new and difficult for current models of spatial long-term memory retrieval to explain. More research is needed to articulate further the constraints that perceptual orientation to the task environment place on spatial retrieval and their implications for models of spatial memory.     

Internal reference frames for representation and storage of visual information: the role of gravity.

Experimental studies of visual mechanisms suggests that the CNS represents image information with respect to preferred horizontal and vertical axes, as shown by a phenomenon known as the "oblique effect". In the current study we used this effect to evaluate the influence of gravity on the representation and storage of visual orientation information. Subjects performed a psychophysical task in which a visually-presented stimulus line was aligned with the remembered orientation of a reference stimulus line presented moments before. The experiments were made on 5 cosmonauts during orbital space flight and additionally on 13 subjects in conditions of normal gravity with a tilting chair. Data were analyzed with respect to response variability and timing. On earth, these measurements for this task show a distinct preference for horizontally and vertically oriented stimuli when the body and gravitational axes were aligned. This preference was markedly decreased or disappeared when the body axis was tilted with respect to gravity; this effect was not connected with ocular counter-rolling nor could we find a preference of any other intermediate axis between the gravity and body aligned axes. On the other hand, the preference for vertical and horizontal axes was maintained for tests performed in microgravity over the course of a 6 month flight, starting from flight day 6. We concluded that subjects normally process visual orientation information in a multi-modal reference frame that combines both proprioceptive and gravitational cues when both are available, but that a proprioceptive reference frame is sufficient for this task in the absence of gravity after a short period of adaptation. Some of the results from this study have been previously published in a preliminary report. Grant numbers: 99-04-48450.     

Heading south with a north-up map: A choice processing analysis of map alignment effects

This study employed an information accumulation model of choice reaction times to investigate alignment effects in mental representations of maps. University students studied a map from a single orientation (with north at the top). In a subsequent two-choice reaction time task, the students’ spatial knowledge of the map was assessed employing spatial left/right judgments, which were made from imagined perspectives that were either north-aligned or south-aligned. Data showed a standard alignment effect, favoring north- over south-aligned trials. To examine the locus of this effect, data were fit using the Linear Ballistic Accumulator (LBA) model of speeded decisions (Brown & Heathcote, 2008). Of interest were three model parameters: drift rate, the speed at which evidence accumulates toward a response; response threshold, the amount of evidence demanded from the decision maker before selecting a response; and non-decision time, the time consumed by pre- and postdecisional processes. The best-fitting model suggested that non-decision time accounted for the alignment effect. The difference in non-decision time between north and south-aligned judgments suggests a mental alignment stage on south-aligned trials, accounting for the longer reaction times for judgements misaligned with the presented north orientation of the map.     

Individual Differences in Representational Precision Predict Spatial Working Memory Span

Perhaps the signature feature of working memory is that it is limited. In the same subjects, we used two different retrieval tasks to independently measure two different limits of spatial memory. Precision was measured by asking participants to localize a missing target item among a field of other targets and distracters. Capacity was measured with a similar task where participants identified, rather than localized, a set of remembered targets from within a larger set of identical items. Across participants, the precision of localization was positively correlated with the number of successfully retrieved items. These data suggest that an individual's representational capacity may ultimately be constrained by their ability to form precise representations of space.     

Spatial orientation during locomotion [correction of locomation] following space flight

To investigate changes in spatial orientation ability and walking performance following space flight, 7 astronaut subjects were asked pre- and post-flight to perform a goal directed locomotion paradigm which consisted of walking a triangular path with and without vision. This new paradigm, involving inputs from different sensory systems, allows quantification of several critical parameters, like orientation performance, walking velocities and postural stability, in a natural walking task. The paper presented here mainly focusses on spatial orientation performance quantified by the errors in walking the previously seen path without vision. Errors in length and reaching the corners did not change significantly from pre- to post-flight, while absolute angular errors slightly increased post-flight. The significant decrease in walking velocity and a change in head-trunk coordination while walking around the corners of the path observed post-flight may suggest that during re-adaptation to gravity the mechanisms which are necessary to perform the task have to be re-accomplished.     

Initial moments of adaptation to microgravity of human orientation behavior, in parabolic flight conditions

The first ethological studies of astronauts' adaptation to microgravity dealt with the behavioral strategies observed during short-term space missions. No attempts had however been made to consider the initial moments of adaptation dynamics, when the subject is first submitted to conditions allowing body orientations in the full three dimensions of space. The present experimental approach was both longitudinal and transversal. It consisted of analysing, during a goal-directed orientation task in parabolic flight, the orientation behavior of 12 subjects with a past experience of 0, 30 or more than 300 parabolas. During each microgravity phase, the subjects were asked to orientate their bodies and touch, with the dominant hand, four coloured targets arranged inside the aircraft.

Results showed that for inexperienced subjects, the time between two target contacts was longer than experienced subjects. They often failed to reach all targets in the series during the first parabolas. They showed right-left confusion and a preference for the “up-down” vertical body orientation. Their performance, described by the efficiency of orientation in all three dimensions, improved over time and according to the level of experience. The results are discussed for the spontaneous, preliminary and integrative stages of adaptation, emphasizing new relationships between the body references and those of the surroundings. Such experiences lead the subject to develop a new mental representation of space.     

Effects of Communication Methods on Communication Patterns and Performance in a Remote Spatial Orientation Task

Abstract

An experiment was conducted to examine the impact of communication methods (text-only, audio-only, and audio-plus-video) on communication patterns and effectiveness in a 2-person remote spatial orientation task. The task required a pair of participants to figure out the cardinal direction of a target object by communicating spatial information and perspectives. Results showed that overall effectiveness in the audio-only condition was better than the text-only and audio-plus-video conditions, and communication patterns were more predictive of errors than individual differences in spatial abilities. Discourse analysis showed that participants in the audio-plus-video condition performed less mental transformation of spatial information when communicating, which led to more interpretation errors by the listener. Participants in the text-only conditions performed less confirmation and made more errors by misreading their own display. Results suggested that speakers in the audio-plus-video condition minimized effort by communicating spatial information based on their own perspective but speakers in the audio-only and text-only conditions would more likely communicate transformed spatial information. Analysis of gestures in the audio-plus-video condition confirmed that iconic gestures tended to co-occur with spatial transformation. Iconic gesture rates were negatively correlated with transformation errors, indicating that iconic gestures more likely co-occurred with successful communication of spatial transformation. Results show that when visual interactive feedback is available, speakers tend to adopt egocentric spatial perspectives to minimize effort in mental transformation and rely on the feedback to ensure that the hearer correctly interprets the information. When visual interactive feedback is not available, speakers will put more effort in transforming spatial information to help the hearer to understand the information. The current result demonstrated that allowing two persons to see and communicate with each other during a remote spatial reasoning task can lead to more errors because of the use of a suboptimal communication strategy.     

Revisiting Perspective-Taking: Can People Maintain Imagined Perspectives?

Abstract

Three experiments were conducted to examine whether people can adopt and maintain imagined perspectives in the absence of target information. The task used entailed providing information about an imagined perspective in advance of target information to examine whether this would facilitate perspective-taking performance and reduce or eliminate alignment effects that are commonly reported in the literature. The three experiments employed different types of spatial environments: an environment learned from navigating a computer screen (Experiment 1), and an immersive environment that was either remote (Experiment 2) or immediate (Experiment 3) at the time of retrieval. Across the three experiments, results showed that information about an imagined perspective can be utilized ahead of target information. Furthermore, they suggested that alignment effects can be reduced as a result of processing information about perspective ahead of target information, but only when reasoning about specific nonimmediate spatial relations (Experiments 1 and 2). Results are discussed in connection with previous findings on spatial updating and the organizational structure of spatial memory.