Visual-haptic integration with pliers and tongs: signal “weights” take account of changes in haptic sensitivity caused by different tools

Takahashi, C. and Watt, S.J. (2016) Visual-haptic integration with pliers and tongs: signal “weights” take account of changes in haptic sensitivity caused by different tools. Frontiers in Psychology. DOI: 10.3389/fpsyg.2014.00109

36087.pdf - Published Version
Available under License Creative Commons Attribution.

Download (1MB) | Preview


When we hold an object while looking at it, estimates from visual and haptic cues to size are combined in a statistically optimal fashion, whereby the �weight� given to each signal reflects their relative reliabilities. This allows object properties to be estimated more precisely than would otherwise be possible. Tools such as pliers and tongs systematically perturb the mapping between object size and the hand opening. This could complicate visual-haptic integration because it may alter the reliability of the haptic signal, thereby disrupting the determination of appropriate signal weights. To investigate this we first measured the reliability of haptic size estimates made with virtual pliers-like tools (created using a stereoscopic display and force-feedback robots) with different �gains� between hand opening and object size. Haptic reliability in tool use was straightforwardly determined by a combination of sensitivity to changes in hand opening and the effects of tool geometry. The precise pattern of sensitivity to hand opening, which violated Weber's law, meant that haptic reliability changed with tool gain. We then examined whether the visuo-motor system accounts for these reliability changes. We measured the weight given to visual and haptic stimuli when both were available, again with different tool gains, by measuring the perceived size of stimuli in which visual and haptic sizes were varied independently. The weight given to each sensory cue changed with tool gain in a manner that closely resembled the predictions of optimal sensory integration. The results are consistent with the idea that different tool geometries are modeled by the brain, allowing it to calculate not only the distal properties of objects felt with tools, but also the certainty with which those properties are known. These findings highlight the flexibility of human sensory integration and tool-use, and potentially provide an approach for optimizing the design of visual-haptic devices.

Item Type: Article
Subjects: Research Publications
Departments: College of Health and Behavioural Sciences > School of Psychology
Date Deposited: 15 Mar 2016 04:31
Last Modified: 15 Mar 2016 16:28
ISSN: 1664-1078
Publisher's Statement: This Document is Protected by copyright and was first published by Frontiers. All rights reserved. It is reproduced with permission
URI: http://e.bangor.ac.uk/id/eprint/6342
Identification Number: DOI: 10.3389/fpsyg.2014.00109
Publisher: Frontiers
Administer Item Administer Item

eBangor is powered by EPrints 3 which is developed by the School of Electronics and Computer Science at the University of Southampton. More information and software credits.