[IEEE 2011 IEEE World Haptics Conference (WHC 2011) - Istanbul (2011.06.21-2011.06.24)] 2011 IEEE World Haptics Conference - Tactile sensing utilizing human tactile perception

  • View

  • Download

Embed Size (px)


  • Tactile Sensing Utilizing Human Tactile Perception

    Yoshihiro Tanaka Yoshihiro Horita Akihito Sano Hideo Fujimoto

    Graduate School of Engineering, Nagoya Institute of Technology


    Human tactile perception incorporates two important characteris-tics self-reference and bidirectionality. Self-reference is an im-portant factor when evaluating tactile sensations. Bidirectionalitycontributes to sensing capability enhancement. In this paper, a tac-tile sensor including self-reference and bidirectionality is presented.The sensor with two microphones is mounted on a human finger.Users can apply the sensor while retaining their normal tactile per-ceptions and simultaneously obtaining sound and skin deformationdata based on the mechanical interaction between the finger and theobject. Experimental results on roughness evaluations and convex-ity detections show the validity of the proposed sensing method andits potential for use in various applications.

    Keywords: Tactile sensor, self-reference, bidirectionality, humantactile perception

    Index Terms: H.1.2 [Models and Principles]: User/MachineSystemsHuman Factors; H.5.2 [Information Interfaces and Pre-sentation]: User InterfacesHaptic I/O


    Works by human hands are still necessary in a number of manufac-turing processes developed in todays digital era, and tactile percep-tions continue to play an important role in such work. For example,high quality surfaces have been, and continue to be, demanded fora variety of products, and such surfaces must be inspected to de-tect small surface irregularities and/or to evaluate roughness. Inthe past, this inspection process has most often been performed byexperienced craft workers using their well-trained sense of touch.However, such manual inspection tasks require high skill levels andlong years of experience. They also depend on the subjective judg-ment of the evaluators. Accordingly, an ongoing need exists forefficient and objective inspection technologies that could supple-ment or replace subject judgments. Currently, laser displacementsensors, dial gages, and image processing technologies are gener-ally used for surface profiles measurements. However, it is difficultto introduce such tools to many types of inspection work becausethey are generally inefficient and insufficiently robust. Laser dis-placement sensors and dial gages are unsuitable for scanning wideareas in a short period of time and require time to set up and oper-ate, while image processing is sensitive to surface conditions. Fur-thermore, the objects to be inspected are often small and/or havecurvatures, and there are few generally available devices that aresuitable for evaluating such curved surfaces.

    Recently, however, numerous tactile sensors have been devel-oped [1]. For example, a force sensor developed by Saga et al. [2]can measure force applied over a large area with high spatial res-olution and high sensitivity. A slip detection sensor created by

    e-mail: tanaka.yoshihiro@nitech.ac.jpciq17604@stn.nitech.ac.jpsano@nitech.ac.jpfujimoto.hideo@nitech.ac.jp

    Teshigawara et al. [3] can be mounted on a robot hand and helpthe robot to grasp an object efficiently. These tactile sensors fo-cus on detecting tactile stimuli applied to the robot or other device.Alternatively, tactile sensors that can be used for evaluating objectproperties have also been developed. Tanaka et al. [4] developeda polyvinylidene fluoride (PVDF) sensor capable of measuring thetactile sensations of fabrics. The sensor is mounted on a robot fin-ger and sensing is performed by scanning the robot hand across theobject. Zbyszewski et al. [5] developed a tactile sensor for medicalapplications that utilizes an air cushion and is capable of measuringthe stiffness of body tissues. This paper focuses primarily on tactilesensing used for evaluation.

    To measure properties such as roughness, tactile sensors gen-erally require limiting usage conditions for accurate sensing. How-ever, objects often incorporate a variety of factors such as curved ar-eas, small parts, and soft surfaces, which makes it difficult to allowtactile sensors to perform their designed functions. Hand-held orfinger-mounted tactile sensors [6][7] can be more easily applied tovarious objects since they are moved by a human being. However,it is difficult to ensure sufficient stability for accurate sensing andthe sensitivity levels decrease if they are not manipulated correctly.Numerous efforts aimed at developing tactile sensors have encoun-tered similar problems between application limitations (strict usageconditions) and ensuring proper sensitivity levels.

    Next, let us consider tactile displays (e.g. [8]) and tactile enhanc-ing devices (e.g. [9]). Sensors of this type generally do not have theabove-mentioned problems. They do not meet strict usage condi-tions. Users can easily perceive the tactile sensations developers an-ticipate (realistic reproduction is another matter). Accordingly, tac-tile displays and tactile enhancing devices appear to have propertiesthat many tactile sensors lack. We next took note of an importantcharacteristic of human tactile perception, which is active sensing.Human active sensing includes the characteristics of self-referenceand bidirectionality, and it is expected that a tactile sensor that iscapable of including human active sensing characteristics could beapplied with high sensitivity under relaxed conditions.

    The purpose of this paper is the development of a tactile sen-sor that includes human active sensing characteristics. First, anoverview of the relevant human active sensing characteristics ispresented and discussed. Following which, the concept of a tac-tile sensing (including human active sensing characteristics) is pro-posed and prototypes of the tactile sensor are shown. Two variantsof a prototype tactile sensor, designed to measure surface properties(roughness and irregularity) have been developed. Experimental re-sults show the potential of the proposed tactile sensing method andconfirm the validity of the developed tactile sensors. Furthermore,the multiplied effects of the proposed tactile sensor are presentedbased on the results of our experiments.


    We will focus on two characteristics of human active sensing.

    1. Self-reference: our tactile sensations are based on deforma-tions to our skin resulting from mechanical interactions be-tween the skin and the object being evaluated/manipulated.

    2. Bidirectionality: our tactile perceptions and sensing motionscannot be separated. They are bi-directionally related.


    IEEE World Haptics Conference 201121-24 June, Istanbul, Turkey978-1-4577-0298-3/11/$26.00 2011 IEEE

  • 2.1 Self-Reference

    Self-reference refers to the point that the tactile stimuli provided byobjects will be experienced differently by different persons. Thisis because the mechanical properties of our fingers (such as skinstiffness, fingernail length, among other factors) differ between in-dividuals. Motions related to tactile sensing also differ betweenindividuals. Therefore, our tactile sensations depend on ourselvesas well as the object. This is an important factor to consider whenevaluating tactile sensations and understanding the importance ofan experienced workers well-trained sense of touch. Tactile dis-plays and tactile enhancing devices also provide this characteristicsince the tactile stimuli are transmitted to the users.

    2.2 Bidirectionality

    Bidirectionality refers to the fact that we adjust our sensing mo-tions to conform to the objects and the tactile sensations. Thus,we can perceive tactile sensations best, and it appears that our tac-tile sensing abilities are optimized by this characteristic. Therefore,when tactile displays and tactile enhancing devices are used, userscan consciously adjust the sensing conditions (such as pressure ex-erted, scanning velocity and other factors) in order to optimize theirperception of tactile sensations. This factor strongly contributesto ensuring adequate performance without imposing limiting con-ditions. Furthermore, bidirectionality is useful when performingdifficult evaluations such as attempting to detect very small differ-ences and large dynamic ranges, and well-trained workers utilizethis characteristic.


    Considering the above-mentioned characteristics, it is expected thata tactile sensor system that includes self-reference and bidirection-ality could achieve a high level of sensitivity without requiring strictusage conditions, and could be used to evaluate tactile sensations atthe individual level. Accordingly, we propose a sensor system thatemploys a users ability to detect his or her own skin deformationsor related information by perceiving tactile sensations. Using thissensor system, we can obtain information on tactile stimuli appliedto ourselves, while also utilizing bidirectionality when performingtactile sensing evaluations.

    Ideas of using a human finger as a part of tactile sensors havebeen investigated. Mascaro et al [10] proposed the nail-mountedtactile sensor capable of measuring the force applied to a finger padby detecting changes to fingernail color. Makino et al. [11] pro-posed the life log system utilizing a nail-mounted tactile sensor,in which a piezo attached to the nail detects vibrations transmit-ted from the finger pad. They showed that touch motions used inthe life can be estimated from sensor output signals. Iwamoto andShinoda [12] proposed the finger ring tactile interface, which mea-sures several DOF vibrations propagating along the finger by us-ing accelerometers on the backside of the proximal phalanx. Theyshowed that tapping on distal phalanx and middle phalanx can bediscriminated from sensor output signals. These sensors have thepotential to utilize self-referenc