* This is the result of joint research with Prof. Hirota, Prof. Sakurai (UEC), Dr. Kuroki (NTT), and our students. The descriptions here may include my personal opinions.
Some animals can recognize the location of remote events through touch. Spiders sense the vibrations on their web with their legs and identify the direction and distance of prey [1]. Scorpions identify the direction and distance of prey from vibrations in the sand [2]. Can humans similarly sense remote vibrations through their hands and identify the location of a vibration source? A common way to convey spatial information through vibration is to attach vibrators directly to the skin surface (palm, wrist, torso, etc.). However, when vibrators are placed at locations away from the skin, it is not well understood whether people can estimate the location of the source from vibrations transmitted through a medium. If people can recognize the location of a remote vibration source through vibration, it would be useful. For example, while driving a car, vision is used to monitor what's ahead, and hearing is often blocked by noise. In such situations, presenting spatial information such as "in which direction is an obstacle" via vibration could enable efficient information delivery.
We conducted an experiment in which a solenoid struck a remote location on a silicone rubber sheet to generate impact vibrations, and users with their hand placed on the sheet were asked to identify the location of the vibration source. Vibration sources were placed at 24 points around the hand (8 directions x 3 distances). We also compared three hand postures: "two fingertips," "five fingertips," and "the entire palm." The results showed that the direction of the vibration source can be recognized to some extent. Particularly when both fingers and the entire palm were in contact with the sheet, accuracy was highest when the source was near the middle finger's tip, with a directional error of about 6 degrees. On the other hand, accurately recognizing the distance of the vibration source was difficult. In other words, "from which direction the vibration came" is recognizable, but "how far away" is hard to tell. These results suggest that direction-information presentation via remote vibration through a medium is feasible. For details, please see paper [3].
In Study 1, we used impact vibrations. We also investigated whether continuous vibrations such as sinusoidal vibrations work. Two frequencies were used: 30 Hz (low frequency, more responsive to RA receptors) and 230 Hz (high frequency, more responsive to Pacinian corpuscles). The experiment confirmed that sinusoidal vibration also enables direction recognition. Distance recognition, however, was difficult, similar to impact vibration. Differences by frequency included that direction-recognition accuracy varied slightly with the source direction, and that the variability in accuracy when the source was farther away was particularly larger at low frequency. In other words, high frequency is suggested to be more advantageous for stably recognizing the direction of distant vibration sources. For details, please see paper [4].
Studies 1 and 2 showed that "the direction of remote vibration sources is recognizable." What about spatiotemporal patterns where multiple vibration sources are presented in sequence? For example, when vibrations are presented sequentially around the hand in clockwise direction, can users correctly recognize that rotational pattern? If spatiotemporal pattern recognition is possible, it opens the way to richer information transmission beyond simple direction presentation. In Study 3, we used vibration sources arranged in 8 directions around the hand and presented 64 types of rotational patterns (combinations of start point, end point, and rotation direction) to investigate recognition accuracy. The average correct response rate was 48.9% (chance level was 0.78%). Furthermore, recognition accuracy varied with pattern characteristics. Patterns starting or ending on the ulnar (little finger) side were difficult to recognize, while patterns starting from the distal (fingertip) or proximal (wrist) side were easier to recognize. Clockwise patterns also showed a slight tendency to be more recognizable than counter-clockwise patterns. These findings provide fundamental information useful for designing spatiotemporal pattern presentation displays around the body. For details, please see paper [3].