A user wearing the fingerpad device touches a 3D-printed teddy bear made from rigid material. (Photo by Yujie Tao)
A user wearing the fingerpad device touches a 3D-printed teddy bear made from rigid material. (Photo by Yujie Tao)

When we say the world is at our fingertips, that’s because they play a major role in our perception of the environment around us. The fingertips are one of the most sensitive places on the human body, with thousands of touch receptors packed into a small stretch of skin and significant real estate in the brain’s sensory cortex. Fingertips are capable of finely-tuned activities such as typing or reading braille, while also detecting small changes in temperature, texture, and softness.

Now, a new wearable technology designed by researchers in the Human Computer Integration laboratory at UChicago CS seeks to fool those fingertips. With a plastic frame that wraps around, but not over, the fingerpad and a small motor, the device can stretch and compress the skin of the fingertip, changing the user’s perception of an object’s softness. A chopstick can feel like a pencil eraser, or touching a hard plastic toy can produce the sensation of pushing into rubber or pressing a button.

The research describing the project, led by predoctoral student Yujie Tao, received a Best Paper Award at the 2021 ACM Symposium on User Interface Software and Technology (UIST), one of the leading human-computer interaction conferences. The project also received the Best Demo Award from the UIST Jury.

Tao’s device, designed with Shan-Yuan Teng and Pedro Lopes, takes advantage of how we naturally sense whether an object feels hard or soft. Hard objects press against our fingerpad, causing the skin to conform to the object’s shape. Soft objects also push back on the fingerpad, but both finger and object conform to each other, increasing the surface area of the contact. Mechanoreceptors inside the skin sense this displacement, and send information about an item’s softness to the brain — the more surface area in contact, the softer the perception.

The device created by Tao and her colleagues tricks this system by pulling on the frame and gently squeezing the edges of the fingerpad, causing it to bulge slightly more than normal and restricting displacement. When the user touches a rigid object with the bulgier fingerpad, it feels softer, due to a larger contact area. But unlike other technologies that have attempted to manipulate the perception of softness by pressing directly on the fingerpad, users can still accurately perceive the other tactile details of what they are touching.

“We wanted our users to still feel the actual texture of the object itself,” Tao said. “Our design goal was to make sure that we are not blocking any existing sensation that people might have when touching physical objects, while augmenting the softness perception in any kind of interactive application.”

A user wearing the fingerpad device holds a video game controller 3D-printed with a rigid material. (Photo by Yujie Tao)
A user wearing the fingerpad device holds a video game controller 3D-printed with a rigid material. (Photo by Yujie Tao)

Those possible applications include making props for virtual or augmented reality more realistic, making appliances and other objects interactive, or helping designers working with hard 3D-printed objects simulate the feel of a softer material. The researchers used some of these situations to test the effectiveness of the device, including asking blindfolded subjects to touch a series of rubber blocks and use a 3D printed video game controller with rigid buttons, with and without the fingerpad restriction.

The tests revealed that the device could significantly change a person’s perception of softness, from approximately the rigidity of a skateboard wheel to the softness of a pencil eraser, Tao said. Subjects also reported realistic haptic feedback, such as the feeling of pressing down a button on the gamepad even though it was stationary.

“I think what’s interesting about this project is, it all comes from your own body’s perceptions,” Tao said. “Our approach is like augmenting your finger, your own body, it changes your physical experience without really changing the environment.”

Previous efforts to produce this interactive softness have focused on instrumenting the environment, altering the target object instead of the person feeling it, or covering up the user’s fingertips entirely, which only allows it to transform the softness of virtual objects. Instead, Tao’s device directly modifies the subjective experience of the user, without covering their fingerpads — a strategy also used in other Human Computer Integration Lab haptic projects such as Touch&Fold and MagnetIO.

“This idea of providing sensations to our fingerpads without covering them is almost paradoxical, which always puzzled me in a good way!,” Lopes said. “This has been the driving force for a series of projects where we are attempting to engineer a new kind of haptic device that can be useful all the time, rather than just while in virtual reality. In the case of Yujie’s device, this is not just useful for VR but even for interacting with physical matter, prototyping, and much more.”

Related News

More UChicago CS stories from this research area.
UChicago CS News

DSI Summer Lab Returns In-Person With 49 Students From Across the U.S.

Jun 14, 2022
UChicago CS News

UChicago CS Labs Join Museum of Science & Industry For Robot Block Party

Apr 20, 2022
UChicago CS News

New Data & Democracy Research Initiative Launched at University of Chicago

Mar 09, 2022
UChicago CS News

Assistant Professor Pedro Lopes Receives Sloan Research Fellowship

Feb 15, 2022
UChicago CS News

CS 4th Year Sophie Veys Receives CRA Undergraduate Research Award

Jan 14, 2022
In the News

Asst. Prof. Blase Ur Discusses the “Metaverse” on Chicago Tonight

Nov 05, 2021
In the News

Assistant Professor Ken Nakagaki Named Innovator Under 35 by Tech Review

Oct 29, 2021
UChicago CS News

New Wearable Device Controls Individual Fingers for Sign Language, Music Applications

Oct 11, 2021
UChicago CS News

Five UChicago CS Students Named to Siebel Scholars 2022 Class

Sep 23, 2021
UChicago CS News

Trio of New UChicago CS Faculty Join for 2021-22 Academic Year

Sep 16, 2021
UChicago CS News

Largest-Ever DSI Summer Lab Adds 55 Students, New Social Impact Track

Jul 13, 2021
UChicago CS News

Edge Computing Strategy from UChicago CS Student Wins RTAS Outstanding Paper

Jun 17, 2021
arrow-down-largearrow-left-largearrow-right-large-greyarrow-right-large-yellowarrow-right-largearrow-right-smallbutton-arrowclosedocumentfacebookfacet-arrow-down-whitefacet-arrow-downPage 1CheckedCheckedicon-apple-t5backgroundLayer 1icon-google-t5icon-office365-t5icon-outlook-t5backgroundLayer 1icon-outlookcom-t5backgroundLayer 1icon-yahoo-t5backgroundLayer 1internal-yellowinternalintranetlinkedinlinkoutpauseplaypresentationsearch-bluesearchshareslider-arrow-nextslider-arrow-prevtwittervideoyoutube