Haptic Empathy: Investigating Individual Differences in Affective Haptic Communications
Yulan Ju, Xiaru Meng, Harunobu Taguchi, Tamil Selvan Gunasekaran, Matthias Hoppe, Hironori Ishikawa, Yoshihiro Tanaka, Yun Suen Pai, and Kouta Minamizawa. 2025. Haptic Empathy: Investigating Individual Differences in Affective Haptic Communications. In Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems (CHI '25). Association for Computing Machinery, New York, NY, USA, Article 501, 1–25. https://doi.org/10.1145/3706598.3714139
Nowadays, touch remains essential for emotional conveyance and interpersonal communication as more interactions are mediated remotely. While many studies have discussed the effectiveness of using haptics to communicate emotions, incorporating affect into haptic design still faces challenges due to individual user tactile acuity and preferences. We assessed the conveying of emotions using a two-channel haptic display, emphasizing individual differences. First, 24 participants generated 187 haptic messages reflecting their immediate sentiments after watching 8 emotionally charged film clips. Afterwards, 19 participants were asked to identify emotions from haptic messages designed by themselves and others, yielding 593 samples. Our findings suggest potential links between haptic message decoding ability and emotional traits, particularly Emotional Competence (EC) and Affect Intensity Measure (AIM). Additionally, qualitative analysis revealed three strategies participants used to create touch messages: perceptive, empathetic, and metaphorical expression.
https://dl.acm.org/doi/10.1145/3706598.3714139
Transcript 4,531 words
Welcome to the Deep Dive. Today, we're really getting into something fundamental. Touch. Absolutely. It's so basic to how we connect, isn't it? Totally. Think about like a hug or just a hand on your shoulder when you need it. It's vital for expressing emotion, for connection. For our well-being, really. Exactly. But, you know, we live so much through screens now. How do you actually send that hug?
How do you send reassurance when you're not physically there? Well, that's the million-dollar question, isn't it? And it leads us straight into today's topic. Which is? It's this concept called haptic empathy.
Basically, the idea that we could maybe convey and even understand emotions just through, well, touch-based vibrations. Okay. Haptic empathy. So feeling through vibrations is intriguing. Imagine getting a digital pat on the back that actually feels, you know, warm. Yeah. Not just like your phone buzzing. Right. More than just an alert. So let's unpack this. We're diving into a specific study today. We are. It's a really interesting one from 2025 by Ju and colleagues titled,
Haptic Empathy, Investigating Individual Differences in Effective Haptic Communications. Gotcha. So our mission here is to figure out what they found. Like, how do people even try to send feelings through touch? Exactly that. Yeah. And how our own personalities, our emotional makeup affects how we send and receive these touch messages. And what it all means for maybe future gadgets or ways we communicate.
Precisely. We're going to get into the nitty-gritty of how people actually, you know, feel through these haptic signals. Okay, cool. So before we dive into the study itself, let's talk a bit more about touch in general. It's a powerful communication channel, right? Often overlooked digitally. Hugely powerful. It's a critical, nonverbal way we convey deep emotions. So important for well-being, for relationships. And it doesn't just work alone, does it? Like, it can amplify other things.
That's a great point. Touch can seriously intensify what you're seeing on someone's face or hearing in their voice. It has this whole other layer of meaning. A hand on the arm makes a kind word feel, well, deeper somehow. Exactly. So if it's so important, how will we typically use touch in, say, technology so far? Well, mostly for practical stuff, right? Like navigation cues on your phone or maybe alerts.
Things like Braille displays, even. Task completion stuff. Right. Cask-oriented. That's very different from what we're talking about today, this field of effective haptics. Effective haptics. So adding actual emotion into touch tech. Which is way harder than it sounds. I bet. What are the main hurdles? Well, for starters, we're all different. Yeah. How sensitive your skin is, what kinds of touch you use.
Like, it varies massively person to person. Tactile acuity, preferences. Okay. So individual differences are a big one. Huge. And then there's a challenge of capturing, you know, subtle, complex emotions with just, well, engineered vibrations. It's not easy to make a vibration feel sad. Right. It's not just on or off. And a lot of previous work looked at what people preferred after the tech was built.
They didn't dig so much into why certain vibrations felt a certain way or how people would design them naturally. Ah. So this study tried to get at the creation part, too. The intuitive design. Exactly. That was a core goal. Okay. So what were the big questions that were trying to answer them? Lay them out for us. Sure. So question one. How do people intuitively design vibrations to express different emotions? What do they actually do?
Makes sense. What else? Question two. How do our individual emotional traits, things they measure like emotional competence or EC and effect intensity, AM, how do those influence how we design and interpret these haptic messages? Okay. So does being more emotionally aware or feeling emotions more strongly change things? That's the idea. And finally, question three. Based on all this, what are the actual strategies? What can we learn to design better haptic interfaces for emotional communication, keeping these individual differences in mind?
Got it. So intuition, individual traits, and design guidelines. Quite ambitious. Definitely. All right. Let's get into the how. How did they actually set this experiment up? Sounds complex. It was pretty clever, actually. They started by recruiting participants. 24 people came in for the first part, the design phase. Okay. And then 19 of those same people came back later for the interpretation phase. Importantly, they had varied demographics, which helps make the results more general.
Good. And what device did they use to send and receive these haptic messages? They used a custom built device. It was wearable. Two channels. Picture two half spheres that clicked together magnetically to form one smooth sphere. Yeah. Okay. Lightweight, neutral colors. They didn't want the look of it biasing the emotions. And it delivered high fidelity vibrations. And they interacted with it using their hands.
Yes. Specifically hands. Good sensitivity and it's, you know, socially acceptable to touch things with your hands. Right. And how did they capture the touch itself? What the participants were actually doing? They used something called PVDF films. Basically, it's sensor strips, like a belt, worn on the index fingers of both hands. Okay. Sensors on the fingers. Yeah. And these sensors were designed to pick up the tiny vibrations traveling through the skin when the fingertip touched something.
Crucially, they didn't just measure the finger waving around, but the actual touch interaction. Smart. That sounds really specific. And you mentioned sensitivity differences earlier. How did they handle that? Calibration? Exactly. They had a calibration system. Before the main task, they figured out each person's individual sensitivity. Oh. They measured the quietest vibration each person could detect at three different frequencies. 50 hertz, 200 hertz, and 400 hertz. Kind of representative points.
Okay. And from those points, they estimated the detection threshold across a much wider range up to 2000 hertz. This let them adjust the intensity of the haptic messages later. Ah. So everyone would hopefully perceive the same level of sensation, even if their skin was naturally more or less sensitive. That was the goal, yeah. Yeah. To standardize the perceived intensity. Okay. Device, sensors, calibration. Now, how did they get people feeling things to create messages about? They needed emotions.
Right. They used film clips. Eight carefully chosen 40-second clips from a database called EMDB. Clips known to evoke certain feelings. Precisely. And importantly, no audio, just the visuals. They were selected to target specific spots on the emotion map, like high valence, high arousal, think maybe excitement or joy. Or low valence, low arousal, perhaps sadness or calmness. Gotcha. So valence being the positive-negative scale and arousal being the intensity scale.
Exactly. And after watching each clip, participants rated their own feelings using something called the self-assessment mannequin, or SAM. SAM. Like a little figure. Yeah. It's a simple pictorial scale. You just point to the figure that best represents how pleasant semblance and how calm, excited arousal you feel on a nine-point scale. It confirmed the clips were working as intended. Okay. Seems like a solid setup. So then the experiment itself, two main phases you said, design and interpretation.
Correct. First was the design phase. The participants watched a clip, felt the emotion, and then they had five to ten seconds to create a haptic message expressing that feeling. How did they create it? Just by touching the device. Using natural actions, yeah. Tapping it, rubbing it, pressing it, whatever felt intuitive to them based on the emotion they just experienced. And they collected a lot of these.
They did. 187 messages in title. Then the researchers curated these down to 72 for the next phase. How did they choose which ones? Based on how confident the designer felt about their message expressing the emotion, and also to ensure they had a good balance across the different emotion types. Makes sense. Okay. So that's design. Then came the interpretation phase. Right. The 19 participants who came back got a set of 33 messages to interpret.
And what was in that set? A mix. A specific mix, yeah. For each interpreter, there were 15 messages created by other people presented without that individual calibration applied. Okay. Raw messages. So then, 15 calibrated versions of those same messages adjusted for the interpreter's sensitivity. Ah, so they could compare calibrated versus non-calibrated. Exactly. Yeah. And just to make it extra interesting, they also included three messages that the interpreter had created themselves back in the design phase.
Oh, cool. To see if you understand your own haptic language better. That was the question, yeah. Okay. And throughout this, they also measured those personality traits we mentioned affect intensity, ABEN, and emotional competence using standard questionnaires. Got it. A really thorough process. Okay. Let's get to the results. What did they find? First off, did the movie clips actually work? Did people feel the intended emotions?
Oh, yeah. Definitely. The validation using those SAM ratings was really strong. The clips reliably produced the target emotions, aligning very closely with the database ratings for both valence and arousal. Great. So the emotional input was solid. Now, the big question. When someone interpreted a message someone else designed, how well did the emotion transfer? Did the empathy work? This is where it gets really interesting and maybe a bit complex. They found only a weak positive correlation for valence.
So people were only slightly better than guessing whether the emotion was meant to be positive or negative? Pretty much, yeah. A slight understanding, but not strong. However, for arousal, the correlation was moderate positive. Ah, so people were much better at telling if the intended emotion was supposed to be, like, calm or intense. Exactly. Conveying the energy level of the emotion through touch seems significantly easier than conveying its specific positive or negative flavor.
Okay, that makes intuitive sense somehow. What about the actual accuracy rates, like percentage correct? Well, matching the findings on correlation, arousal accuracy was consistently above chance levels. People got it right, or partially right, a decent amount of the time. Okay. But for valence accuracy, it often hovered much closer to chance, sometimes barely better than guessing. Wow. So, again, intensity comes through, but the specific feeling is blurry.
Very much so. Yeah. And they found something else really key, which they termed the dampening effect. Dampening effect, like turning the volume down. Kind of, yeah. When the emotion, which was initially triggered by a rich visual stimulus, like the film clip, got translated into just a haptic signal, the intensity often seemed to diminish. Both the valence and arousal scores reported by the interpreters tended to be closer to the neutral midpoint than the scores reported by the original designers.
So the emotion gets kind of muted or compressed in the translation from vision to touch. That's a good way to put it. Muted or compressed. It suggests a challenge in maintaining the full emotional richness across that sensory translation. Interesting. Okay. What about that calibration? Adjusting for individual sensitivity, did that help people interpret the messages better? Surprisingly, not as much as you might expect on the whole. It didn't significantly boost the overall accuracy across the board.
Really? Huh. But it wasn't useless. It did seem to improve the accuracy specifically for interpreting arousal. And it also helped messages intended as high valence, high arousal cluster together better in the analysis. Okay. So a more subtle effect. Yeah. It helped clarify the intensity and maybe the really positive energetic feelings, but didn't solve the main valence problem. Exactly. Nuanced, not a magic bullet.
And were some people just naturally better interpreters than others? You mentioned individual differences earlier. Oh, definitely. There was significant variability. Some people were much better at decoding the messages than others. And did people understand their own messages better, the ones they designed themselves? Here's another surprise, not really. Participants didn't show a clear advantage in interpreting their own creations compared to messages from others.
Wow. Okay. So it's not like you automatically understand your own secret haptic code. Apparently not. It suggests a really complex interplay happening. But they did find a link between skill sets. Ah, so. There was a significant positive correlation between how accurately someone interpreted valence in non-calibrated messages and how proficient they were rated at designing messages that others could understand. So if you're good at making haptic messages others get.
You're probably also pretty good at understanding the messages others make, especially the emotional flavor, the valence. It's like a linked skill, haptic expressiveness, and haptic perception for emotion go together. It strongly suggests that, yes, a reciprocal ability. And confidence. Did feeling confident matter? Very much so. Strong positive correlations there. People who felt confident about their ability to design messages also felt confident about their ability to interpret them, and vice versa.
This held for both calibrated and non-calibrated messages. So your belief in your haptic skills, both sending and receiving, seems tightly linked. Yeah, it really underscores that intrinsic connection between designing and interpreting in this domain. Okay, this is fascinating. We've looked at the numbers, the correlations, the accuracy, but this deep dive is called feeling through vibrations. Let's get into the human side. How did people actually come up with these touch messages?
What strategies did they use? The interviews must have revealed some cool stuff. Absolutely. This qualitative part is where you really see the thought processes. They identified three main intuitive strategies people used. The first one was perceptive expression. Perceptive expression, meaning? Basically translating things they saw in the videos directly into touch. Okay, like mimicking actions. Exactly. Imitating motion was big. They tried to match the amplitude, the rhythm of actions in the clips.
Things like violent scenes or even erotic scenes were apparently easier to mimic physically. Right. They have distinct movements. Some people even use their left versus right hand to represent different people in the video, like a conversation or a relationship. Wow, that's quite detailed. What else under perceptive expression? Referencing texture. They'd use touch to try and convey a texture they saw, like clothing or table surface.
Or even for the erotic clips, some mention touching their own arm to try and represent the feeling of skin. One person clenched their palms to show disgust, like mimicking a gut reaction. Calm scenes often involve trying to convey smooth or gentle textures. So translating visual or even conceptual textures into physical action. Yes. And another surprising one was imagined sound. Remember, the clips had no audio.
Right. But people would imagine the sounds and try to translate that into vibrations, like making a sharp, quick vibration for slashing some with a knife or a different pattern for cracking eyes. Whoa. So they're really trying to recreate the whole sensory world of the clip, even the missing parts, through touch alone. That's ambitious. What was the second strategy? The second was empathetic expression.
This was less about mimicking the visuals and more about conveying their own emotional state while watching the clip. Okay. Expressing their personal reaction. Yeah. High arousal emotions and tense ones were generally easier to express this way. People could create intense vibrations for fear or excitement. They even noted subtle differences, like trying to make erotic intensity feel different from horror intensity. Trying to capture the flavor of the intensity.
Exactly. And they often based their designs on their immediate physiological reactions.
Like what? Like one participant talked about feeling like internally screaming during a violent clip and trying to translate that panic into the haptic message. Another might do excited tapping for an erotic scene. So using their own body's signals as the source material. Precisely. Which, interestingly, made expressing high energy emotions easier than expressing calmness because it was harder to actually feel calm on demand in the lab setting.
That makes sense. Did their general capacity for empathy matter here? It seemed to, yeah. That ties into perspective taking, which was another part of this strategy. Designing based on how would I feel if I were in that situation. Okay. But this varied a lot. Someone who couldn't easily empathize with violence found those scenes hard to design for. Calm scenes were tricky if there were no humans in the clip to empathize with.
Right. Harder to put yourself in the scene. And people really struggled with mixed or complex emotions. Erotic scenes, for example, could involve excitement, happiness, intensity, maybe even calmness all mixed together. Sadness could be complex, too. How do you capture that blend in one short vibration pattern? Yeah, distilling a complex emotional cocktail into a simple vibration. That's a huge challenge. Okay. What was the third and final strategy?
The third was metaphorical expression. Using abstraction, implication, things not directly in the video. Okay. Going beyond the literal. Like using symbols. Kind of. Using associations. Connecting the feeling to something else entirely. For calmness, maybe designing a slow, rhythmic pulse like a heartbeat. Or gentle tapping like raindrops. Ah. Drawing on familiar real-world sensations linked to that emotion. Exactly. Or for disgust. Maybe a high-frequency jarring vibration.
Like the sound of chalk screeching on a blackboard. Something totally unrelated to the clip but associated with the feeling. Happiness might be represented by patterns resembling music. Interesting. Using personal or maybe common metaphors for feelings. Yes. And some people even talked about it like creating a language. Framing haptic design as a conversation of body language. Or literally learning a new language. Exploring how using one hand versus two changed the expression.
One person explicitly compared using two fingers to drumming and music. Trying to build a richer vocabulary of touch. It seems so. And it was even a fascinating cultural example. One participant linked an erotic film clip to the Chinese slang term pa-pi-a. Which refers to intimate relations. And try to convey that specific cultural nuance in their haptic design. Wow. That opens up a whole other dimension.
Culturally specific haptic metaphors. Potentially. Yeah. Shows how deep and layered this could become. So these strategies. Perceptive. Empathetic. Metaphorical. Really show the creativity people bring to this. Now let's connect back to those individual traits. You mentioned emotional competence. EC. And effect intensity. AAM. How do those actually link up with how well people designed or interpreted these messages? Right. This is where some of the most perhaps counterintuitive findings emerged.
Let's start with emotional competence, EC. Okay. How good you are with emotions. Specifically, they looked at interpersonal EC. How skilled you are at understanding and managing other people's emotions. Right. And they found a strong negative correlation between high interpersonal EC and the accuracy of interpreting valence. Positive negative feeling for the calibrated messages. Wait. Negative. So people who are really good at understanding others' emotions in real life were worse at understanding the emotional flavor of these calibrated haptics.
That's what the data showed. It's fascinating, isn't it? It really is. Why would that be? Well, the researchers theorized a bit. Maybe people who are highly attuned to the richness and complexity of real-world emotional cues find these relatively simple, abstract haptic signals. Harder to pin down. Like they're looking for nuances that just aren't there or reading too much into it. Oops. Or maybe they perceive too many potential emotional possibilities in the vibration, making it hard to settle on one.
Or they might even tend to overestimate the emotional valence because they're used to stronger cues. It's a really interesting puzzle. Definitely food for thought. Being too emotionally perceptive might hinder interpretation of simplified signals. Okay. What about the other trait? Affect intensity measure. AIM. Feeling emotions strongly. For AIM, the results weren't statistically significant, so we need to be cautious. But there was a trend suggesting a negative relationship between having higher effect intensity and being accurate at interpreting valence.
So, again, potentially people who feel things very strongly might have been less accurate at judging the positive negative feeling from the vibration. That was the hint in the data. Yeah. Yeah. It didn't reach statistical significance, but the trend was there. Any theories on that one? The idea floated was that maybe individuals who experience really intense emotions find these subtle vibro-tactile stimuli just not strong enough.
Like the vibrations don't provide the level of intense arousal they associate with strong feelings. So maybe they misinterpret the valence or find it harder to engage with emotionally. Like the signal bandwidth is too low for their emotional processing? Could be something like that. Yeah. But again, that's more speculative, needs more research with bigger groups. Understood. Okay. So we've seen how people try to create these messages, the challenges in interpretation, the dampening effect, the role of calibration, and these intriguing links to personality traits.
Where does this leave us? What does it mean for actually building technology that uses haptic empathy effectively? Yeah. Putting it all together. The big takeaway is that, yes, haptics can convey emotional information, but how people do it and understand it is incredibly individualistic. Right. No one-size-fits-all vibration for sad. Definitely not. Which makes designing universal systems really tricky. The study suggests the path forward needs a careful balance.
A balance between? Between standardization and personalization. Okay. Explain that. We probably need some standardization for the basic building blocks of haptics, like maybe agreements on how intensity ramps up or certain rhythmic patterns so things are broadly usable and people have a common starting point. Like basic grammar for haptics. Kind of, yeah. But then the actual end-user experience needs to be highly customizable.
It has to adapt to your personal preferences, your sensitivity, your emotional thresholds, for a message to really land emotionally. So standard basics, but personalized delivery and meaning. That makes a lot of sense. So based on everything they learned, did the researchers offer concrete advice for designers, like actual guidelines? They did. They distilled it down into five key design guidelines, which are really practical takeaways for anyone thinking about this stuff.
Okay, let's hear them. Guideline one. First, incorporate cross-modal correspondences. Designers should actively think about how we naturally link senses. Map cues from vision or sound onto the haptics intentionally. So like we discussed, fast movement in a visual becomes a sharp federation. A low sound becomes a low frequency rumble. Exactly. Make those links explicit and intuitive. Don't just create abstract vibrations. Tie them to other sensory information where possible.
Okay, that seems crucial for making it understandable. Guideline two. Second, design for personalization and flexibility in emotional thresholds. This is huge. The system has to adapt to the individual user. Meaning? Meaning you, the user, should be able to adjust the feedback. Maybe your threshold for feeling intense is different from someone else's. The system needs to allow that tuning so the emotional message actually resonates personally.
Right. Tailoring the volume of the emotion to the individual. What's third? Third, leverage physiological reactions to enhance authenticity. This was pretty futuristic but exciting. Okay. Imagine future systems integrating your real-time biosignals like heart rate, maybe muscle tension from a smartwatch. Oh. The system could use that data to dynamically adjust the haptic feedback it gives you. Making the emotional experience feel more authentic because it's literally reacting to your body's state.
That is mind-blowing. A device that feels your stress and sends a calming vibration that adapts as your heart rate slows. Potentially, yeah. Whoa. Creating this biofeedback loop to make the haptics more genuinely empathetic. Incredible. Okay. Guideline four. This must relate to those creative strategies people use. It does. Fourth, utilize metaphors and cultural references to enrich communication. Don't just rely on direct mimicry or physiological responses.
Right. The interface should provide a flexible space. Allow users to create and share meanings through abstract metaphors, maybe associating happiness with certain rhythmic patterns or sadness with slow pulses, and even allow for incorporating culturally relevant references like that POPP example. So give users the tools to build that richer, more symbolic haptic language. Exactly. Empower expression beyond the literal. And the final guideline, number five.
Fifth. Standardize iterative haptic encoding strategies. This is about learning and improving. Also. Users need chances to practice, to test their haptic messages, refine them based on feedback, and see how others interpret them. This iterative learning process is key to developing haptic empathy. So it's not just about the tech. It's about teaching people how to use it effectively to communicate emotion. Precisely. Building a shared understanding and skill through practice and feedback,
like learning any language, really. Okay. Those five guidelines, cross-modal mapping, personalization, using biosignals, allowing metaphors, and iterative learning seem like a really solid roadmap. That's a great starting point, definitely. So wrapping this deep dive up, it feels like we've journeyed into a really new territory of communication, communicating feelings through touch alone. It's clear that it's possible, but wow, is it individualistic and complex.
Yeah, this study really throws that complexity into sharp relief, but also the potential, right? Especially when you factor in our own emotional styles influencing how we send and receive. Absolutely. And like any pioneering study, it has its limitations, which we should acknowledge. For sure. What were the main ones? Well, it focused mainly on just vibrotactile feedback vibrations. There are other kinds of haptics, like force feedback or temperature.
True. They only use video clips to evoke emotions, not other methods. The sample size, while decent for this kind of intensive study, was still relatively small. Right, limiting generalizability. And as that one example showed, cultural nuances could easily lead to meanings getting lost in translation. That needs way more exploration. Definitely. But even with those caveats, it feels like this work really lays some crucial groundwork.
Couldn't agree more. A vital foundation for thinking about touch beyond physical presence. Which brings us to our final thought for you, the listener. As we get better at understanding and designing for haptic empathy. As we learn to speak this silent, tactile language. What new kinds of connection, what new forms of understanding might open up? Imagine truly feeling someone's emotional state, their empathy, reaching you across any distance.
What will that future feel like? How new forms of understanding is just no hearing they may not say it's less hearing they may not happen. How new forms of understanding can actually speak have been helpful in asking them in reading their musical awareness. How new forms of understanding can always watch people looking at learning where there are actual maps of understanding they may know what new forms of understanding they may actually consider need of choose from seeing them in reading them.
As we read from trying to speak with hope of reading about reading work of reading book art is important in reading book story and reading book study with reading book stri Ahh