All episodes
Cover art for NeuResonance: Exploring Feedback Experiences for Fostering the Inter-brain Synchronization

NeuResonance: Exploring Feedback Experiences for Fostering the Inter-brain Synchronization

— CHI 2025 — episode 44

0:00 17:45

When several individuals collaborate on a shared task, their brain activities often synchronize. This phenomenon, known as Inter-brain Synchronization (IBS), is notable for inducing prosocial outcomes such as enhanced interpersonal feelings, including closeness, trust, empathy, and more. Further strengthening the IBS with the aid of external feedback would be beneficial for scenarios where those prosocial feelings play a vital role in interpersonal communication, such as rehabilitation between a therapist and a patient, motor skill learning between a teacher and a student, and group performance art. This paper investigates whether visual, auditory, and haptic feedback of the IBS level can further enhance its intensity, offering design recommendations for feedback systems in IBS. We report findings when three different types of feedback were provided: IBS level feedback by means of on-body projection mapping, sonification using chords, and vibration bands attached to the wrist.

 

Jamie Ngoc Dinh, Snehesh Shrestha, You-Jin Kim, Jun Nishida, and Myungin Lee. 2025. NeuResonance: Exploring Feedback Experiences for Fostering the Inter-brain Synchronization. In Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems (CHI '25). Association for Computing Machinery, New York, NY, USA, Article 363, 1–16. https://doi.org/10.1145/3706598.3713872

 

Download the audio (4 MB)
Transcript 3,070 words

Ever been so perfectly aligned with someone you know, a friend, finishing your sentence? Or maybe a bandmate hitting the exact same note. Oh, yeah, absolutely. Or like teammates just moving in perfect sync on the field. Exactly, that feeling. It's almost like your brains are literally connected, right? Oh. Well, science is increasingly showing that's not just a feeling. It's actually measurable. Mm-hmm.

Welcome to the deep dive. Today we're not just talking about being on the same wavelength. We're really diving into the science of interbrain synchronization, IBS for short. Oh, right. And specifically how new technology is trying to, well, maybe amplify that connection. For this deep dive, we've really zeroed in on a specific research paper. Pretty groundbreaking stuff. Yeah, it's called NERR Resonance, exploring feedback experiences for fostering the interbrain synchronization.

Comes from researchers at the University of Maryland and Texas A&M. So our mission today? Yeah. Figure out what IBS actually is. And then how these scientists tried to boost it using different kinds of feedback, like visual, audio, even touch. And crucially, what could this all mean? For teamwork, communication, maybe even physical therapy. That's the plan. So the big question we're tackling is, can we genuinely get a shortcut to being in sync with someone?

And, you know, if we can, which way works best? Visual, audio, haptic. The answers might actually surprise you. Yeah. Okay. Let's get into it. Let's do it. So interbrain synchronization. IBS. When we talk about this phenomenon, what exactly are we talking about? Are our brains literally syncing up? Yeah, pretty much. When people work together on something, a shared task, their brain activity patterns often start to mirror each other.

They synchronize. Wow. And it's not just, you know, a coincidence or some kind of metaphor. It's a real measurable neural thing. We've seen these shared patterns in, well, all sorts of cooperative activities. Like what kind of activities show this? My mind jumps to musicians playing together, obviously. Sure. Musicians are a classic example. But it's actually much broader. Studies have seen it when people watch the same movie together.

Oh. Yeah. Or perform coordinated hand gestures, play online games together, even simple things like just holding hands or working on a puzzle together. Or I think I read collaboratively typing something. Exactly. Collaboratively typing passages. It really shows how our brains kind of automatically try to find a rhythm with another person when we're focused on the same goal. That's pretty amazing. But, okay, why does it matter?

Is it just a cool scientific observation or does this brain sync actually have an impact? Oh, it definitely has an impact. This is where it gets really interesting, I think. Past research shows pretty clearly that IBS isn't just happening in the background. It's deeply connected to positive social stuff. Positive social stuff. Like what? Like stronger feelings of closeness, trust between people, even empathy.

It seems to foster what researchers call behavioral coordination. Okay. Like moving together smoothly. Exactly. Think of dancers or rowers. And it boosts the sense of joint agency. That feeling of we're doing this together as a single unit. Right. That we're feeling. And being able to measure this sync, it might even help predict how well a collaboration will go. It helps us understand those, you know, subjective parts of working together.

Okay. So brain sync is definitely a good thing. Makes sense. Which naturally leads to the next question. Yeah. Can we, like, make it happen more? Can we boost it? Oh, yes. Yes. Especially using ways that, you know, everyday people could potentially access, not just lab equipment. That is precisely the big question this new resonance paper dives into. We've known for a while that IBS correlates with good outcomes, but actively enhancing it.

That's been relatively unexplored territory. Especially with external feedback. Exactly. There's been some work using things like magnetic brain stimulation, which is not exactly user-friendly. No kidding. So this study focused on things like visuals, sounds, vibrations, much more accessible. So if we could reliably strengthen this sync with feedback. Yeah. Wow. What are the potential implications there? Oh, that could be huge. Really huge.

It could lead to totally new ways of working together in teams, creating synergies that maybe go beyond what individuals can do alone. Think about education students tackling complex problems together. Or in companies, improving teamwork and communication. Or even therapy. You mentioned that earlier. Yes, definitely. Imagine strengthening the connection, the rapport between a therapist and a patient. It could really open up some new possibilities for connection and collaboration.

Okay. So that's the potential. Let's get into the experiment itself. New resonance. How did they actually try to sync people's brains? What was their main hypothesis? Well, their central idea, their hypothesis was basically, if we give people real-time feedback about how in sync their brains are using visual, sound, or touch, will that feedback itself increase the level of synchrony? So can these external cues actively push the brains to sync up more?

That's the core question they wanted to answer. And measuring brain zinc in real time. That sounds incredibly difficult. How do they pull that off? It is complex, yeah. But they had a pretty smart setup. They used dual EG. EG, like the caps with electrodes. Exactly. Electroencephalography. Reading the brain's electrical activity. They used these specific headsets, Emotive Epoxy X, on two participants at the same time.

Okay. And to make sure the signals were clean, because people move, right? They used a Vicon motion capture system. Ah. Like for movie CGI? Kind of, yeah. It helped remove the noise from physical movements, so they were getting cleaner brain data. Clever. And then how did they calculate the actual sync level? They used a measure called the Circular Correlation Coefficient, or C-Core.

You can think of it as a way to measure how well the phases of the brainwaves from the two people line up. Phase angles. Like the peaks and troughs matching up. Precisely. A higher C-Core value, closer to one, meant the brainwaves were more aligned, more in sync, and the system was pretty fast. It could calculate and output a new C-Core value every one and a half seconds.

Wow. New real time, then. So they've got this number representing sync. How did they turn that into feedback people could actually perceive? Right. That was the next challenge. They designed three different feedback systems, all dynamically changing based on that C-Core score with five levels of intensity. Okay. What was the first one? Visual. Yep. Visual feedback. They used projection mapping for this. They projected an abstract image, an oscillating orange circle directly onto the participants'

bodies. Onto their bodies. Interesting. How did it work? The idea was, as the IBS, the brain sync, increased, the wobbling or oscillation of that orange circle decreased. Ah. So more sync meant a calmer circle. Exactly. The goal was a perfectly still circle when they were at maximum synchrony. It was designed to be, you know, spatially there with them and hopefully not require too

much mental effort to understand. Okay. Sounds fairly intuitive. Like a visual gauge for calmness or alignment. What about the sound? How do you make brain sync audible? For the auditory feedback, they mapped the IBS score to the pitch, the frequency of one note within a musical chord. A chord. Yeah. They used a major triad, typically a stable, pleasant sound. Two notes of the chord stayed the same, the root and the fifth.

But the middle note, its pitch would shift based on the sync level. So if you were out of sync. If your synchrony dropped, the frequency of that middle note would decrease slightly, just a 5% shift for one level down. This made the chord sound a bit off, less harmonious. Hmm. Like instruments tuning, but maybe going out of tune if you weren't synced.

Kind of like that. Yeah. The idea was to guide people using relative pitch, even if they weren't musicians. It was played through stereo speakers. But yeah, the question remained. How easy is that for non-musicians to pick up on? Good question. Okay. Visual auditory was the third one. Haptic. Haptic feedback, yes. Using vibration, they had participants wear vibration bands on their wrists. Like a smartwatch vibrating.

Sort of, yeah. The feedback here was based on rhythm and intensity. Lower synchrony, more dissonance meant faster beats per minute, faster pulsing, and stronger vibration. And higher synchrony. Higher synchrony meant slower, gentler vibrations. Slower BPM, lower intensity. What's interesting about haptics, does it have advantages? Well, one big advantage is speed. You feel vibrations almost instantly, like within 150 to 200 milliseconds. So it's quick, glabs your attention.

Right. And it does that without necessarily pulling your visual focus away from a task. And it's silent, so it maintains privacy. Okay. Three very different ways to feel the sync. So how did they test these out? What did the actual user study involve? They recruited 34 people, put them into 17 pairs, mostly strangers to each other. Okay. And these pairs did two different tasks together.

One was simple, hand mimicry, just copying each other's hand movements. The other was trickier, the cup and string task, you know, where you have multiple strings attached to a rubber band and you have to work together to pick up and move cups using only the strings. Oh, I know those. They require serious cooperation, like building IKEA furniture with someone, but maybe harder.

Exactly. Both tasks were chosen because they really demanded cooperation, coordination, and paying attention to each other, joint attention. Makes sense. So what conditions did they compare? They had a baseline non-sync condition where people just watched a video, expected low IBS there. Then they had the collaborative tasks with four variations, no feedback at all. Then with visual feedback, auditory feedback, and haptic feedback.

And they measured more than just the brainwaves. Oh yeah. They used questionnaires after each trial asking about trust, how helpful the feedback felt if they understood it, and then longer interviews and surveys at the very end. Or the moment of truth. After all that setup, all that data, what actually worked? Did any of this feedback actually boost brain sync? First off, they checked their basics.

And yes, their setup worked. IBS levels were definitely higher during the collaborative tasks compared to just watching a video, so they could measure the effect reliably. Good start. Then the hypotheses about the feedback, well, visual feedback. Hypothesis one was that it would increase IBS. That was false. Really? It didn't work. Quantitatively, no. It didn't show a significant improvement over getting no feedback at all.

Kind of surprising, maybe. Huh. Okay. What about auditory? Auditory feedback. Hypothesis two. It increases IBS. That was true. This one was actually the clearest winner. It had the most substantial, most consistent positive effect on boosting synchrony. Interesting. Okay. And haptic. Haptic feedback. Yeah. Hypothesis three. It increases IBS. Yes. Also true. Haptic feedback did positively influence the intensity of the brain sync. So visual was a bust, but auditory and haptic both helped.

Pretty much. And the overall hypothesis, H4, that external feedback in general can augment IBS. That was also true. Having some kind of feedback was generally better than none. So, yes, you can nudge brains into syncing better with external cues. That's a big finding. It really is. But, you know, the numbers are one thing. What did the people actually think? How did it feel to get this feedback?

Yeah. The qualitative stuff, the interviews, that added a lot of important nuance. For visual feedback, remember the orange circle? Yeah. A lot of people, 20 out of the 34, actually found it distracting. Distracting. How so. Well, they felt they had to split their attention visually between doing the task and watching the feedback projection. And often, if they got really focused on the task itself, the visual feedback just sort of faded into the background.

They stopped noticing it. Oh, okay. So maybe okay for simple stuff, but not when you really need to concentrate. That seems to be the case. Some found it clear for simple movements, but less helpful for the complex cut task. Right. And haptic, the vibrations, you said that also worked quantitatively. It did, but it was really polarizing subjectively. People seemed to either love it or hate it.

Oh. Yeah, it was the most favorite for 13 participants, but the least favorite for 14 others. Pretty split. Why the strong reactions? Well, those who liked it initially described it as calming, intuitive, less stressful. Some felt it helped them trust their partner more. One person specifically said it helped them focus more on watching their partner, which helped them sync up. Okay, that sounds positive.

So why did others dislike it? The main complaints were that the effect could wear off, like, sensory adaptation. You just get used to the buzzing. Yeah, like tuning out your phone vibration. Exactly. Or they found it too intrusive or actually hard to notice the changes in vibration, especially if the baseline intensity felt too strong to begin with. Hmm. Tricky to get that balance right.

Hmm. Okay, so that leaves auditory, the quantitative winner. How did that land with participants? Auditory was, um, much less polarizing. Generally, people preferred it. They described it as distinct, beneficial. They liked that it gave instant, delay-free responses. Ah, the immediacy was key. It seemed so. It let them keep their visual focus entirely on the task and their partner. And people with some musical background often found it especially easy to understand.

Makes sense. Any downsides? A few people found it a bit intrusive or sometimes confusing. Like, if the sound indicated they were out of sync, but they felt like they were perfectly in sync with their partner. Ah, that could mess with your confidence a bit. Right, it could reduce confidence momentarily if the feedback didn't match their own perception. That brings up trust again.

Do they look at which feedback type people trusted the most to be accurate? They did. And this was another really key finding. Auditory feedback came out on top as the most trusted signal for synchrony. Okay. Followed by haptic, and then visual was seen as the least trustworthy. Interesting. But here's something even more fascinating. Pairs, where both people happened to share the same top preference for a feedback type.

Yeah. They actually showed significantly stronger synchrony when using that preferred feedback. Their IBS scores, the C-Core values went up by an average of 14% compared to the no feedback condition. Wow. So personal preference really matters here. It's not just about the modality itself. Exactly. It highlights how important user preference and maybe even shared expectations could be when you're designing systems for connection.

That's a massive takeaway for anyone building collaborative tools or experiences. So pulling this all together, how should we think about using this feedback? How do we tailor it? Well, the results give us some pretty clear pointers. Auditory IBS feedback seems like a really good general purpose choice, especially for tasks involving movement, because it doesn't really interfere with your eyes or hands. Right.

But obviously it's not great if you're in a noisy place or if the task itself involves critical listening, like playing music or having a conversation. Okay. So where auditory doesn't fit, haptic comes in. Exactly. Haptic IBS feedback is a fantastic alternative then. It's silent, not bothered by noise, keeps things private, doesn't interrupt conversation. You need to be careful about the task, right?

Definitely. You wouldn't want it interfering if the task itself relies heavily on fine-tuned feelings in your hands or fingers, like intricate crafting, maybe surgery. Yeah, buzzing during surgery seems like a bad idea. Probably not ideal, no. So thinking about real-world applications, where could we see this being used effectively? Well, you mentioned physical therapy earlier. I think that's a great example. Imagine using auditory feedback to help strengthen that connection, that therapeutic alliance between a therapist and patient.

Yeah, it could boost motivation, maybe make it feel less clinical, more like a team effort. Precisely. Enhancing comfort, that sense of togetherness, while the patient can still focus on the physical task. What about something like brainstorming? Could this help teams gel better? That's another really interesting possibility, maybe using haptic feedback there. Why haptic? Because it could subtly enhance those feelings of closeness and trust, maybe make people feel more agreeable, without getting in the way of the actual talking and idea sharing.

Hmm, that's clever. Could that even work remotely, like over video calls? Potentially, yeah. Imagine using shared haptic feedback to create a sense of shared presence, of immersion, even when people are physically apart, fostering that we're feeling across distances. Okay, so wrapping this up, it seems like we've uncovered something pretty profound here about brain sync. Yeah, we really took a deep dive into interbrain synchronization today.

It's this amazing thing where our brains literally get on the same wavelength when we collaborate. And this research showed pretty convincingly that, yes, we can actually enhance that connection using external feedback. With auditory seeming to be the most consistently effective overall. Great, but haptic, showing its own unique strengths too, especially for privacy or when audio isn't suitable, and visual. Well, maybe needing a rethink.

It really makes you wonder, doesn't it? What a future tech could truly personalize this. Like, feedback that adapts not just to the task, but to your specific sensory preferences, maybe even your partner's. Imagine that. A future where you don't just feel like you're in sync, you have this subtle, unobtrusive feedback confirming that you are. Measurably. How different would collaboration be? Yeah. Or learning.

We're just connecting with people, whether they're right next to you or, you know, on the other side of the world. It definitely gives you something to think about. A future where we're consciously, technologically enhancing our connections. Well, thank you for joining us on this deep dive. We hope it's given you a bit of a shortcut to understanding IBS and maybe spark some new thoughts.