Exploring the Alteration and Masking of Everyday Noise Sounds using Auditory Augmented Reality

0:00Welcome back, everyone. Today we're diving deep into sound. Sound indeed. Specifically, how technology might soon allow us to reshape our sonic experiences. Precisely. We'll be examining a paper from this month's International Conference on Multimodal Interaction. The title is a mouthful. It is. It's called Exploring the Alteration and Masking of Everyday Noise Sounds Using Auditory Augmented Reality. Auditory Augmented Reality kitschy. The paper's focus is on not just blocking out noise, which we're all familiar with, but selectively changing it.

0:33And doing so based on its category and how much it matters to the listener. That's right. It's almost as though we could have a world where technology filters out the annoying and amplifies what we want to hear. A world where we curate our own soundscapes. Let's start by defining noise. The paper emphasizes it's not simply about loudness. Not just decibels. Right. It defines noise as any unwanted or unpleasant sound that disrupts our peace.

0:57So a dripping faucet could be noise even if it's very quiet. Exactly. It's about the disruptive nature of the sound, how it impacts us. These unwanted sounds can impact our concentration, reduce our productivity. And even cause stress. The paper highlights that a sound's annoyance isn't solely determined by loudness. Yes. A critical factor is the sound's relevance to you at any given moment.

1:18So a jackhammer outside might be less annoying than someone whispering if you're trying to concentrate. Precisely. This builds on the work of researchers Saylor and Hassenzhal. Who studied noise annoyance. Yes. They emphasize the role of informational content in how we perceive noise. So the meaning of a sound influences how annoying we find it. Correct. To delve deeper, the paper explores four noise categories.

1:43Sounds from living beings. Birds chirping, dogs barking. Yes. Then there are mechanical noises. The hum of an engine, the whir of a fan. Then environmental sounds. Rain, thunder, wind. And finally, relevant noises, which is an intriguing category. We'll come back to relevant noise. But first, can we explore this auditory augmented reality? Certainly. It sounds futuristic. Think of it as digitally adding a layer of sound on top of the real world.

2:09Oh, it's like a sonic filter. It goes beyond simple noise cancellation. It's about modifying and shaping the soundscape around you. Auditory augmented reality, or AAR for short. Yes, that's right. So instead of just blocking sounds out, we're altering them in real time. Precisely. The paper references a taxonomy by Krasaniak and others that outlines how this might be achieved. So how would this work in practice?

2:33Well, it could involve blending real and digital sounds, placing specific sounds in precise locations. So you could make a bird sound like it's right next to you, even if it's far away. That's one possibility. It also involves enriching audio with additional information, and of course, the real-time modification we just discussed. This real-time modification is key. Absolutely. It's about dynamically altering sound as it happens.

2:57So let's see if I understand this. Someone could theoretically walk down a busy street. Yes. And have their AIR technology replace the rumble of traffic with the sound of ocean waves. That's the concept. It's about crafting a personalized soundscape. One that adapts to your needs and preferences in real time. Fascinating. How did the authors of this paper explore these ideas? They conducted an online survey with 124 participants.

3:21To understand how people would use AAR to manage different types of noises. Yes. They presented participants with various noise scenarios and asked how they would prefer to modify them using AAR. So not just asking if they liked or disliked a sound? Correct. They went deeper. Participants were given six AAR strategies to choose from. Six different ways to modify a sound. Precisely. They could choose to keep the noise unchanged, make it more pleasant, obscure it with other sounds.

3:49Or reduce its volume, remove it completely, or replace it with something else. A range of options from subtle tweaks to a complete sonic overhaul. Yes. And these strategies were grouped into no augmentation, light augmentation, and substantial augmentation. To reflect the degree of change applied. Exactly. What were the key findings from this survey? One major finding was that as noise annoyance increased, people wanted more substantial changes.

4:12Makes sense. If a sound is truly bothersome, we want to do more than just tweak it. Of all the AAR strategies, which one was most popular? Reducing the volume. It seems people don't always want to eliminate sounds completely. They just want to make them more manageable. That's right. Makes sense. I imagine preferences would also depend on the type of noise. You're right.

4:34The study found that mechanical and environmental noises were generally perceived as more annoying. More so than sounds from living beings. Or those relevant noises we touched on earlier. Let's return to that category of relevant noise. What makes a sound relevant? In this study, relevant sounds are those that participants wanted to remain aware of. Because they contained useful information. Exactly. Even if a sound is loud or distracting, we might choose to keep it if it tells us something important.

5:03So a fire alarm would be considered relevant, even if it's jarring. Precisely. The study found that sounds with clear informational content, like someone calling your name, were considered less annoying than those with less informational content. Such as someone chewing gum nearby. The more relevant a sound, the less likely participants wanted to heavily modify or suppress it. They preferred to keep those valuable sounds, perhaps with some minor adjustments for comfort.

5:29This brings us to an intriguing finding about footstep noise. Yes. Footstep noise was a unique case. How so? Participants consistently preferred to keep or lightly augment footstep sounds, regardless of relevance. So even if someone's footsteps were irrelevant to their task, they still wanted to hear them. That's right. Why do you think that is? The researchers speculated it might be due to the nature of the sound.

5:54Footsteps are generally low frequency, fairly predictable. And significantly, they provide information about someone's presence and movement. So even if we don't consciously register it, hearing footsteps might give us a sense of who's around and what they're doing. It suggests a deep connection between sound and our awareness of our environment. We might instinctively want to retain certain sounds, even if they're not directly related to our current task.

6:18Because they contribute to our overall sense of place and safety. It makes you realize how much we take our hearing for granted. It's a powerful sense that shapes our experience of the world in countless ways. This research highlights the potential for technology to do more than just manage unwanted sound. It suggests we could enhance our auditory perception in ways we never imagined.

6:39Where do we go from here? What are the potential applications of this AAR technology? The possibilities are vast. Imagine personalized soundscapes that adapt to your preferences. Filtering out distracting conversations in a bustling cafe. Enhancing the sounds of nature on a walk in the park. Or even providing subtle auditory cues to help with navigation. And this isn't just science fiction. The technology is advancing rapidly.

7:04We could be on the verge of a sonic revolution. Where we have far more control over our auditory experience than ever before. Which raises important questions about responsibility ethics and the potential impact of this technology. We need to consider not just how to eliminate annoying sounds. But how to fundamentally change how we interact with our sonic environment. It's a conversation we need to have now as this technology develops.

7:27We'll be exploring those questions and more in part two of this deep dive. Stay tuned. Picking up where we left off. With those possibilities for a sonic revolution. Yes. Let's consider what this level of sonic control could mean for our daily lives. It's quite a concept to have the power to curate our own soundscapes. The authors of the paper highlight some intriguing possibilities.

7:50Oh. Imagine AAR systems that can instantly categorize noise types. And then adjust the augmentation based on your preferences. That's right. So if I've programmed my AAR to know that I dislike leaf blowers. It could automatically mute them whenever they start. Wow. Or it could identify the sound of my best friend's voice. And ensure it remains clear even in a crowded room. No more what did you say?

8:13Moment. Exactly. The possibilities for filtering and enhancing are vast. The paper also mentions using head movements and gestures to control AAR. Yes. Imagine being able to simply turn your head away from a sound you don't want to hear. So at a noisy conference, I could focus on a particular speaker just by facing them. That's the idea. It could offer a new level of control over our auditory attention.

8:36And what about this deep learning they mention? Could it really recognize situations and adapt the soundscape accordingly? That's the concept. So I could sense I'm about to cross a busy street. And amplify the sounds of approaching traffic to ensure my safety. It's both impressive and a bit unsettling to think about. You raise a valid point. It's crucial to consider the potential downsides of such powerful technology.

9:01If we can completely personalize our soundscapes, are we at risk of shutting out the real world? It's a valid concern. Imagine walking down a vibrant city street, but only hearing music from your earbuds. You would miss the street musicians' melodies, the laughter of children playing. We might lose touch with the richness and unexpected nature of real-life sounds. Precisely. And then there's the potential for AAR to be used in ways that are manipulative or even harmful.

9:26Can you give an example? Consider targeted advertising utilizing AAR to send personalized messages. Based on my location or emotional state? Exactly. Or what if AAR was used to subtly alter the sounds of a political speech to spread misinformation? That's a disturbing thought. These are serious concerns we need to consider as AAR technology evolves. We need to ensure it's used responsibly and ethically.

9:50Absolutely. With safeguards in place to protect individual privacy and autonomy. It seems we're facing a classic technological dilemma. Incredible potential, but also the possibility of misuse. That's the challenge with any powerful new tool. How do we harness its benefits while mitigating its risks? Open discussion is crucial. We need to have conversations about the potential benefits and risks of AAR. And involve a diverse range of voices in those conversations.

10:17Technologists, researchers, ethicists, policymakers, and of course the public. It is everyone's soundscape after all. This research is a valuable starting point. It highlights the possibilities of AAR. And prompts us to consider its potential impact on our experiences of sound. It reminds us that technology shapes and is shaped by our values. And by our understanding of the world. So what are the next steps in this exploration of sound?

10:40Further research is needed into personalized noise control. Exploring how AAR can adapt to individual preferences. We also need to investigate how AAR can be integrated with other technologies. Like wearable sensors and artificial intelligence. To create even more sophisticated soundscapes. It's an exciting area ripe for innovation. But as we've discussed, those innovations must be guided by ethical considerations. And a focus on human well-being.

11:06The future of sound is in our hands. Let's create a sonic world that is both technologically advanced and profoundly human. We've discussed the potential of auditory augmented reality to reshape our sonic world. But what does that mean for us on a personal level? How might AAR change the way we live, work, and interact with the world around us? Let's start with something many of us experience daily at the commute.

11:31Ah, yes. The joys of rush hour traffic. Imagine putting on AAR headphones and instantly transforming that noise into something more pleasant. So instead of honking horns and screeching brakes. You might hear the sound of a flowing stream or the calming rhythm of ocean waves. That could make the stressful commute a lot more bearable. And beyond blocking unwanted noise, AAR could also provide useful information.

11:54Like real-time traffic updates. Exactly. It could alert you to approaching sirens or give you turn-by-turn directions. Without having to look at your phone. Right. Making navigation safer and more efficient. What about in the workplace? AAR could transform the office environment. How so? By creating personalized sound zones. So I could block out distracting conversations while still hearing my colleagues. Precisely. It could also offer real-time language translation.

12:21That would be invaluable for international teams. It could break down communication barriers and foster collaboration. AAR could also have a significant impact on how we learn. Students could use it to focus on specific lectures or reduce distractions in a library. And language learners could immerse themselves in a foreign language environment. With AAR translating and clarifying what they hear in real-time. The educational applications are vast.

12:46AAR could also enhance our leisure time and creative pursuits. Music lovers could use AAR to create personalized concert experiences. Adjusting the volume of different instruments or isolating the vocals. Gamers could have more immersive experiences with AAR heightening the realism of gameplay. And for those who enjoy spending time in nature. AAR could amplify the sounds of birdsong and rustling leaves. It seems AAR has the potential to touch every aspect of our sonic lives.

13:16From the mundane to the extraordinary. As we embrace these possibilities, we should proceed with awareness and intention. We need to be mindful of the potential for AAR to create new forms of sensory overload. Or isolate us from the world around us. We want to use AAR to improve our lives without losing our connection to the natural soundscape. Perhaps the key is to use AAR selectively.

13:38As a tool to enhance our experience rather than replacing it entirely. Making conscious choices about how we want to experience sound. Rather than letting technology dictate our sonic reality. The future of sound is ultimately in our hands. We have the power to shape our sonic environments. And create a world that is both technologically advanced and sonically rich. It's an exciting time to be exploring the possibilities of sound.

14:02We've only just scratched the surface of what AAR might be capable of. As this technology continues to evolve, we encourage you to stay informed. Ask questions and be a part of the conversation about the future of sound. It's a conversation that affects us all. And one that has the potential to reshape our world in profound ways. Thank you for joining us on this deep dive into the world of auditory augmented reality.

14:24We hope you found it informative and thought-provoking. Until next time, keep listening. Thank you.