Honorable Mention: Wheeler: A Three-Wheeled Input Device for Usable, Eficient, and Versatile Non-Visual Interaction
Md Touhidul Islam, Noushad Sojib, Imran Kabir, Ashiqur Rahman Amit, Mohammad Ruhul Amin, and Syed Masum Billah. 2024. Wheeler: A Three-Wheeled Input Device for Usable, Efficient, and Versatile Non-Visual Interaction. In Proceedings of the 37th Annual ACM Symposium on User Interface Software and Technology (UIST '24). Association for Computing Machinery, New York, NY, USA, Article 31, 1–20. https://doi.org/10.1145/3654777.3676396
Blind users rely on keyboards and assistive technologies like screen readers to interact with user interface (UI) elements. In modern applications with complex UI hierarchies, navigating to different UI elements poses a significant accessibility challenge. Users must listen to screen reader audio descriptions and press relevant keyboard keys one at a time. This paper introduces Wheeler, a novel three-wheeled, mouse-shaped stationary input device, to address this issue. Informed by participatory sessions, Wheeler enables blind users to navigate up to three hierarchical levels in an app independently using three wheels instead of navigating just one level at a time using a keyboard. The three wheels also offer versatility, allowing users to repurpose them for other tasks, such as 2D cursor manipulation. A study with 12 blind users indicates a significant reduction (40%) in navigation time compared to using a keyboard. Further, a diary study with our blind co-author highlights Wheeler’s additional benefits, such as accessing UI elements with partial metadata and facilitating mixed-ability collaboration.
https://dl.acm.org/doi/10.1145/3654777.3676396
Transcript 2,313 words
Today we're looking at the future of digital accessibility. We're moving past beyond screen readers and into a whole new way that blind users can experience the digital world. Yes, we're diving into the research behind Wheeler, which is a new input device. And it's got three wheels. It's designed to be much more intuitive and efficient than what's currently available. And they claim it's going to be, according to the researchers, usable, efficient, and versatile.
So what is Wheeler and why is it such a big deal? Well, imagine for a second a computer mouse. Okay. Now, in your mind, replace the trackball with three rotating wheels and then add two side buttons. That's the basic design. Sounds simple, but it has huge potential for how blind users can interact with everything from software to just basic cursor control. I can see why we're intrigued by the three wheels.
Yeah. But the researchers, they start by outlining the problems with the traditional keyboard and screen reader setup, calling them cumbersome and time-consuming, especially for navigating menus or using anything graphical. And that's an important point because while keyboards and screen readers are, of course, essential, they kind of force you into this linear way of navigating. What this new device wants to do is create a more spatial interaction with digital hierarchies.
This approach could really change the game when you're talking about moving through lots of menus or options. They call the two methods of interaction H-NAV for hierarchical navigation and C-DNAV for two-dimensional navigation. So let's start with H-NAV. How do the wheels actually function within that framework? So with H-NAV, each wheel corresponds to a different level in the hierarchy of a particular application.
So think about the ribbon menu in Microsoft Word. The first wheel might let you switch between the main tabs, and then the second wheel would handle the options within each of those tabs. And then the third wheel, that one would allow you to access any submenus that are even deeper in. So instead of tabbing through each option, you could quickly move between sections using the wheels.
Exactly. And they actually give an example of this in the paper. They show how navigating between really deeply nested menus, which would usually take a bunch of keystrokes, can be done with just a couple of spins on the wheeler. That sounds much faster. It would be a huge time saver for someone who uses those kinds of applications all the time. And it's not just about speed. This is about making the experience more intuitive.
You know, blind users have to rely on their mental model of an interface. And this seems to offer a much more direct and tactile way to interact with that model. It's almost as if they're taking that digital hierarchy and sort of projecting it onto the physical world with these wheels. But let's move on to Cubity Nav Mode. This one sounds like it's designed for interacting with graphical elements.
You got it. Techie Nav Mode lets Wheeler work a lot like a mouse, but with some features that are made specifically for blind users. Two of the wheels control horizontal and vertical movement, which you'd kind of expect. But it's the third wheel that really sets this device apart. So is the third wheel like an accelerator or a brake for the cursor? Exactly. It gives the user control over the speed of the cursor, and it can be adjusted on the fly.
The paper stresses how important this level of control is for blind users because they don't have visual cues. So they have to depend on audio feedback to figure out where they are on the screen. That's so important. It's not just about moving the cursor, but being able to do it accurately and with confidence, even though you can't see the screen. And there's another key point they make about Tati Nav Mode.
It lets you get to what the researchers call blind spots in digital interfaces. Blind spots. What do they mean by that? They're talking about places within apps or websites that are really hard, maybe even impossible to reach if you're just using a keyboard. It could be graphical elements that aren't labeled well enough for screen readers, or maybe just areas that weren't designed with keyboard navigation in mind.
So because Wheeler gives you such fine-tuned cursor control, it can actually let users get to and interact with these areas where a keyboard just wouldn't cut it. That's right. And the paper makes it clear that Wheeler isn't just giving audio feedback for movement. It's also giving feedback for where that cursor is within the interface, which helps a lot with navigation. That's really clever. Combining the spatial awareness you get from the wheels of very specific audio cues creates a whole new way for blind users to understand and interact with the digital world.
But did they test this? I mean, did it actually work? They did. They had 12 blind participants try out Wheeler in a study doing tasks involving both navigation and cursor control. And the results were really impressive, especially when it came to navigating things like software menus, those hierarchical structures. And what about the participants? Did they find Wheeler easy to use, intuitive? That seems to have been a really positive part of the research.
Not only was the device a lot faster, with navigation times dropping by something like 40%, but the people using it also said that it was fairly straightforward to learn and use. That's critical. Because you could have an incredibly powerful device, but if it's too difficult to pick up, it's not going to make a real difference. And they didn't stop there. They went on to do a diary study with one of the authors, who was actually blind, to see how Wheeler would work in everyday life.
So they went beyond just lab settings and looked at how someone would use it naturally. What did they find out? They found that it could be used for so many things. The author was using Wheeler not only for tasks he'd struggled with in the past, but for completely new things. He found it helpful for getting around on websites that weren't designed with accessibility in mind, and even for giving technical help to other people.
So it actually became more than just an assistive device. It was a tool for collaboration. Yeah. A way to connect people with different abilities. Absolutely. And it really highlights something important about designing inclusively. A lot of times when we make things more accessible, we end up with benefits that go way beyond what we originally intended. And the researchers do hint at other potential applications for this tech. What else are they thinking?
One area they mention is virtual reality. Think about the challenge of navigating a three-dimensional environment when you can't see. The spatial input you get from Wheeler, combined with the audio feedback, could make these spaces much more intuitive and immersive. It's like this technology could open up entirely new worlds, not just for blind users, but for anyone who's looking for a more natural and intuitive way to interact in virtual environments.
And it goes beyond just VR. They also talk about using this kind of technology to interact with complex data sets. Imagine exploring a spreadsheet or a scientific visualization through touch and sound. That could revolutionize not only how we analyze data, but also how we learn. It could give students of all abilities a more engaging and multisensory way to understand complex ideas. The main takeaway here is that the potential for this technology is huge.
It goes way beyond what it was originally designed for. By rethinking how we interact with technology, the researchers have opened up a world of possibilities. That's exactly why we do these deep dives. To find these hidden gems, these sparks of brilliance, that could change the way we think about and use technology. But it also begs the question, what's next? Yeah, it is. It's really something else.
And what's amazing is that they weren't just trying to kind of copy what already exists, but make it for a new audience. They actually found areas where user experience was completely missing in current assistive tech and decided to do something about it. It sounds like they found a group of users who are more than ready to embrace those innovations, not just because they're new, but because they actually address real needs.
But to go back to the research for a moment, you mentioned a diary study with one of the paper's authors. Yeah. So this part was all about taking Wheeler out of the lab and seeing how it worked in the real world. The author, who's blind, actually used it in his everyday life. Well, it's one thing to, you know, optimize for certain tasks in a controlled setting, but it's a whole other thing to see how something gets used organically day to day.
What came out of that part of the study? What they found was just how flexible this device could be. The author was using Wheeler not just for things that had always been difficult, but for things he'd never even thought of doing before. He used it to get around on websites that weren't really designed with accessibility in mind. He even used it to give tech support to other people.
So in a way, it stopped being just an assistive device and became something more, a tool for connection, for breaking down barriers between people. Exactly. And it speaks to a larger point about how we design things. When we prioritize making technology accessible, we often end up with things that are better for everyone, not just the people we initially had in mind. And the researchers themselves suggest that there are even more applications for this kind of technology, right?
What other possibilities did they bring up? They specifically mentioned virtual reality. Think about how difficult it must be to navigate a three-dimensional space when you can't see. The kind of spatial input and audio feedback that Wheeler provides could completely change how people experience those environments. It's as if this tech could open up entire worlds. And not just for blind users, but for anyone who wants a more natural way to interact with virtual spaces.
And it doesn't stop at virtual reality. They even talk about using this to interact with complex data. Imagine exploring a spreadsheet or a scientific visualization using touch and sound. Now that would be a game changer, not only for how we analyze data, but also for education. You could have students of all abilities engaging with really complex ideas in a much more hands-on, multi-sensory way.
The biggest thing to take away from this is that this technology has the potential to be so much more than what it was originally designed to be. They've really opened up a world of possibilities by rethinking how we interact with technology. And that's really what these deep dives are all about. Uncovering those hidden gems, those moments of brilliance that make us rethink how we use technology.
But it also leaves us with a question. Where do we go from here? It's exciting to see this kind of shift, you know, going from just adapting what we already have to really rethinking how we interact with tech from the ground up. It really is a different way of thinking about it. This research is a challenge for us to stop treating accessibility as something we tack on at the end.
Something we have to check off a list. It's saying we should think about it right from the start as a core part of the design process. It seems that the team behind Wheeler has done something pretty amazing here. It's not just a tech solution. It's a whole new way of thinking about design. Yes. And it's a philosophy that's focused on what's possible, not on what's limited.
It's about understanding that the ways we interact with tech right now might work for a lot of people, but they leave a lot of people out too. And by doing that, we limit ourselves. We miss out on all those different perspectives, those different ways of experiencing and engaging with the world. Think about it. The technology we have now, it's all built on certain assumptions.
A mouse, a keyboard, a touch screen. They all assume that you can see. But Wheeler, it makes us think beyond vision, right? It offers a way to navigate the digital world that's more about touch, more about sound. And when you do that, you open up so many possibilities, not just for making technology accessible to people who are blind, but for creating totally new experiences for everyone.
It reminds us that sometimes the most innovative ideas come from the edges, from those places where we're forced to confront what we take for granted and to explore new territory. As we wrap up this deep dive, I have to say I'm feeling optimistic. The work on Wheeler gives us a glimpse of what we can achieve when we put inclusivity first and when we're willing to challenge the way things have always been done.
It's a call to action for all of us, whether we're creating technology or just using it, to embrace that spirit of innovation and work towards a digital world that truly is accessible for everyone. Because when we design with everyone in mind, we all win. We all benefit from the incredible things that become possible. And that brings this deep dive to a close.
We'll see you next time.