Absolutely fascinating. The University of Washington is developing a vocally controled mouse interface. We’ve seen vocal control of the computer before, but it is usally responding to specific commands and words to carry out tasks such as opening files. This system uses different vowels and sounds to create cursor motion. You can see the same system used in the video above to control a robot arm as well.
15 thoughts on “Vocal Mouse Control”
Good luck. I can barely give vocal direction to humans telling them where I want them to click.
Can I get this software somewhere?
Too bad if he looses his voice he will no longer be able to play card games anymore
I remember this from a few years ago, the video looks a little older too.
We did the EXACT same thing for a session project at the University of Sherbrooke. Are second semester in electrical engineering. Instead of using software it was all done with hardware (filters and a FPGA). We where using 4 phoenemes to control a home made video game.
You can do similar with voice recognition software. I think it’s Dragon that lets you kick up a grid on-screen. It’s 9×9 and you just narrow down your selection with a few words and then “click.”
I want to see him playing counterstrike! How cool would that be??
“ahhh, ahh OOOO ch ch ch!!!”
Cool. I know someone who was in a car accident with limited arm movement (Can basically flail their arms, no real control yet). I’ll have to check this out.
I just came up with that idea a few days ago!
Took them long enough to think of this!!!!!!
Watch the software gona cost a bloody fortune.
Quick quick Everyone Make a clone of this for every O/S you can think of :)
Don’t forget Click/drag and R/mouse.
And since Voice recognition is so slow. how about a phonim keyboard. :)
(amagens folks running around sounding like old analog computers talking to each other)
Now what would be cool if he could control his whelchair like that, i mean…
accelerate slow down
it would be completely natural.
Since I saw the NeuroSky stuff (brain control), this is kind useless
What happened to loading up a 3×3 grid on the screen, you say a number 1-9, then a new 3×3 grid appears in the previous square you just chose, you say a number 1-9 to narrow it down… this recurses… until you say “click” and it it clicks in the middle of the “5” square you’ve narrowed down to.
I know I’ve seen that implemented somewhere.
There is a voice/speech controlled Wheelchair
This is mine : http://hackaday.com/2008/05/17/voice-controlled-wheel-chair/
and there is a better one.
I bet you have heard of throat singing.How about a work out with that!? In fact a few lessons in modified diaphragmatic breathing could help.And a Russian scientist who created a breathing technique to help asthmatics could be worth an investigation,where there is a possibility of use.And dont forget American Indian languages,which maybe,more breatheee,and allow for instruction anew.It also struck me then,that a lot of sounds humans make are occupational related,like being in a dentist chair,say Ahhh.Translating these basic sounds to categories of words pictures instructions,could end up as shortcuts delivered say in a dental circumstance,for wheel chaired bound as clients or professionals.And adding whistles and bells too.Blah.Blah.Blah.
Please be kind and respectful to help make the comments section excellent. (Comment Policy)