Vocal mouse control

Absolutely fascinating. The University of Washington is developing a vocally controled mouse interface. We’ve seen vocal control of the computer before, but it is usally responding to specific commands and words to carry out tasks such as opening files.  This system uses different vowels and sounds to create cursor motion.  You can see the same system used in the video above to control a robot arm as well.

[via BotJunkie]


  1. Skitchin says:

    Good luck. I can barely give vocal direction to humans telling them where I want them to click.

  2. Spender says:

    Can I get this software somewhere?

  3. me says:

    Too bad if he looses his voice he will no longer be able to play card games anymore

  4. kyle says:

    I remember this from a few years ago, the video looks a little older too.

  5. Jerome says:


    We did the EXACT same thing for a session project at the University of Sherbrooke. Are second semester in electrical engineering. Instead of using software it was all done with hardware (filters and a FPGA). We where using 4 phoenemes to control a home made video game.

  6. BigD145 says:

    You can do similar with voice recognition software. I think it’s Dragon that lets you kick up a grid on-screen. It’s 9×9 and you just narrow down your selection with a few words and then “click.”

  7. srilyk says:

    I want to see him playing counterstrike! How cool would that be??

    “ahhh, ahh OOOO ch ch ch!!!”

  8. Brandonman says:

    Cool. I know someone who was in a car accident with limited arm movement (Can basically flail their arms, no real control yet). I’ll have to check this out.

  9. t0ny says:

    I just came up with that idea a few days ago!

  10. Zagro says:

    Took them long enough to think of this!!!!!!
    Watch the software gona cost a bloody fortune.

    Quick quick Everyone Make a clone of this for every O/S you can think of :)

    Don’t forget Click/drag and R/mouse.

    And since Voice recognition is so slow. how about a phonim keyboard. :)

    (amagens folks running around sounding like old analog computers talking to each other)

  11. Ryan Leach says:

    Now what would be cool if he could control his whelchair like that, i mean…

    accelerate slow down

    it would be completely natural.

  12. Vander says:

    Since I saw the NeuroSky stuff (brain control), this is kind useless

  13. antiver says:

    What happened to loading up a 3×3 grid on the screen, you say a number 1-9, then a new 3×3 grid appears in the previous square you just chose, you say a number 1-9 to narrow it down… this recurses… until you say “click” and it it clicks in the middle of the “5” square you’ve narrowed down to.

    I know I’ve seen that implemented somewhere.

  14. Amnon says:


    There is a voice/speech controlled Wheelchair

    This is mine : http://hackaday.com/2008/05/17/voice-controlled-wheel-chair/

    and there is a better one.


  15. philip travers says:

    I bet you have heard of throat singing.How about a work out with that!? In fact a few lessons in modified diaphragmatic breathing could help.And a Russian scientist who created a breathing technique to help asthmatics could be worth an investigation,where there is a possibility of use.And dont forget American Indian languages,which maybe,more breatheee,and allow for instruction anew.It also struck me then,that a lot of sounds humans make are occupational related,like being in a dentist chair,say Ahhh.Translating these basic sounds to categories of words pictures instructions,could end up as shortcuts delivered say in a dental circumstance,for wheel chaired bound as clients or professionals.And adding whistles and bells too.Blah.Blah.Blah.

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s


Get every new post delivered to your Inbox.

Join 96,754 other followers