Vocal mouse control

posted Oct 10th 2008 8:51am by
filed under: Medical hacks, news, peripherals hacks

Absolutely fascinating. The University of Washington is developing a vocally controled mouse interface. We’ve seen vocal control of the computer before, but it is usally responding to specific commands and words to carry out tasks such as opening files.  This system uses different vowels and sounds to create cursor motion.  You can see the same system used in the video above to control a robot arm as well.

[via BotJunkie]



15 Responses to Vocal mouse control

  • Skitchin says:
    October 10, 2008 at 9:56 am

    Good luck. I can barely give vocal direction to humans telling them where I want them to click.

    Reply Report comment
  • Spender says:
    October 10, 2008 at 9:59 am

    Can I get this software somewhere?

    Reply Report comment
  • me says:
    October 10, 2008 at 10:23 am

    Too bad if he looses his voice he will no longer be able to play card games anymore

    Reply Report comment
  • kyle says:
    October 10, 2008 at 10:24 am

    I remember this from a few years ago, the video looks a little older too.

    Reply Report comment
  • Jerome says:
    October 10, 2008 at 1:36 pm

    haha

    We did the EXACT same thing for a session project at the University of Sherbrooke. Are second semester in electrical engineering. Instead of using software it was all done with hardware (filters and a FPGA). We where using 4 phoenemes to control a home made video game.

    Reply Report comment
  • BigD145 says:
    October 10, 2008 at 2:46 pm

    You can do similar with voice recognition software. I think it’s Dragon that lets you kick up a grid on-screen. It’s 9×9 and you just narrow down your selection with a few words and then “click.”

    Reply Report comment
  • srilyk says:
    October 10, 2008 at 5:31 pm

    I want to see him playing counterstrike! How cool would that be??

    “ahhh, ahh OOOO ch ch ch!!!”

    Reply Report comment
  • Brandonman says:
    October 10, 2008 at 10:08 pm

    Cool. I know someone who was in a car accident with limited arm movement (Can basically flail their arms, no real control yet). I’ll have to check this out.

    Reply Report comment
  • t0ny says:
    October 10, 2008 at 10:52 pm

    I just came up with that idea a few days ago!

    Reply Report comment
  • Zagro says:
    October 10, 2008 at 11:08 pm

    Took them long enough to think of this!!!!!!
    Watch the software gona cost a bloody fortune.

    Quick quick Everyone Make a clone of this for every O/S you can think of :)

    Don’t forget Click/drag and R/mouse.

    And since Voice recognition is so slow. how about a phonim keyboard. :)

    (amagens folks running around sounding like old analog computers talking to each other)

    Reply Report comment
  • Ryan Leach says:
    October 11, 2008 at 12:48 am

    Now what would be cool if he could control his whelchair like that, i mean…

    accelerate slow down
    WEEEEEEEEEEEEEEEEE AHHHHH

    it would be completely natural.

    Reply Report comment
  • Vander says:
    October 13, 2008 at 9:55 am

    Since I saw the NeuroSky stuff (brain control), this is kind useless

    Reply Report comment
  • antiver says:
    October 13, 2008 at 9:42 pm

    What happened to loading up a 3×3 grid on the screen, you say a number 1-9, then a new 3×3 grid appears in the previous square you just chose, you say a number 1-9 to narrow it down… this recurses… until you say “click” and it it clicks in the middle of the “5″ square you’ve narrowed down to.

    I know I’ve seen that implemented somewhere.

    Reply Report comment
  • Amnon says:
    October 17, 2008 at 7:33 am

    Ryan

    There is a voice/speech controlled Wheelchair

    This is mine : http://hackaday.com/2008/05/17/voice-controlled-wheel-chair/

    and there is a better one.

    Amnon

    Reply Report comment
  • philip travers says:
    October 27, 2008 at 5:20 am

    I bet you have heard of throat singing.How about a work out with that!? In fact a few lessons in modified diaphragmatic breathing could help.And a Russian scientist who created a breathing technique to help asthmatics could be worth an investigation,where there is a possibility of use.And dont forget American Indian languages,which maybe,more breatheee,and allow for instruction anew.It also struck me then,that a lot of sounds humans make are occupational related,like being in a dentist chair,say Ahhh.Translating these basic sounds to categories of words pictures instructions,could end up as shortcuts delivered say in a dental circumstance,for wheel chaired bound as clients or professionals.And adding whistles and bells too.Blah.Blah.Blah.

    Reply Report comment

    • Leave a Reply

    XHTML: You can use these tags: <a href="" title="" rel=""> <abbr title=""> <acronym title=""> <b> <blockquote cite=""> <cite> <code> <pre> <del datetime=""> <em> <i> <q cite=""> <strike> <strong>

    Hack a Day serves up fresh hacks each day, every day from around the web as well as hacking related news.

    Send us your hacks










         



    Hacks

    Resources