Controlling a mouse with your voice

It’s entirely possible to use a computer without the aid of a mouse or trackpad. Shift and arrow keys will get you very far, but that is entirely too taxing. [Stephen] came up with a really neat way to control a mouse with your voice, a project that is sure to find its way onto the desktops of those with mobility issues very quickly

The voice controlled mouse works in conjunction with the voice recognition built into OS X, a little AppleScript, and a touch of Python. When the user says, ‘show grid’ a 10 by 10 grid numbered 1 to 100 is displayed on the screen. By saying ‘thirty five,’ the cursor moves to the 35th cell in the grid. From there, the mouse can be controlled by speaking cardinal directions such as South and Northwest.

[Stephen] put up a very clever demo of his Voice Mouse project available after the break. Even though he did have a little difficulty with his mac recognizing a few of his spoken commands its light years ahead of trying to navigate the web with just shift and arrow keys.

24 thoughts on “Controlling a mouse with your voice

  1. I was just thinking about that idea a couple of days ago. What a boon for quadriplegics or other (temporarily) incapacitated/bedridden people by allowing them to communicate via computer with people or robotic assistants.

  2. Not to disparage [Stephen], but this is exactly how the built-in voice recognition in Windows 7 works. One minor difference in that the Win7 voice control uses subdivided grids, not cardinal directions after the rough target is selected.

      1. just goto wase of access in control panel. i used it for the better part of a year after my hp mini drank a pepsi then a day later drank some coffee and refused to let me type on it anymore. works great. nice to see a homebrewed variety.

  3. Dragon dictation software has had this feature for some years. Nevertheless this is some good coding.
    Shame it is still quicker to use a mouse.

    1. Yeah I was going to say, I remember this exact process being called up through the “mouse grid” voice command several years ago with Dragon.

      I understand the value in doing something yourself, but this seems mostly inferior.

    2. It seems like with a slightly more accurate speech recognition module (like Dragon), you could get used to it after awhile.

  4. something windoze 7 had for quite long. I liked it there but at least with my mics the recognition quality sucked a bit.. but usable enough.

  5. nancy: i want this project as its my final yr project topic.. can you plz provide me the source code and SRS of this project??

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s