For [Ern]’s MEng group project, his group had to develop a robotics platform capable of achieving some end goal. Because innovation is a large part of the grade, [Ern] convinced his team members to work with a brain controlled interface and build a mind controlled robotics platform.
For wont of having an easy build, [Ern] and his team chose a Lynxmotion Tri-Track robot capable of moving around the classroom while receiving commands from a computer. The mind-control portion of the build comes from a NeuroSky MindWave Mobile, a cheap and fairly open EEG system that reads alpha, beta, and delta waves generated by a user’s brain and sends that data over to a computer for processing.
After a bit of testing that included an Arduino to move the robot forward if the MindWave’s ‘attention’ value was over 60%, [Ern] and his team looked for a way to implement multi-directional control.
In order to get the robot moving left, right, and backwards in addition to moving forwards, the team looked at the included ‘blink detection’ abilities of the MindWave to cycle through a few commands. This technique turned out to be far too sensitive – the blink detection of the MindWave is simply too good. To get around that problem, the team used the signal strength of the received EEG signals. The theory being when a user blinks their eyes, the EEG contacts will move slightly, degrading the signal received by the hardware.
The team finally got a reasonable mind-controlled robot up and working, as demonstrated in the video after the break. Check out how each blink allows [Ern] and his colleagues to cycle through driving modes. Pretty neat for controlling something with your mind.
[youtube=http://www.youtube.com/watch?v=0-YuF9z5-uI&w=470]
MEng, as in Master of Engineering?
interesting project, but detecting blinks isn’t really “mind control”, is it?
I suppose it would depend. I would still count it as mind control if the device was sensing the electrical impulses in the nerve, which it seems to be doing.
Hey,
Glad you like the project :D
The blinks aren’t really brain-actuation, they’re more a change in the signal quality based on movement of the skin, so a different physiological interaction.
But the start/stop functionality is triggered using a value output by the Mindwave headset which relates to your concentration level. It’s a proprietry algorithm but I suspect they use a weighted average of the Alpha, Beta and Gamma brain waves at that electrode position.
Ern
hey ern great job..
can u please let me know how to do it at home..
i was very fascinate in the mindwave so i had already bought the mindwave headset
but the arduino control is not possible… as the bluetooth modem i am using is hc 05 nd pairing is not efficient plz let me know if u can help me out..
please send me the program as well…
Thanksss …
I agree, this is not mind control any more than using a joystick is mind control…since your mind controls you thumbs and all
Hey,
I agree that the directional controls are not mind control, but the blinks just set the drive mode (forward, back, left and right), and don’t actually move the robot. The actual movement is triggered by concentrating which causes the “attention” value to increase. So it’s not fully mind controlled but it is partially :)
Ern
what are you thinking to move forward,backward,left,right,, also how to clasify each, what algo did you use (i.e. Hidden Markov Model, Artificial neural network, Gaussian mixture model etc., what did you use, MVAR,AR,PCA
also correct me if i am wrong
blink,think of moving to the left,blink, execute move to the left, Attention>Threshold, Move?
how long do i need to think of moving to the left to execute it?
how long does it take to turn in a certain direction?
thanks in advance
Facial/Gesture Recognition, Neural Interfacing, dynamic perching, physical/electronic weaponized , Decentralized & Distributed command & control…
Its all part of this wonderfully wacky world of wonder.
Just until they decide to use their own on-the-fly protocols to communicate….
SkyNET
;-)
cant u make the robot to move by just using mind without making use of blinks
What is the logic u have used for making the robo move forward . We are trying to do a project based on mindwave.So , can you send me the programs used in your project.
Hi Ern, can you tell me the way you detecting the blinkStrength for arduino?
I have a project related with the blinkStreng parameter from the headset, but i’m still stuck in it..
hello guys
I have a Neurosky Mindwave headset ( white color with USB RF dongle ). I want an Arduino code that make me able to use Eye blink detection. For example, I have RGB LED and the Neurosky Mindwave. When I wink, the RGB LED turns respectively Red, Green, and Blue which is the natural mode. if I wink on the Red color, the RGB turns Red for 5 seconds the back to the natural mode.
please help me.
I am waiting for your response
Sincere thanks and appreciation
hi! I am getting the same problem, did you managed to solve it? In case you did, could you send me the code for arduino? Thank you! onescerebrals.tdr@gmail.com
Hello
I am trying to get blink data from arduino and mindwave but I am stuck on it. Could you send me the code for eye blink or contact me? It would be an enourmous help. Here my e-mail: onescerebrals.tdr@gmail.com
I wait for your response,
Thank you.
Hello
I am trying to get blink data from arduino and mindwave but I am stuck on it. Can you please help me with the code. It would be really helpful.
Thanks