What will it take to make your house smarter than you? Judging from the price of smart appliances we see in the home centers these days, it’ll take buckets of cash. But what if you could make your home smarter — or at least more observant — with a few cheap, general purpose “supersensors” that watch your every move?
Sounds creepy, right? That’s what [Gierad Laput] and his team at the Carnegie Mellon Human-Computer Interaction Institute thought when they designed their broadband “synthetic sensor,” and it’s why they purposely omitted a camera from their design. But just about every other sensor under the sun is on the tiny board: an IR array, visible light sensors, a magnetometer, temperature, humidity, and pressure sensors, a microphone, PIR, and even an EMI detector. Of course there’s also a WiFi module, but it appears that it’s only for connectivity and not used for sensing, although it clearly could be. All the raw data is synthesized into a total picture of the goings on in within the platform’s range using a combination of machine learning and user training.
The video after the break shows the sensor detecting typical household events from a central location. It’s a powerful idea and we look forward to seeing how it moves from prototype to product. And if the astute reader recognizes [Gierad]’s name, it might be from his past appearance on these pages for 3D-printed hair.
[muA] tipped us off on this one. Thanks!
Very nice! Take my money, please.
Main thing missing is smell. Would be nice for it to tell the difference between “you’re brewing coffee” and “you’re brewing tea”.
Now one will know which visitor broke wind.
… and what they were eating
Smellivision! Live!
Cortana! What did George have for breakfast?
can someone tell me what the point of this is?
Software needs input. Inputs create hook points and events. Software then reacts in kind.
There are a couple of targeted gas sensors, for CO and NG, for instance, but it would be really nice to have a generic gas sensor.
Smell? Coming right up.
http://knowledge.electrochem.org/encycl/art-n01-nose.htm
As already mentioned there are sensors for specific molecules, for something general purpose you would need something like a mass spectrometer or ion mobility spectrometer. There has also been a class of chemical sensors that use the standing acoutic wave effect. I also read about a MEMS chemo sensor with piezo tuning fork elements treated with various reactants but I don’t think it has made it into commercial production.
Electronic nose technology makes use of the fact that most chemical sensors are nonspecific, but respond differently to different components of an odor. Since we patented it in 1987, it’s been picked up by the wine industry and parts of the food industry, and is being validated for use in detection of cancer.
and radiation detector… hard times require hard protection
holy shit! thats way cool!
Neat.
I wonder how hard it would be to mesh several sensors to cooperate on detecting… for example *where* in the room an event is taking place…
Actually, it almost could with just one. Notice somewhere in the video where it detected the left and right faucets being used. If their software is as easy to use, registering appliance/tools should be as easy as recording the sensor-signature it makes, and label them as such. A row of faucets would sound the same, but the level of noise those make are different depending on it’s distance to the sensor. Theoretically, if the sensor is sensitive enough it should be able to cover the whole house.
*ALERT*
“Cat is on kitchen counter. Shattering plate on kitchen floor. Cat is licking the butter on kitchen floor.”
I would even say that with 3 sensors you can use triangulation, and with 4 it gives you the ability to find the height. After that the more you have, the better!
I love it. THIS, I would have in my house.
Good work!
Amazing, This is the kind of after market tech that I want to see more of in the future.
I like how this approach is almost how a person would sense things around them, which is also susceptible to being tricked easily.
I would be less concerned about them being tricked and more concerned about them being confused. However, with enough training it could do a pretty good job… but it requires a lot of training. :/
Here’s what it should look like:
https://upload.wikimedia.org/wikipedia/commons/thumb/f/f6/HAL9000.svg/220px-HAL9000.svg.png
“What will it take to make your house smarter than you?”
Is it smarter than a fifth-grader?
Status: “Billy is masturbating in the upstairs bathroom.”
To detect that you need to train the sensor by having billy to masturbate on and off until it recognizes it. Even more creepy.
Mechanical turk, I’m sure there are creepy parents out there…
So it’s sort of like a spectrum sensorlyzer.
When it was detecting the toothbrush it reminded me of the scene in Electric dreams when Edgar ( the computer) was trying to work out what the noise in the bathroom was ( electric razor)
Is this thing going to lock me out of my house and try and steal my girlfriend :o
Where can i buy one?
It looks like an Industrial Psychologist’s dream.
But would it be good for workers? Or could it manufacture a future of Tesla and Amazon wageslaves driven to exhaustion?
Also, with the IOT, I worry about eventually non-updating devices connected to the internet which are powerful enough to cause harm if they’re pwnd and botnetted. We should always see a compromise as when, not if.
Like they aren’t already?
Out of curiosity, what would you feel about setting something up similar via POE hardwired? That way the signal cannot be scraped, and you can choose how much info is release outside of the LAN or firewall.
I’m working on something similar, running 1wire over Cat5/6. The sensor boards I have designed have temperature, humidity, 2 x PIR, IR TX/RX, Audio (locally stored chimes only, not much bandwidth available), light, air quality (MQ135), carbon monoxide (MQ7), and for bathrooms, hydrogen sulphide (MQ136 – these sensors cost a bit so they are optional). I’ll be open sourcing the boards, firmware, enclosures & submitting OWFS patches upstream shortly. I’ll post a project to Hackaday when it’s all ready.
I can’t wait to see them!
THAT IS AMAZING…..ly similar
http://www.st.com/en/evaluation-tools/steval-stlkt01v1.html
Net Neutrality. Privacy.
Great if you are a single threaded CPU, but I’m more of a quad core…I do multiple threads at the same time. How does it handle that?
This is so cool. I wanna play ;-) Seriously though, is the hardware and software available?
How much training does it need to personalize it for a particular kitchen/room/task?
This is a great example of sensor fusion. Thanks for reminding me how it can be done.
Cool. Very cool. I see it on battlefield. Couple of them will make picture of the area. Computer will process the data, make picture, AI analyze situation and propose strategies for commanders. Its compatibile with US strategy of giving more responsibility for lower levels of command. They need “eyes”.
Detecting/identifying location of people and animals in the house should be pretty easy based on footstep vibration in the floor. In my house the floors squeak so it would be especially easy.
In terms of training, this is the first compelling use for IOT I have seen.
This is a great example of truly disruptive technology. I bet the refrigerator manufacturers are damned embarrassed that the best they could do was an app where you could tell the fridge to make more ice.
Integrate all this into a new apartment complex… The building calls the cops if the music is too loud. Tracks the coming and going of tenants. The kitchen knows when you cook fish and your mailbox is submitted for targeted ads plus informs you when your mailbox is full. The plumbing bill for that clogged sewer is directed the the apartment that caused it. Mice and cockroaches are detected and the exterminator called. Your physician and employer can check your sleep patterns the picked up by the floor sensors. Grandma fell down and broke her hip, the ambulance is called.
I like it but also see it’s 1984 on steroids. We’ll have to protect privacy rights starting right from the beginning…. which is now.
nope….get rid of the “cloud” (or at least have it optional) and I’m there, but everyone wants rent these days
I actually do NOT want it on the “cloud”. No, POE connectivity throughout…