It’s ridiculously easy to take a bad photograph. Your brain is a far better Photoshop than Photoshop, and the amount of editing it does on the scenes your eyes capture often results in marked and disappointing differences between what you saw and what you shot.
Taking your brain out of the photography loop is the goal of [Peter Buczkowski]’s “prosthetic photographer.” The idea is to use a neural network to constantly analyze a scene until maximal aesthetic value is achieved, at which point the user unconsciously takes the photograph.
But the human-computer interface is the interesting bit — the device uses a transcutaneous electrical nerve stimulator (TENS) wired to electrodes in the handgrip to involuntarily contract the user’s finger muscles and squeeze the trigger. (Editor’s Note: This project is about as sci-fi as it gets — the computer brain is pulling the strings of the meat puppet. Whoah.)
Meanwhile, back in reality, it’s not too strange a project. A Raspberry Pi watches the scene through a Pi Cam and uses a TensorFlow neural net trained against a set of high-quality photos to determine when to trip the shutter. The video below shows it in action, and [Peter]’s blog has some of the photos taken with it.
We’re not sure this is exactly the next “must have” camera accessory, and it probably won’t help with snapshots and selfies, but it’s an interesting take on the human-device interface. And if you’re thinking about the possibilities of a neural net inside your camera to prompt you when to take a picture, you might want to check out our primer on TensorFlow to get started.
Thanks to [Peter]’s colleague [Julian], who tipped us off on this one.
38 thoughts on “Neural Network Zaps You To Take Better Photographs”
The best way selfies can be improved with this technique is if the involuntary muscle contraction slammed the phone into users head.
Thank you! That just made my morning! :D
I hope that it will have also burst mode! :D
Wow, electrocuted for taking bad pictures, that’s a little harsh for something so trivial. Besides, how can one learn when dead?
+1 for shock
Spin-off thought; could you use electrical signals like this to stabilize the camera, effectively using your hand as a camera gimbal? It’d probably feel rather strange, but would actually be quite handy, and would be less cumbersome than a standard gimbal
That’s what I thought this was doing. But apparently this is basically a computer controlled shutter. If only they made cheap little things that can plug into cameras and trigger them with a pure electrical signal….
That’s a brilliant idea!
You might even be able to adapt it to trigger the shutter on a timer, or sound, or… or… or…
tr.v. e·lec·tro·cut·ed, e·lec·tro·cut·ing, e·lec·tro·cutes
1. To kill with electricity: a worker who was electrocuted by a high-tension wire.
2. To execute (a person sentenced to death) by means of electricity.
Should we change the text to read “zapped”? Or are we all good with a little poetic license here?
Zapped or shocked would definitely be better. This isn’t like using drone to describe a quadcopter, this is the difference between life and death.
I wouldn’t worry, getting zapped by a computer so that one looks better in their selfies is hardly ‘life’/living.
Are you one of those people that feel the urge to go on a shooting spree when someone uses the word “literally” figuratively?
I’m sure we could go with “that tingly feeling”. :-)
Too long for the headline, but I like it.
Control robot over people! I can hear Hitler’s happy laughter from hell ….
ST’s “Spock’s Brain” was ahead of it’s time then.
How is aesthetically pleasing defined? Rule of 3rds? Composition? Color? Subject? Lighting? Focus?
It says the network is trained with high-quality photos, but what if you fed it experimental photography instead?
I guess the point I’m getting at is that the artistic consensus of what is ‘aesthetically pleasing’ isn’t constant. Soup cans and urinals aside, I think we can all agree some photography or art that looks good to one person may not look good to another.
Thats right. This particular example was trained with one particular dataset. (CUHKPQ which consists of 17,613 images. They were obtained from a variety of online communities and are divided into seven semantic categories. They were also labeled in categories of high- and low-quality pictures. A photographic community has done this by hand.) So each dataset results in a different overall aesthetic.
This one for example especially “liked” the color blue, complete absence of color or stacked objects.
There are many factors to what the particular algorithm classifies as aesthetically pleasing. The dataset, the neural network and also the learning time are all part of the result. Changing one can create different aesthetics. In the future, we may see different coexist and act as artists do. Some people might enjoy the aesthetics of algorithm X
whereas others prefer the approach of algorithm Y.
Awesome, thanks for the details
Electrocution implies death or serious injury due to electrical shock. This device causes neither.
Please don’t use such clickbaity titles.
this is so wrong on so many different levels!
Came in the comments section expecting somebody to complain about electrocution = death. Was not disappointed.
Visited the comments expecting someone to complain about the comments. Wasn’t disappointed :)
I came into the comments to apologize for “electrocution”. I really didn’t think it implied someone had to die.
Revisited the comments to say that no apology was necessary as current usage of the word ‘electrocution’ does not always imply ‘fatal’.
I see what you did there.
Bad Brit! No Biscuit!
Step it up a notch and use a pistol – now a camera detects when the gun is aimed near the bullseye and pulls the trigger for you.
Will this work with unaesthetic people?
Sometimes it does ;): https://twitter.com/psibu/status/836935926270017536
I’m wondering what was used to supply the TENS power. I’ve not seen any units that are both affordable AND easily controllable/triggerable from an outside source. It’s also not the sort of thing anybody should be DIYing as “good enough”, this is a device DESIGNED to pass a current through human muscle tissue. Not something you want to screw up.
A commercial TENS unit was used 10€ on ebay(http://tenswelt.de/products/tns-sm-2-mf-tens-reizstromgeraet-mit-burst-und-modulation). Only the electordes are now stationary so one has not to deal with those messy and sticky stickers. It is powered with a 9v battery. One can adjust the mA till control over the contraction is lost. After all the testing I am still feeling fine :) Nothing else as using it as it was designed for. Except the computer decides when the signal is send.
So much for creativity, when every photo looks like something from the training set.
I’d get more use out of computer assistance at taking a group photo when everyone is smiling and has their eyes open. (Might have to do it by auto-combining multiple frames.)
You don’t like understand, man.
The camera itself is art.
Regardless of if it produces good art.
Sounds good in fact for such “classic, highly demanded type of photo, with high standard, and no artist touch” :p
But I do think this can wipe out all imperfections we can see in brain-crafted photos where no one would have take this picture!
Please be kind and respectful to help make the comments section excellent. (Comment Policy)