Nerf sentry gun with image recognition

Here’s another hacked Nerf Vulcan rifle. This time it is an automated sentry gun. You must present it your badge, if no badge is found, you are assaulted with a fiery storm of small nerf darts. All encounters are logged and a photos are kept. This was a final project at Cornell, and for once it wasn’t ECE.  This was for CS1114. They did a pretty good job with the tracking, now they need to add some more interesting voice options to it.

45 thoughts on “Nerf sentry gun with image recognition

  1. another gem from caleb kraft and his lack of spell check… the title of the video _clearly_ says ‘sentry’ whereas mr. kraft titled the article ‘centry’ … amazing

  2. I bet this could be easily modified for paintball for all those paintball freaks.

    and maybe even for home defense to “mark” the culprit with paint. I’m thinking back-yard sentry or front yard that’s fenced in.

    oh yeah… first real post :-p

  3. I felt ill when I saw a National Instruments USB-6008/9. Use a labjack instead of that overpriced crap, please!

  4. Good presentation, but I had one small thought about the language used; It was said “basically” then there proceeded to be a paragraph of description describing how some thing worked and was sending signals. This happened twice and didn’t sound very basic to me.

    Other than by regular bsing (above) I think you did a very awesome job with this. Physics book for the win!

  5. Nice work. I’m surprised they got the thing to turn at all with the servo. The image recognition over video is pretty cool too. Maybe when they take an ece class they’ll ditch the national instruments USB 6008/9 (or labjack, if that’s your thing) and just do servo control with a microcontroller over serial.

  6. we couldn’t use a microcontroller because 1) this was supposed to be a matlab project, and 2) the setup we had (webcam and NI usb) worked fine and we had already spent enough money.

    abumaia: you can easily change the sounds by substituting in different wavs in the sounds folder :)

  7. Am I the only one to notice the music selection ruined the entire thing. Ick… Great job on the hardware/software of the project but I digress.

  8. They made an automated nerf sentry gun with tracking and recognition capabilities and the only thing they can be called on are grammatical errors?

    -and what music they chose for the video?
    -really?

    Looks like the only thing you really need to do is a little proof reading on your presentation.
    That’s like 5 minutes and doesn’t even involve the project itself.

    I’d call that pure -= win =- fellas.

    pure win.

    Congrats on an awesome project.

  9. Why is it that the lag on these “sentry” systems is so bad that even an out of shape person can dodge the aiming.

    Put decent servos in there and either put in decent processing or close the loop tighter on the tracking. it should adjust aiming 60 times a second at least.

    The phalanx auto guns reassess aiming 240 times a second

  10. Ingenious!

    @sansan
    I’m sorry that you, or someone you know, has obviously suffered some loss at the hands of a nerf-gun wielding maniac, but I think that you lack what we living in free countries like to call “perspective”.

    @mr.metro
    You’re right; that music was AWESOME!

  11. Extremely badass, but it kills me that the kid talking about the software spent more time showing the different color schemes (“and this one looks like Star Wars”) than on how the target recognition works.

  12. You are in direct violation
    of penal code 27 section C.

    - You have five seconds to comply.

    - Four, three, two, one.

    I am now authorized
    to use physical force.

  13. I would guess the reason the turret is slow to respond has to do with Matlab’s Image Aquisition Toolbox. I was playing around with it for a purpose similar to this and found it extremely clunky.

    I gotta agree on the presentation, best sentry doc so far but still lacking alot of technical information.

  14. must of been patronizing to go around picking up all those darts. that was always my least favorite part of nerf wars. I say get a roomba with dart recognition software to suck them up and bring them back!

  15. “do you really believe nerf guns contribute to violence?”

    In this country, we’re allowed to bear arms to protect ourselves from nerfiggas.

  16. I want one of those for my lab! That’ll teach the maintenance people to just walk in and start messing around near our million dollar equipment without calling ahead first.

  17. Slow aiming is forgivable. MATLAB is *slow*, and there’s not a heck of a lot you can do to get away from that. If you implemented it in something less bloat-tastic, i’m sure you could make it much quicker.

  18. now make it controllable via internet… (gut a mobile security cam use it’s motor with the cam, Make sure you use one that can be connected to by the internet…)

  19. can it be mad to fire at any movement? that would be beast!

    and the movements are kinda slow and no too great…\\but over all it is fucking awesome!

  20. Very Cool! I never even thought this was possible!
    I Love the badge part!

    Very useful if you’ve got an Arch-Nemesis coming to your house!

  21. Am I the only one that thought they should integrate this into a scale model ED-209?

    “YOU ARE IN A RESTRICTED AREA. PRESENT YOUR CREDENTIALS. YOU HAVE TEN SECONDS TO COMPLY.”

    BLAMBLAMBLAMBLAMBLAMBLAM!

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s