Toys are great for keeping the kids amused at play time, but oftentimes its difficult to get them to understand the importance of tidying up after themselves. It would naturally be ideal to have some manner of robot to help in this regard, and [Paco Garcia] might just be leading the charge in this area.
[Paco]’s project involves combining a robotic arm with computer vision tools in order to allow it to pick and place small objects – in this example, toys. The robot arm is of a gantry type, built on an aluminium frame with 3D printed components. The computer vision side of things is handled by a Raspberry Pi, fitted with the standard camera and running OpenCV software for object recognition. This then passes commands to an Arduino which runs the stepper motors controlling the arm.
[Paco] notes that the hardest part of the build was learning how to generate real-world coordinates from a single camera feed in OpenCV. With that mastered, the rest of the dominoes began to fall. With trigonometry and kinematics knowledge in hand, the robot has grown capable of reliably picking and placing small objects across its range of motion. Future work aims to improve the robot’s abilities to rotate and otherwise manipulate its end effector for more versatility.
Naturally, we typically see pick and place machines used for PCB production – and this build is no exception. Video after the break.
We just had a bed sheet and a tote. We could play with our toys on that sheet. When done, you grab the 4 corners and throw the entire batch in a tote. Have multiple sheets and totes depending on the category of toys – lego, tinkertoys, matchbox cars, etc.
I have to babysit my two nephews during the week (4yo and 5yo) I love their company but they are messy. This sheet idea is great…I plan to implement this new “sheet initiative” idea you have given me next time I babysit. Thanks for the awesome idea man.
Why did my parents not teach me this…
@heatgap and @ sebastian: You’re welcome for the idea. It prevents stepping on legos and losing them up the vacuum cleaner for the most part. As to why your parents didn’t teach you this, all I can say is you’re never too old to learn.
Hello I wish to build the same robot but stuck with one thing, how 2D Coodinates from Computer Vision are converted to 3D Coodinates in real-world??
A claw game that always wins…