Robotic Pool Cue Can Be Your Friend Or Your Foe

In his everlasting quest to replace physical skill with technology, [Shane] of [Stuff Made Here] has taken aim at the game of eight-ball pool. Using a combination of computer vision and mechatronics, he created a robotic pool system that can allow a physical game of pool over the internet, or just beat human players. See the video after the break.

Making a good pool shot requires three discrete steps. First, you need to identify the best shot, then figure out how exactly to strike the balls to achieve the desired results, and finally physically execute the shot accurately. [Shane’s] goal was to automate all these steps. For the physical part, he built a pool cue with a robotic tip which only requires the user to place in approximately the right position, while a pneumatic piston mounted on a Stewart platform does the rest. A Stewart platform is a triangular plate mounted with six reciprocating rods, which gives it the required freedom of motion. The rods’ bases are attached to a set of cranks actuated by tension cables pulled by servos mounted at the rear-end of the cue. An adjustable air system allows the power of the shot to be adjusted as required.

A camera mounted is mounted over the table and connected to computer vision software to gather the required position information. Fiducials on the corners of the table and the cue tip allow the position of the pockets, balls, and cue to be accurately determined, and theoretically should allow the robot to take the perfect shot. Getting this to work in reality quickly turned into a very frustrating experience. After many hours of debugging, [Shane] tracked the error to a tiny forgotten test function that was introducing 5-10 mm of position error, and 2 of the six servos in the cue not performing up to spec. To determine the vertical positioning of the cue, an IMU and fixed height foot were added. [Shane] also added an overhead projector to overlay all required information directly on the table.

At this point [Shane] realized he had all the parts to allow someone to play a game of pool with him over the internet. He created a simple web-app to send a video feed to the remote player, who can then choose where [Shane] should position the pool cue, and then take the shot remotely. Although he didn’t have high hopes for this mode, it turned out to be a fun and engaging experience.

The final step was to make the computer choose the shots. First, it does a bit of pseudo ray tracing to compile a list of every possible shot and its effects across the table. It then selects the best shot based on a combination of distance, precision, and ball velocity.

This is probably [Shane]’s a most complex project to date, but only by a small margin. The fact that he can complete projects like the CNC barber, robotic basketball hoop, and explosive baseball bat quickly enough for a monthly upload schedule is nothing short of amazing.

21 thoughts on “Robotic Pool Cue Can Be Your Friend Or Your Foe

    1. The price of machines in US is pretty high. From the looks of it, this guy has over $100,000 in machines in his basement. He is really good at this stuff and likely gets a lot of equipment from vendors as it shows off their capability on youtube.

      1. He has been “gifted” a very nontrivial amount of equipment. Assuming he is marketing it and selling it, the vendors are winning out a fair bit here.

        He even talked about how quite a few fairly large machines were literally given to him.

        1. One thing of the many things we can and should learn from [Shane] is to document failure.

          Personally I think [Shane] earned the equipment he is using. My advice to those who envy others: “Do doubt how good their break even calculation is”.

  1. I haven’t been able to stop thinking about this project since I saw the video.

    1. Wow what a huge amount of work goes into these videos
    2. He needs a claw that brings the cue in from the ceiling to cut out the middle man and make remote in person real life pool!

      1. I had a nightmare I’d lost my job to AI and the only jobs left were super menial ones it didn’t make economic sense to automate.

        I was peeling stickers off bananas. I don’t know what the bananas were for above my pay grade I suspect.

        I think I must have been earning enough though because my car was humongous (and covered in banana stickers)

        1. Helps to be rich/have enough money to get things started for sure.

          What I wonder about most, is how these people stay motivated. Showing videos of your work is nice, but really interacting with people and your products is nicer.

          This must be draining after a while.

  2. I have been thinking about this a really long time after missing so many easy shots – ok maybe the beer had an influence. Shane has solved identifying the table, balls, path projection, cue position, and all the really hard math. My goal was less ambitious. No robot cue stick, just project the ball paths as the cue is moved using cue stick fiducials. The player is responsible for picking the best shot, backspin and setting up the next shot(s). The concept is directed to the idea of a billiard’s trainer rather than robotic cue stick. As proficiency grows, projection is turned off, keeping the cue stick vibration feedback. On final thought for low ceiling installs, use 2 projectors (like the $50 holiday LCD model).

Leave a Reply

Please be kind and respectful to help make the comments section excellent. (Comment Policy)

This site uses Akismet to reduce spam. Learn how your comment data is processed.