Watching a sport can be a bit odd if you aren’t familiar with it. Most Americans, for example, would think a cricket match looked funny because they don’t know the rules. If you were not familiar with baseball, you might wonder why one of the coaches was waving his hands around, touching his nose, his ears, and his hat seemingly at random. Those in the know however understand that this is a secret signal to the player. The coach might be telling the player to steal a base or bunt. The other team tries to decode the signals, but if you don’t know the code that is notoriously difficult. Unless you have the machine learning phone app you can see in the video below.
If you are not a baseball fan, it works like this. The coach will do a number of things. Perhaps touch his cap, then his nose, brush his left forearm, and touch his lips. However, the code is often as simple as knowing one attention signal and one action signal. For example, the coach might tell you that if they touch their nose and then their lips, you should steal. Touching their nose and then their ear is a bunt. Touching their nose and then the bill of their cap is something else. Anything they do that doesn’t start with touching their nose means nothing at all. If the signal is this easy, you really don’t even need machine learning to decode it. But if it were more complicated — say, the gesture that occurs third after they touch their nose unless they also kick dirt at which point it means nothing — it would be much harder for a human to figure out.
The code uses SDEC (Sequence-Domain Encompassed Correlations) to look for patterns in an ASCII string. We couldn’t help but think this would probably be applicable to a lot of other things where you were looking for a sequence of things.
The video has a pretty good Sunday supplement explanation of machine learning. It includes some details like hidden layers without getting bogged down too much in math or actual coding. If you haven’t dug into machine learning yet, this won’t make you an expert, but it will give you some orientation.
If you want a more detailed explanation of how machine learning works, try this one. Even the Arduino can get in on the act.
One thought on “AI Phone App Learns Baseball Signals”
This is simply one of the best ML example I have ever seen!
Please be kind and respectful to help make the comments section excellent. (Comment Policy)