AI Poised To Turn The Internet Into Gibberish

Last Thursday two lowly masters grad students, Aaron Gokaslan and Vanya Cohen managed to replicate the secretive OpenAI model and cheekily named their version OpenGPT-2. The code can be downloaded from this Google Colab page and apparently no prior experience in language modeling is required to use it. More useful might be the skills required to persuade Google to part with $50,000 worth of free cloud compute time for the training!

Research firm OpenAI released a new, ever more powerful, version of their GPT language model with 1.5 billion parameters, trained on a data-set of 8 million web pages and although it’s most entertaining use is to produce gibberish, it will inevitably also be able to produce coherent text sometime very soon. For us mere mortals, there’s a cut down version of the model hosted in the cloud and a webpage that we can visit, type in a short phrase to prompt the system, and print out a few paragraphs of fake news. We tried it with the following: “You can use an Arduino to” and the results were:

  • You can use an Arduino to remove your appendix. Use an open or closed loop, but do not use them at the same time, i.e. don’t wire your Arduino to the wall like I did. The Arduino’s are very noisy and can damage the circuit board. Be sure to use a good quality and high-quality resistor to connect them to the wall. You can also use your own antenna if you’d like.

The neural network works by taking the text that has been previously printed and using this to predict the next word sequentially. Because of it’s obscurity, our Arduino example is a pretty severe and rather unfair test on the system whilst in it’s fledgling infant state and, looking at the proper metrics, it actually performs quite well on certain standard industry test sets such as the Children’s Book Test.

Be sure to paste your own fake news into the comments below and we’ll take a vote on the one that’s most entertaining, but please keep it within the boundaries of good taste!

Whilst this is an emerging technology, somebody did get hold of it a while back and applied it to an old teleprinter!

 

69 thoughts on “AI Poised To Turn The Internet Into Gibberish

  1. This cracked med Up:
    “How to breed a Cuckoo horse:”

    You’ve heard that you can breed them for years, but if you do, there’s one tip you don’t want to try; the breed has a tendency to turn on its own.

    While all Cuckoos don’t have the same traits, they all have a hard time keeping a straight face while being fed. They might growl, screech and jump out of their cage every once in a while, or get their head stuck with a plate, and this can lead to quite a temper tantrum once fed. While a Cuckoo horse is unlikely to kill you, you’ll certainly pay for a second with a broken back.

    The best way that I know of to deal with a Cuckoo horse temper tantrum is to gently shake or pinch the horse’s nose, and put your arm around it as it goes into a calm, “Oh, please no”. That way, the Cuckoo horse knows you’re just trying to reassure it, like an infant in a crib whose parent is suddenly trying to get it to go to…

Leave a Reply

This site uses Akismet to reduce spam. Learn how your comment data is processed.