HOPE 2008: YouTomb, A free culture hack


YouTomb is a research project designed by the MIT Free Culture group to track video take downs on YouTube. To succeed, the team needed to track every single video on YouTube… which is close to impossible. Instead, they built several “explorer” scripts to track what videos were interesting. One explorer tracks all of YouTube’s lists: recommended, featured, most active, and more. Another explorer picks up every video submitted to YouTube, and a third crawls Technorati.

The explorers just find the videos; a separate group of scanner scripts checks the current status of videos. It checks both the new videos and ones that have been killed to see if they return. YouTomb archives every video it finds. They display the thumbnail of the video under fair use, but they’re still determining whether they can display each video in full.

YouTomb is tracking a little more than 282,000 videos right now and maintain a public MySQL snapshot for anyone that wants to build their own tools. The code is also open source. They’ve been archiving all their historical data too, all 70 million rows of it.

They’ve started trending country censorship. Germany, Poland, and France all have hate speech bans, so any video with a swastika can’t be viewed there. Thailand blocks anything that impugns the king. Crank That is blocked in 200+ countries.

YouTomb got a lot of press when it was initially released. The team feels that this is the result of a clear interface. They encourage others to take the time to present data clearly. As a final note, they pointed out that you can always file a DMCA counterclaim to get your videos restored.

Comments

  1. b10hazard says:

    I request that Crank That be banned in one more country.

  2. Vinnie says:

    What does this have to do with HOPE 2008 ie hackers on planet earth.I swear this site just gets lamer and lamer everytime I come here

  3. Soulja Boy is a mindvirus.

  4. Eliot says:
  5. tony says:

    I agree with post #1

  6. Rick says:

    There’s quite a few sites hosting deleted youtube content, and they are already fully functional for viewing the videos. I think one is called delutube, and there were a few posted to digg.com a year or two back.

  7. Cracker says:

    I do this with CD found in the street. “Boy Bands” are a huge casualty. Hear that RIAA, you might want to stamp out more SlipKnot or Static-X!

  8. guy says:

    @vinnie: then please stop coming here.

    or at least, stop commenting.

  9. Anika says:

    What a sexy blog, love the theme, what are you using?

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s

Follow

Get every new post delivered to your Inbox.

Join 94,560 other followers