sample of automatically generated comics

Read Your Movies As Automatically Generated Comic Books

A research paper from Dalian University of Technology in China and City University of Hong Kong (direct PDF link) outlines a system that automatically generates comic books from videos. But how can an algorithm boil down video scenes to appropriately reflect the gravity of the scene in a still image? This impressive feat is accomplished by saving two still images per second, then segments the frames into scenes through analysis of region-of-interest and importance ranking.

movie to comic book pipeline diagram

For its next trick, speech for each scene is processed by combining subtitle information with the audio track of the video. The audio is analyzed for emotion to determine the appropriate speech bubble type and size of the subtitle text. Frames are even analyzed to establish which person is speaking for proper placement of the bubbles. It can then create layouts of the keyframes, determining panel sizes for each page based on the region-of-interest analysis.

The process is completed by stylizing the keyframes with flat color through quantization, for that classic cel shading look, and then populating the layouts with each frame and word balloon.

The team conducted a study with 40 users, pitting their results against previous techniques which require more human intervention and still besting them in every measure. Like any great superhero, the team still sees room for improvement. In the future, they would like to improve the accuracy of keyframe selection and propose using a neural network to do so.

Thanks to [Qes] for the tip!

Comic Boxes Reflect Owner’s Skills

We are the culmination of our experiences. We build with the tools we’re familiar. We design with the decorations we like. Sometimes this thinking leads to a project that looks like a kindergartener who has dressed in a pink tutu and a camo shirt. Sometimes our experience leads us to make something functional and elegant. [jordanlund] combined his work experience in a library, 3D modeling skills, and love of comic books to turn a hodgepodge pile of scribbled-upon boxes into an orderly collection of comic books in boxes adorned with brass drawer pulls.

3D printing bridged the gap between the brass card catalog drawer pulls he knew well from the library and the crates of comics he kept at home. Custom brackets allowed the drawer pulls, which were meant to be screwed into wooden drawer faces, to work with cardboard boxes. The drawer pulls have a slot for labels so there will be no need to rip off sticky labels later or scrawl with a permanent marker. Perhaps [jordanlund] is merely a bibliophile with a 3D printer but if we didn’t know better, we might think those boxes were meant to have the drawer pulls installed.

Engage your own love of literature with this wordplay riddled appeal for libraries. or make your home library a little more fantasical with a secret door.