1 / 35

Automatic Storytelling in Comics

Automatic Storytelling in Comics. Intrinsic Needs of Human Being!. Communication Storytelling Today’s world is information-saturated Computers are becoming a larger and larger part of people’s lives (Intel 2005)

gcedric
Download Presentation

Automatic Storytelling in Comics

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Automatic Storytelling in Comics

  2. Intrinsic Needs of Human Being! • Communication • Storytelling • Today’s world is information-saturated • Computers are becoming a larger and larger part of people’s lives (Intel 2005) • More and more people are documenting their lives with digital images, video, music, and recordings (Imation 2003) • As storage space gets cheaper, and people record more and more and more, they need some way to automate the categorization of all of these digital memories

  3. Recall, share and preserve (gaming) experience • Virtual community such asforums, blogs • Video, screenshots,comics or other art formats • Narrative, summary, story Search “Lineage Story” or “Lineage Comics”… • Around 26,600 files in YouTube and 724,000 items in Google • http://www.lineage2.com/community/fanart.html • http://himewikia.blogspot.com/ • …

  4. Example:

  5. Example:

  6. Narrative • In short, People Like Stories. Or, put more accurately, People RememberStories • So we provide a summarization tool to aid storytelling of end-users • But whyComics…

  7. Comic • A storytelling medium • Vocabulary of comics • Panel layout • Border shape • Panel size • Bleed, splash page • Speech balloon and sound effects • Motion lines • Visual language • Draw attention to important events Reference: http://scottmccloud.com/2-print/index.html (McCloud, Scott)

  8. Comic Generation Tools • Automation support • The computer is charged with a greater role in the creation of the comic • Authoring support • Tools offer the most agency in creating panels and layouts of any size and shape Reference: http://dm.lcc.gatech.edu/~jalderman/comics/

  9. Comic Chat(1996) Comic Chat visually represents conversations as sequences of comic panels. Automation support: • Changing posture and facial expression of users’ avatars in chat room • Placing word balloons in natural reading order • Zooming “camera” to frame the people talking • Parsing text into panels procedurally. Panels are all in the same size Reference:http://kurlander.net/DJ/Projects/ComicChat/resources.html

  10. Microsoft Chat 2.5 Chat room: Comic mode Authoring support: Emotion Wheelallows users to choose the facial expression and body language Massage

  11. Microsoft Chat Character Editor • Character Icon • Character Contents • New Pose • New Pose

  12. Example:

  13. Video Manga(1999-2003) It provides a summary of video clips that allows users to quickly browse a long video in comic book format. • Manga is named after a Japanese word for "comic book" • A video is represented with different-sized keyframes that packed in a comic book format • Video Manga allows users to quickly browse a long video • The visual summaries support printing function Reference: http://www.fxpal.com/?p=manga

  14. Automation support: • A video is segmented based on the color features of each frame • The segments are clustered according to their similarities • We have introduced an importance score to rank the segments • A segment is considered to be important if it is long and rare • The keyframes are extracted from highly ranked segments • The keyframes are sized according to their scores • The frame-packing algorithm puts the keyframes in a comic book format Authoring support: • Handling captions to its frames manually typed in by users

  15. Video Manga: Summary of staff meeting

  16. Generating Comics From 3D InteractiveComputer Graphics (2006) Automation support: • Recognizing scenes • Converting to visual depiction • Comic layout • Image processing Reference:http://ieeexplore.ieee.org/xpl/freeabs_all.jsp?arnumber=1626186

  17. Automation support • Recognizing scenes • Time and space • Separating scenes when • The interaction level is low • The location changes • Converting to visual depiction • Transforming each scene into a sequence of images depicting the main event • Using idioms to depict interactions • Change of scene • Shooting • conversation

  18. Comic layout • B (Big): peak interaction images and change-of-scene • S (small): action-to-action pair or FP viewpoint shots • F (fixed): images with speech balloon • N (neutral): all others • Image processing • Mean shift • Laplacian • K-means

  19. Example:

  20. Comic Life (2005) Applicationfor creating comics: loading images into comic panels Authoring support: • Simple and Easy-to-use interface • Drag in your pictures, captions, sound effects (‘ka-blam!') and speech balloons and it’s done! • Layout templates • Filters like hand-drawn, painted and night vision • More freedom to create comic but still some restrictions Reference: http://plasq.com/comiclife-win

  21. Comic Life 1.3

  22. Example:

  23. Manga Studio Application for creating comics: drawing, laying out comic and styling comics Authoring support: • High versatility and flexibility to create comics • A large collection of special effects • Sketch, ink, and color artworks without the need for any other graphics applications • Interface similar to Photoshop Reference:http://my.smithmicro.com/mac/manga/index.html

  24. OurProposal • Automation support • Frame selection • Layout computing • Authoring support • Comic layout • Graphic Effects • Internet support • User interface

  25. Comic Gene(2009) It automatically summarize players’ interactions (logs and screenshots) in virtual world into comics. Automation support: • Recording log and shots (Addon) • Frame selection • Comic layout computing • Rendering comics Authoring support: • Editing log files and screenshots • Comic layout • Option setting • Changing size and position of the shots Reference:http://mmnet.iis.sinica.edu.tw/publication_detail.html?key=chan09_comics

  26. Prototype …How to improve!

  27. 1. Automation Support • Automatically summarize logs and frames into comics • Log:events • Frame: video, photos,screenshots and so on • Definition of important events • Frequency, weight • Significance score

  28. Frame selection • How many images does a comic strip need? • Is the criterion of significance score enough? • Layout computing • Algorithm • Detection

  29. 2. Authoring Support • Page properties • How many images in a comic/page/row/… ? • Important event/frames • Comic layout • Panel layout • Border shape, bleed • Panel size • Speech balloon • Sound effects

  30. Graphic effects • Templates • Cartoon-like design • Cartoon-like filter • Motion line • Internet support • Uploading comics to individual album or blog

  31. 5. User Interface Design • User-friendly Features • Navigation bar • Easy-to-use • Click, wheel • Drag-n-drop

  32. UI Example: Videolyzer Navigation bar

  33. UI Example: Comic Life Drag-n-drop

  34. Drag-n-drop UI Proposal: Comic Gene

  35. Thank you

More Related