{"id":1135,"date":"2015-11-05T12:18:35","date_gmt":"2015-11-05T16:18:35","guid":{"rendered":"https:\/\/sites.temple.edu\/tudsc\/?p=1135"},"modified":"2025-11-18T15:42:27","modified_gmt":"2025-11-18T19:42:27","slug":"coloring-your-data-the-art-of-digital-video-and-image-visualization-part-i","status":"publish","type":"post","link":"https:\/\/sites.temple.edu\/tudsc\/2015\/11\/05\/coloring-your-data-the-art-of-digital-video-and-image-visualization-part-i\/","title":{"rendered":"Coloring Your Data-The Art of Digital Video and Image Visualization (Part I)"},"content":{"rendered":"

By Ping Feng<\/p>\n

<\/p>\n

 <\/p>\n

\u201cThe meanings of the word \u2018visualize\u2019 include \u2018make visible\u2019 and \u2018make a mental image\u2019. This implies that until we \u2018visualize\u2019 something, this \u2018something\u2019 does not have a visual form. It becomes an image through a process of visualization.\u201d<\/p>\n

–Lev, Manovich, 2010<\/p>\n

 <\/p>\n

From visualization to information visualization: <\/strong><\/p>\n

The concept of visualization is not new; however, it was relatively recently that the term\u00a0information visualization<\/em> (infovis)<\/em>\u00a0became widespread\u00a0in both academic and industrial spheres, on account of new\u00a0computational capabilities and the demand for processing large quantity of digital data.<\/p>\n

Researchers at University of California, Berkeley recently estimated that about 1 exabyte (1 million terabytes) of data is generated annually worldwide with 99.997% of the data available only in digital form (Keim, 2001). However, without the adequate capability to analyze and make sense of it, the large amounts of data will become useless database dumps. Information visualization is hence developed from\u00a0the call to visualize the data with the aim to generate insights and augment human cognitive work to process complicated issues.<\/p>\n

There are many different ways to visualize information. The most common and easiest way is to visualize statistical data, which is usually quantifiable and immediately available for visualization; examples are x-y plots, line plots, histograms and so on. Mapping is also a form of infovis but focuses on geographical and spatial data. Until recently, there is a growing tendency to quantify and visualize text data as a result of the ever-increasing availability of digitized text data. With the ever-growing digital video and image materials scattered all over the internet on Youtube, Facebook, Instagram, and elsewhere, analyzing and visualizing this large set of visual and video\u00a0data might become the next important subject for visualization researchers.<\/p>\n

Quantify, visualize and colorize digital video\/images:<\/strong><\/p>\n

So far, in my perspective, there are two ways to visualize digital video and image materials: \u00a0One is to visualize the editing meta-data of digital videos and images, which I already discussed in my previous blog<\/a><\/u>. Another way is to code directly to the digital video and digital image texture materials and visualize it into certain patterns. However, the special \u201ctexture\u201d of digital video and digital image materials makes it not as easy as statistical data or geographical data to be visualized. As Lev Manovich (2010) states, \u201csince the layout in such visualizations is already fixed and cannot be arbitrarily manipulated, color and\/or other non-spatial parameters are used instead to show new information”. \u00a0Therefore, this article will focus on exploring and providing a general survey on some prominent digital video\/image visualization projects that feature color pattern presentation and analysis.<\/p>\n

Cinema Redux<\/a> is an interesting project created by designer Brendan Dawes in 2004. He wrote a program to sample a film at the rate of one frame per second and then scale down the pixels of each frame. He then rearranged these frames in a rectangular grid with each row presenting a single minute of the film. The resulting visualization, as Manovich notes, represents a trade- off between the two possible extremes: preserving as many details as possible of the original artifact and abstracting its structure completely; the former maintains the original details and aesthetic experience while the latter is more advantageous in revealing certain patterns. In this way, we can visualize and compare the length of the movies as well as how many frames or actions are contained in each single minute.<\/p>\n

\"gone<\/a>\"The<\/a><\/p>\n

(Left: Gone with Wind<\/em>; right: The Conversation<\/em>)<\/p>\n

Another very exciting\u00a0project is cinemetrics.site <\/a>by Frederic Brodbeck, a creative designer and coder who went to the other opposite direction and focused on displaying an abstract pattern of shot length and frequency of the digital video textures via a dynamic animated color wheel. The three screenshots below, for example, shows the color wheel visualization from three different movie genres – “space”, “action” and “horror” respectively:<\/p>\n

\"Screen<\/a>Figure 1: Space<\/p>\n

\"Screen<\/a>Figure 2:Action<\/p>\n

\"Screen<\/a>Figure 3:Horror<\/p>\n

From the above visualization, it is very easy for us to capture and compare the basic characteristics of three genres of the movies. For the space genre, a very distinctive feature is that they are all in \u00a0dark blue color, which does make sense as a lot of a space movie is typically set with dark blue sky as backdrop. For the action genre, we can easily observe much more frequent shots jumping around than the rest of genres, and this confirms many movie studies that claim action movies are usually edited with a high frequency of shots to promote a fast paced tension. As for the horror genre, the color pattern is more diversified; however, they are all consistently in dark and deep color hues, subject to the thrilling dark atmosphere in most horror movies.<\/p>\n

In next section, we will introduce some color pattern presentation and analysis projects that are based on digital image textures.<\/p>\n

Stay tuned!<\/p>\n

 <\/p>\n

Reference:<\/strong><\/p>\n

Manovich, L. (2010). What is visualization?.\u00a0paj: The Journal of the Initiative for Digital Humanities, Media, and Culture<\/em>,\u00a02<\/em>(1).<\/p>\n

Keim, D. A. (2001). Visual exploration of large data sets.\u00a0Communications of the ACM<\/em>,\u00a044<\/em>(8), 38-44.<\/p>\n","protected":false},"excerpt":{"rendered":"

By Ping Feng<\/p>\n","protected":false},"author":7448,"featured_media":1244,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_monsterinsights_skip_tracking":false,"_monsterinsights_sitenote_active":false,"_monsterinsights_sitenote_note":"","_monsterinsights_sitenote_category":0,"footnotes":""},"categories":[296,2],"tags":[117,97,29],"class_list":["post-1135","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-critical-digital-studies","category-grad-students","tag-big-data","tag-data-visualization","tag-visual-analysis"],"_links":{"self":[{"href":"https:\/\/sites.temple.edu\/tudsc\/wp-json\/wp\/v2\/posts\/1135","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/sites.temple.edu\/tudsc\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/sites.temple.edu\/tudsc\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/sites.temple.edu\/tudsc\/wp-json\/wp\/v2\/users\/7448"}],"replies":[{"embeddable":true,"href":"https:\/\/sites.temple.edu\/tudsc\/wp-json\/wp\/v2\/comments?post=1135"}],"version-history":[{"count":1,"href":"https:\/\/sites.temple.edu\/tudsc\/wp-json\/wp\/v2\/posts\/1135\/revisions"}],"predecessor-version":[{"id":9803,"href":"https:\/\/sites.temple.edu\/tudsc\/wp-json\/wp\/v2\/posts\/1135\/revisions\/9803"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/sites.temple.edu\/tudsc\/wp-json\/wp\/v2\/media\/1244"}],"wp:attachment":[{"href":"https:\/\/sites.temple.edu\/tudsc\/wp-json\/wp\/v2\/media?parent=1135"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/sites.temple.edu\/tudsc\/wp-json\/wp\/v2\/categories?post=1135"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/sites.temple.edu\/tudsc\/wp-json\/wp\/v2\/tags?post=1135"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}