Actionable Data

Last month I talked about the explosion of unstructured information in retail and the new technologies to tame its growth. This month I want to discuss how you can get actionable data from some of that content.

Unstructured data includes new technologies such as blogs and Wikis. Many companies have embraced these forms of communications but don't have an effective way to comprehend the content in a way that can be actionable.

Blogs now number in the millions and according to the latest issue of Forbes, are growing at 100,000 per day. Anyone can now create their own free blog on Google's Blogger dot com. Blogs have both made companies and crippled companies. Many companies are starting their own blogs to counter blogs of dissatisfied customers. There are numerous blog search engines but comprehending the range of content is too much even for the most sophisticated searches.

Wikis are the newest form of community interface. There are even blogs about Wikis. Wiki-wiki is Hawaiian for quick. A Wiki is like a blog on steroids that allows content to be cross referenced, organized and easy to follow a thread. To best understand the Wiki, visit www.wikipedia.com and create an entry in any subject that you have an interest in. Wikipedia is an on-line free encyclopedia that any one can edit or create new topics. In fact one blog has a wiki joke.

Q. How many Wiki people does it take to change a light bulb?

A. One, but anyone can change it back.

Retailers are starting to use the Wiki technology for knowledge management. Buyers, merchants, store managers and vendors can use the Wiki to quickly input unstructured information such as a customer comment about a product or service. They can input information about a competitor, marketing promotions, new colors for fashion, what's selling and what's not. This information can be made instantly available to everyone in the company who needs it.

Still who has time to read through the growing terabytes of data for relevant content? IBM research has developed a tool for visualizing such evolving documents and the postings of multiple authors.

It is called History Flow Visualization.

History Flow Visualization Application is a "tool for visualizing dynamic, evolving documents and the interactions of multiple collaborating authors". The application includes online help, as well as a plug-in for retrieving the history of a given page from any MoinMoin "wiki." (MoinMoin is an advanced, wiki engine.)

How does it work?

History Flow Visualization Application has four main visualization modes that allow the user to comprehend the flow of changes and better understand the underlying pattern in the content.
Community view:

This is the default mode and it shows all contributions from different authors, color-coding the text to indicate the author of each sentence.
Individual author view:

This mode highlights the contributions of a single author and it depicts the persistence of these contributions over time.

Recent Changes View:

This mode highlights the new content in each version of the Wiki page, independent of authorship. This view allows us to see what portions of the text have been edited the most over time. For instance this view might point to an emerging trend.
Age View:

Imagine a scenario where several people will make contributions to a Wiki page at different points in time. Each person edits the page and then saves their changes to what becomes the latest version of that page. History flow connects text that has been kept the same between consecutive versions; in other words, it connects corresponding segments on the lines representing versions. Pieces of text that do not have correspondence in the next (or previous) version are not connected and the user sees a resulting "gap" in the visualization; this happens for deletions and insertions.

A simple example

Here's an example of a simple page with just a few edits: the first eight versions of the Wikipedia entry for IBM. The page has three named authors (listed at left), including a script which changed some formatting. Each author is given a unique color. Several anonymous authors also made contributions; their insertions are shown in shades of gray. The green regions show the contributions of the initial author, Peter Winnberg, many of which persist throughout the versions shown. Text that persists over time is darkened to indicate its age, so at the right side of the diagram Peter Winnberg's contributions have changed from bright green to dark green.

Related work

History Flow is available to the public on IBM's Alphaworks Website

Copyright © Daniel Hopping

About The Author:
Daniel Hopping is a global technology futurist, author, consultant and speaker. With four decades of hands-on experience, Dan's area of expertise is forecasting the impact that technology will have on the retail industry and tomorrow's consumer