Just recently found this IBM site called “Many Eyes” which has a nice tools set for visualizing large data sets.  Some of the visualizations may be quite interesting to chatbot developers- including ‘Word Tree’ and ‘Phrase Net’.  I have uploaded a public data set from chatlogs covering approx 100K inputs to a chatbot (Laybia) for you to play around with if you want.

I haven’t had any success getting this to work running on Chrome on Linux. It seems to be a problem with the Java app on my particular platform rather than your data set because the examples on the site didn’t work either. It always timed out without starting.

For what it’s worth, a comparable set of services is available through Google docs with their FusionTables application.

https://support.google.com/fusiontables/?hl=en#topic=1652595

Oh dear, is it this data set, right: http://www-958.ibm.com/software/data/cognos/manyeyes/datasets/chatbot-input-100k-lines-may-2013-/versions/1.txt

Sooo much dirty talk in there, wtf is wrong with people

Andrew Smith - Aug 3, 2013:

I haven’t had any success getting this to work running on Chrome on Linux. It seems to be a problem with the Java app on my particular platform rather than your data set because the examples on the site didn’t work either. It always timed out without starting.

For what it’s worth, a comparable set of services is available through Google docs with their FusionTables application.

https://support.google.com/fusiontables/?hl=en#topic=1652595

The Google tools are very nice, but clumsy and hard to get large data sets into IMO.  That is why I liked the “Many Eyes”- it takes huge data sets with grace and the visualizations (if you have java running) work very smoothly and quickly compared to the Google.

Wouter Smet - Aug 3, 2013:

Oh dear, is it this data set, right: http://www-958.ibm.com/software/data/cognos/manyeyes/datasets/chatbot-input-100k-lines-may-2013-/versions/1.txt

Sooo much dirty talk in there, wtf is wrong with people

Welcome to the real world of chatbots.