Dave Morton - Jan 16, 2013:
What I didn’t mention (though I ~DID~ think about it) was the further “what if” of something like a school shooting happening, and during the investigation the cops find in browser history all of the plans to the shooting in a chatbot’s conversation logs. What responsibility for the crime would devolve to the botmaster? Especially if the chatbot was poorly coded, and actually seemed to condone or even encourage the event?
*You* might be the one going overboard now, Dave. You can’t be reasonably expected to take on the roles of the police and FBI, monitoring and reporting everybody on suspicion only. You’re a chatbot programmer, not informant. The situation is analogous to an image posting site where they merely provide the service and aren’t responsible for monitoring and making moral decisions about what is posted. What if somebody sent you an e-mail saying they were going to shoot up a high school and you didn’t read it soon enough to prevent the disaster? You can’t be expected to play the role of society’s watchman and read everything right away, just in case. The nature of security is there is no limit to such security efforts.
Here’s another scenario: What if somebody was just role playing (very popular now) or trying out a new personality (popular among teenagers), said they were going to shoot up a high school, you reported them, the police raided their place, shot their family dog (I’m reluctant to post *that* YouTube video, for fear of getting too political or too offensive) or shot a family member, then it was discovered that the user was just joking around and you made a mistaken report or maybe there was even mistaken identity, then you got sued for manslaughter or invasion of privacy or filing a false police report? Kids, adults, and families could be ruined for life. Is there a notice on your bot site that says that all conversations are saved and read? You may find that the more you monitor such conversations, the more people decide your chatbot is not useful for their purposes anymore, then they go elsewhere where they can experiment in their own way, privately, without fear of repercussions.
On a more practical note, I noticed that publishers of controversial weapons manuals put the phrase “For entertainment purposes, only.” on the front covers. There is probably legal reasoning behind that, despite it sounding almost ridiculous, which is something you could look into, and possibly use for a web site.