Hi, Chris, and welcome to chatbots.org. 
I doubt that you’re going to find anything in the open source arena that will suit your needs, and I’m reasonably certain that you’re going to have a hard time finding anything that will do exactly what you want “out of the box”, but I may have a suggestion for you. Try reaching out to Media Semantics to see if this is something that they’re interested in working on with you. I work with them regularly, and I’m sure that they’re capable of creating something like what you’ve described, so it’s worth discussing it with them. My point of contact there is a man by the name of Doug C.(I won’t give out his full name in a public forum without permission), and if you talk to him, please let him know I sent you (I won’t get a kickback or anything, but he might appreciate the referral).
I hope this helps.