AI Zone Admin Forum Add your forum

NEWS: Chatbots.org survey on 3000 US and UK consumers shows it is time for chatbot integration in customer service!read more..

RSS AI Zone  Forum Home  >  Development  >  ChatScript  >  Thread
Question on Engine defined concepts - POS tags
  
 
Posted: Nov 25, 2017

It’s nice to have access to the Engine Defined Concepts. However I have difficulty in trying to use them.

In case I need to catch grammar errors in the user input. As illustrated int the attached screen shot with CS7.7, the pattern ( ‘I ~verb ~verb ) doesn’t work always! I have similar experience with the set ~noun too.

Is there any better or correct scriting for this? I appreciate any advice.

Many thanks,
Michael

Image Attachments
CS_screen_shot.png
Click thumbnail to see full-size image
 

 
Posted: Nov 25, 2017
   [ # 1 ]

So problem is, pos-tagging has varying degrees of accuracy. BEST pos-taggers on clean data like wall street journal are 97.3 or 97.4% accurate, falling off as you go to any other domain, and chat is worse.
CS pos-tagger is a work in progress, only about 94% on WSJ. If you also have treetagger english, its better than either one alone.
 

 
Posted: Nov 26, 2017
   [ # 2 ]

Thank you Bruce for the prompt advice. With that understanding I shall adjust my way to do it.

Michael
 

 
  login or register to react
‹‹ Are there a complete open-source chat bot to use?      A weird unicode match error ››