AI Zone Admin Forum Add your forum

NEWS: Chatbots.org survey on 3000 US and UK consumers shows it is time for chatbot integration in customer service!read more..

Amazon EC2 instance size for 100,000 users
 
 

Hello,

What Amazon EC2 instance size would be needed to support 100,00 concurrent users?

 

 
  [ # 1 ]

There is no machine that can serve that quantity alone. You need a fleet. As soon as you use a fleet, you need a central fileserver to store user data. Currently CS has direct support for using Postgres in that role.  And Postgres can also be sharded into a fleet when you get enough usage for that need.

 

 
  [ # 2 ]
Bruce Wilcox - Jun 10, 2016:

There is no machine that can serve that quantity alone. You need a fleet. As soon as you use a fleet, you need a central fileserver to store user data. Currently CS has direct support for using Postgres in that role.  And Postgres can also be sharded into a fleet when you get enough usage for that need.

Thank you very much for the reply, Bruce. How many servers would constitute the fleet? or perhaps put another way, how many users can a server within a fleet handle?

 

 
  [ # 3 ]

It depends on how complex your chatbot is, what it does for computation. Rose, our lead Loebner bot, nominally takes under 10ms on a cheap processor. So it can handle 100 users per second, but users take time, so a 10 second volley speed per user would mean 1000 users per second being handled.

 

 
  login or register to react