slow response time

  • Resolved w3nta1

    (@w3nta1)


    3 years, 1 month ago

    Hi. The response time of the chatbot is too slow, sometimes it takes up to 40 or 50 seconds to response. Any way to speed up the time?

    • This topic was modified 3 years, 1 month ago by w3nta1.
Viewing 1 replies (of 1 total)
  • Plugin Author Jordy Meow

    (@tigroumeow)

    3 years, 1 month ago

    Hi @w3nta1,

    Yeah, sometimes OpenAI servers can be very slow. Which model are you using? Are you using embeddings as well, or moderation? 40-50s is however very long. In my case, it takes 3-5s. Have a look at my own chatbot here: http://meowapps.com. It uses GPT-3.5 with embeddings, so it’s actually quite a lot of requests, but still don’t take more than 10s.

Viewing 1 replies (of 1 total)

The topic ‘slow response time’ is closed to new replies.