Memory and Token Usage

  • Resolved Anonymous User 18191698

    (@anonymized-18191698)


    3 years, 4 months ago

    Hi there. There are two issues which I have been in touch about and have replied via email, though, I am not sure if you are receiving them.

    1. It would be great if one could enable, disable, or tweak token usage in regard to how the chatbot memory works. For example, the option to enable, disable, and set number of tokens for memory would be really useful because sometime, u don’t need the bot to remember e.g. if I had an app which purely fixes grammar(no need for memory there). What would also be ideal is if it you could apply a setting in the backend so that users could add memory parameters i.e. what the bot should focus on(regarding memory). For example, Focus on remembering and recalling 1. names 2. dates, nouns, verbs, and so on.

    2. Regarding storage, I like the fact that u can add an id and have the messages stored for later. However, let’s say u had a stored conversation, and returned to it at a later point, the chatbot does not remember the content. If you could add the following option: 1. Retain memory 1. Yes 2.No 3. If yes, how long?

    Thanks for doing a great job. Have a great day.

Viewing 1 replies (of 1 total)
  • Plugin Author Jordy Meow

    (@tigroumeow)

    3 years, 4 months ago

    Hi @ai6667,

    Hi there. There are two issues which I have been in touch about and have replied via email, though, I am not sure if you are receiving them.

    I do; if you didn’t get answers within 24 hours there might be a problem though! (or maybe I missed something, I am constantly working these days and replying swiftly to everyone became really hard)

    For example, Focus on remembering and recalling 1. names 2. dates, nouns, verbs, and so on.

    Mmm, that sounds… extremely hard 🙂 Do you have a technical solution for this in mind? I don’t any, or I would need to query the AI regularly in order to create and maintain some kind of memory. But even the ChatGPT service online doesn’t do that.

    However, let’s say u had a stored conversation, and returned to it at a later point, the chatbot does not remember the content.

    This feature is only to remember the conversation when going to one page to another. It’s not a feature to actually save and continue a conversation later; that kind of feature will come later at a certain point, and I will have the same possibility as what ChatGPT has.

Viewing 1 replies (of 1 total)

The topic ‘Memory and Token Usage’ is closed to new replies.