• Resolved Sim2K

    (@sim2k)


    This is a great plugin, a very smart plugin, thanks for making it.

    For it to really work for my site I really need pinecone namespaces to be used a lot more than they already are.

    My site is being created for many people to use and if they are all uploading their data to the same namespace then embeddings will not work as intended in this site. People will be searching for answers to their own data and getting responses based on other peoples data which will be a fail.

    For basic use on one website with one set of data, this is cool for basic use, but if I want to use your plugin to benefit multiple people, then I can’t use it.

    An idea is to create a name space for the site as usual like ‘DataSite‘ and all general site data is stored under that name space. When someone joins, they are given a name space for their own data like ‘DataSite_UsersID‘. When a user uploads data to pinecone through the creation of a post, it saves to their name space only so when a chatbot is created for that user, it can point to namespace DataSite_UsersID and only search and show the users data. So when a post is created, it creates namespace DataSite_UsersID if it does not exist in pinecone and stores the users data there and a chatbot pointing to that namespace is created automatically for that user if one does not it exist.

    So each user will have their own namespace for their own data and their own chatbot for their data. This would be a amazing and the logic shouldn’t be that hard I don’t think.

    Even better would be DataSite_UsersID_UserCatergory and a search bot per category per user. This will make the plugin actually work for people who need to use it for multiple users. This option would be perfect.

    By the way, I’m a paying customer and can send my payment ID on request as proof.

    please consider this option and I can then use your plugin for my website.

    • This topic was modified 3 years ago by Sim2K.
Viewing 6 replies - 1 through 6 (of 6 total)
  • Plugin Author Jordy Meow

    (@tigroumeow)

    Hi,

    Actually, AI Engine will support dynamic indexes and namespaces for the chatbot sometimes soon. However, in your case, what will go inside the embeddings related to the users? How those embeddings will be created and by who?

    Thread Starter Sim2K

    (@sim2k)

    Hi, thanks for the response which is why I do like this plugin as the owner, you, actually care about your plugin and its users.

    Ok, here is the scenario. My site is going to be about events, a chat bot based on any type of event for anybody, any where, in any language.

    • The user registers on my site (Thats where the UserID comes from)
    • The user uploads details about their event through a form creating a post in a custom post type. Each event will be a Category or a name of the event or an event ID.
    • When that post is created, it is dumped into Pinecone as an embedding automatically.
    • Now the embedding namespace would look like this… DataSite_UsersID_UsersEventID for example EventSiteName_125_Event451 or wwwEventSiteCom_BigJohn_QuizNight
      These namespaces can be dynamically created based on the site name, user ID and post ID easily and the namespace can be deleted as soon as the event is done or post is deleted. (If a post of a certain custom post type is deleted, dynamically create the namespace and see if it exists, if so, delete it from Pinecone).
    • Now say Big John is running 2 separate quiz nights, he can have 2 separate chatbots for each event and each question won’t get mixed up with both events as there will be 2 separate embeddings which will not conflict with each other.

    The problem is this, if I have multiple events on one website, with embeddings created for each event as a post, all these similar embeddings under the same namespace cannot work. With separate name spaces for each event, this can work amazingly! I checked with Pinecone, you can have unlimited namespaces so this in theory can most definitely work.

    • This reply was modified 3 years ago by Sim2K.
    Thread Starter Sim2K

    (@sim2k)

    Basically, a custom post type can be setup to put all post contents into one Namespace, a default namespace that holds everything, maybe just site general data.

    But another separate custom post type can be used in the way I described above.

    • This reply was modified 3 years ago by Sim2K.
    Plugin Author Jordy Meow

    (@tigroumeow)

    Okay, I see, but basically that means more or less that you would like to handle many different chatbots, one for each user?

    Why not creating a WordPress instance for each user?

    Maybe I am trying to understand the concept of this; right now it sounds like each user only has its knowledge base, but it’s not for anyone else.

    Also, do they have that many events? Because if they don’t, you could automatically feed the context at every load of the chatbot with all the events and there will be less complexity, queries and costs too 🙂

    Thread Starter Sim2K

    (@sim2k)

    Hi Jordy

    The events could be a small Birthday party for 10 people or a huge corporate event for 10,000 people over 3 days with 100 workshops. One could easily fit in a post, one would be a huge amount of data over multiple embeddings as its context would be to much for the prompt and completion.

    The main important thing is for me is for the answers people get when talking to ChatGPT are not mixed up with someone else’s event, even though there might be similar events in the embeddings, especially if its a big event which has a huge amount of data so it has to be an embedding. This is why I need dynamic namespaces created so I can put a whole event inside a namespace and search within that namespace only, plus its cheaper than using many indexes.

    Thread Starter Sim2K

    (@sim2k)

    I need each user to have a link like this ..
    http://www.AI4UEvents.com/e/1234567
    This would be unique to the user and their event and their namespace

    Plus I want to make an app from this later allowing users to question an event in detail but from an app.

    Yes, each user will have it s own knowledge base, and individual namespaces will solve all this. I don’t want to create a multiple instances as that would be an overkill for what I’m trying to do.

    I hope to have 1000’s of individual events on the site and a chatbot for each event.

    Maybe in the future I can somehow check the content length of a post to decide if it requires embeddings or just an automatic feed of the context at every load.

Viewing 6 replies - 1 through 6 (of 6 total)

The topic ‘Pinecone namespaces needed’ is closed to new replies.