Enable Streaming Feature Doesnt Seem to Work

  • hemantsarthak

    (@hemantsarthak)


    11 months ago

    Hey Max,

    I enabled the Enable Streaming option in the mxchat options, but it doesnt seem to work, there is still a loader dots animation after the user types something for a few seconds, then all the text get visible at once.

    Any ideas on if its a bug or if I am doing something wrong?

    I have disabled autooptimize and cleared sites cache as well, Any other things could be causing this feature to not work?

    Can you please look into/help resolve this issue? I am using the latest mxchat version, with gpt4o on php8.2.

    Thank You

    Hemant

Viewing 11 replies - 1 through 11 (of 11 total)
  • Plugin Support m4xw3ll

    (@m4xw3ll)

    11 months ago

    Hi @hemantsarthak,

    Are you able to share the URL with me so I can review the network requests when chatting? This will help me start to understand what is happening. Not all hosting providers support streaming responses, but I’ll be able to review and see what’s going on.

    Thanks,

    Maxwell

    Thread Starter hemantsarthak

    (@hemantsarthak)

    11 months ago

    Hi Max

    I have shared the link via mail, instead of here, please check and let me know if you need anything else.

    Thank You

    Hemant

    Plugin Support m4xw3ll

    (@m4xw3ll)

    10 months, 3 weeks ago

    Hi @hemantsarthak,

    The website you linked doesn’t appear to be live anymore. It seems that was maybe a staging website. Did the issue resolve for you?

    Thanks,

    Maxwell

    Thread Starter hemantsarthak

    (@hemantsarthak)

    10 months, 3 weeks ago

    Hi @m4xw3ll

    Yes the website is a staging site but it isn’t disabled its just that the staging website goes to sleep after a while of inactivity, please just open the staging wesbite link I shared and let it load and connect for 2-4mins, it would connect and show you the staging website with the chatbot.

    Please let me know if you still cant connect to the staging site etc.

    Thank You

    • This reply was modified 10 months, 3 weeks ago by hemantsarthak.
    Plugin Support m4xw3ll

    (@m4xw3ll)

    10 months, 3 weeks ago

    Hi @hemantsarthak,

    I was able to load and review your website. It is calling the streaming function and its returning a streaming response in the network, but yes, its loading it all before showing. It could be related to something specific in your server environment that is causing it to buffer before displaying.

    I’ve reviewed and made the streaming response functions more robust. Would you be interested in testing the update? I’m not able to replicate on my end, so I’d really need to have you upload the test version to confirm if it’s good to go.

    Thanks,

    Maxwell

    • This reply was modified 10 months, 3 weeks ago by m4xw3ll.
    Thread Starter hemantsarthak

    (@hemantsarthak)

    10 months, 2 weeks ago

    HI @m4xw3ll Yes I would be open to testing the update max. Please let me know how it can be done.
    Thank You

    Hemant

    Plugin Support m4xw3ll

    (@m4xw3ll)

    10 months, 2 weeks ago

    Hi @hemantsarthak,

    I just released version 2.3.3. This includes a more robust streaming mechanism. Once you update, please let me know and I’ll check your website.

    Thank you,

    Maxwell

    Thread Starter hemantsarthak

    (@hemantsarthak)

    10 months, 2 weeks ago

    Hi @m4xw3ll

    I have updated the plugin to 2.3.3. Can you now please check the website.

    It doesnt seem to work at all now I think, like responses just seem to show a empty bubble.

    Thank You
    Hemant

    Plugin Support m4xw3ll

    (@m4xw3ll)

    10 months, 2 weeks ago

    Hi @hemantsarthak ,

    Thanks you and yes I see that. I ran some tests on your website and it appears you’re using cloudflare. I was hoping my recent update would be able to bypass cloudflare, but it doesn’t appear that it works. I believe the issue is that CloudFlare is buffering the response for optimization reasons. Can you do me a favor and pause cloudflare for a little and let me test? You would have to wait likely around 20 minutes after pausing before testing.

    Once disabled I’ll run some tests on my end to confirm the cloudflare is off and review the streaming.

    Thread Starter hemantsarthak

    (@hemantsarthak)

    10 months, 2 weeks ago

    Hi @m4xw3ll

    I am using wpengine, this staging site is running on their advanced network, I dont think they have a feature to disable cache outwrite, I have disabled the object cache though, and cleared all the cache.

    Please let me know if this works. Or if needed I can clone and host the website on a diff service for testing etc.

    Thank You

    Hemant

    • This reply was modified 10 months, 2 weeks ago by hemantsarthak.
    Plugin Support m4xw3ll

    (@m4xw3ll)

    10 months, 2 weeks ago

    Hey @hemantsarthak,

    Streaming responses aren’t supported in all hosting environments. Many setups (like WP Engine and Cloudflare) disable this feature for performance optimization reasons.

    I just released a patch update (v2.3.4) that fixes the blank chat bubble issue you and others were experiencing. When streaming fails, the chat now automatically falls back to regular responses instead of showing a blank bubble.

    I’d love to investigate this further if you’re interested. Since none of my test sites experience this issue, it’s challenging for me to diagnose the root cause and to find a work around. If you’re comfortable providing temporary access, please connect with me privately so I can take a closer look and potentially implement a solution for these hosting environments.

    Thanks for your patience!

Viewing 11 replies - 1 through 11 (of 11 total)

The topic ‘Enable Streaming Feature Doesnt Seem to Work’ is closed to new replies.