Streaming from edge function is working, but chunks arrive together at once at the end

Support
, , ,
1

I’m using an LLM API’s streaming feature (for Claude). It was fine until past couple of days but suddenly it stopped working. Streaming from edge function is working, but chunks arrive together at once at the end. It works fine in my local server.
This happened without me doing anything with the code so I’m thinking I don’t have anything to do with it.
I tried doing the streaming without external packages and without edge functions. All of them worked on my local server but didn’t work on netlify.

Left is localhost, right is live production in netlify servers.

image
image1096×668 46.6 KB

2

I think we might have the same issue, only that we’re using Remix and Netlify Functions. I posted here on the support forum earlier today. It’s as if the streaming is blocked until all promises are resolved, which defeats the purpose of deferring the data loading for later and showing the content shell/loading state first. I’m stumped.

4

I’ve asked the devs to take a look.