How do you print chunked output with curl?

Question

I can see chunked output as it arrives with:

curl http://asia.dabase.com:4000

However when I try loop and work with it like so:

curl -s http://asia.dabase.com:4000 | while read line; do echo $line; done

It doesn't print anything. :(

A previous answer suggests CURLOPT_WRITEFUNCTION, though I don't see how that's done from curl's manpage.

seems to be working, is the url you are trying to curl return binary contents ? — ajreal, Dec 10 '11 at 15:39
Yup, is OK for me when using another URL. Are you sure the URL is working ? — ajreal, Dec 10 '11 at 15:43
but does not work for me, the page is hang, and no output being returned — ajreal, Dec 10 '11 at 15:56

score 1 · Accepted Answer · answered Dec 12 '11 at 08:36

I have since taken the site asia.dabase.com down, though I have found the solution using a tool I've never heard of until now called stdbuf.

stdbuf -oL curl -s http://asia.dabase.com:4000

This allows me to immediately start working with a chunked stream.

1 Answers1