Is it possible to write json chunk by chunk with pandas

Question

I've got a web server (tornado), and want to serialize a large dataframe to json but chunk by chunk, not creating the whole json string then sending it.

Is that possible ?

See if this helps https://stackoverflow.com/questions/38531195/writing-panda-dataframes-to-csv-file-in-chunks — Hassan Voyeau, Sep 17 '18 at 15:50

score 0 · Answer 1 · answered Sep 18 '18 at 07:35

0

The http server (tornado) implements so this works :

import tornado.ioloop
import tornado.web
impot pandas as pd

df=pf.DataFrame({"test":[1,2,3,4]})

class MainHandler(tornado.web.RequestHandler):
    def get(self):
        df.to_json(self)

answered Sep 18 '18 at 07:35

julienfr112

2,077
2
25
37

Is it possible to write json chunk by chunk with pandas

1 Answers1