Beeline-Hive returns CSV with blank rows on top of data

Question

My script does simple job, run SQL from a file and save to CSV.

Code is up and running but there is odd behaviour while producing CSV output. Data starts at around line 70, rather then from very beginning in the CSV file.

#!/bin/bash
beeline -u jdbc:hive2:default -n  -p  --silent=true --outputformat=csv2 -f code.sql > file_date+`%Y%m%d%H%M%`.csv

I would like my data to start at the very first row of actual data.

1 blank;blank;blank
2 blank;blank;blank
3 blank;blank;blank
4 attr;attr;attr
5 data;data;data
6 data;data;data
7 data;data;data
8 data;data;data
9 data;data;data

Did you try sorting any of the column values in the table through the query present in `code.sql` file? Also, provide the query ran if possible. — Gomz, Aug 08 '19 at 11:43
If you do not want the blank data to come at the top, you can perform the `ORDER BY` in the reverse. i.e., perform `DESC` if `ASC` is in place or vice versa. — Gomz, Aug 08 '19 at 11:56
`ORDER BY` didn't work - file still gets created with blank rows on top of my data — marcin2x4, Aug 29 '19 at 14:47
Did you try in both the ways? ```ORDER BY DESC``` & ```ORDER BY ASC``` ? — Gomz, Aug 29 '19 at 14:50

score 4 · Accepted Answer · answered Sep 03 '19 at 07:55

4

Workaround embedded in next step of my automation:

 sed -i '/^$/d' file.txt

answered Sep 03 '19 at 07:55

marcin2x4

1,321
2
18
44

Beeline-Hive returns CSV with blank rows on top of data

1 Answers1