I'm using pyspark to read textfiles which are encoded by gbk. So how can i use pyspark to read this files by gbk.
read.csv() can't read whole line, hadoopfile() only support 'utf-8'
Asked
Active
Viewed 59 times
0
-
You can go through this answer: https://stackoverflow.com/questions/904041/reading-a-utf8-csv-file-with-python – C_codio Jun 04 '19 at 07:08
-
use pyspark,not only python – cxco Jun 04 '19 at 10:46