1

I am trying to load a file that around 25 gigabyte to MYsql i was going to write a script but saw a stackoverflow thread of load data command so trying

LOAD DATA INFILE 'file_path\\test.txt' INTO TABLE my_table
fields terminated by ":";

the result was seeming to be ok but the mysql workbench connection seems to drop after a while maybe because of the file size of course. so what can i do, and is python script be more efficient in this case and more importantly more reliable since i cant withstand of any error of course occurring in the middle of this long process.

KMG
  • 1,433
  • 1
  • 8
  • 19

1 Answers1

0

You can load the data in chunks using python script with multiple thread as per your system configuration.

NIKHIL KULSHRESTHA
  • 134
  • 9