Getting Memory error to perform operation with readline python

Question

I am reading the file using readlines() function in python and storing the data to variable. it is worked fine with small text file, but getting the "Memory error" for big sized file.

Is there something we can use instead of readline() and store the data to varibale ass list?

with open("some_test.txt") as fp:
    line= fp.readlines()

Where Line is the List

You can just iterate the file object directly rather than load the whole file into memory — roganjosh, Feb 13 '20 at 13:00
Note that you keep changing between `readline` and `readlines`. Both exist and they do different things — roganjosh, Feb 13 '20 at 13:00

Mohammad Jafari · Answer 1 · 2020-02-13T13:05:06.693

0

You can iterate over lines

Try this way:

with open("some_test.txt") as fp:
    for line in fp:
        do_your_stuff(line)
        ...

EDITED: I made a mistake (didn't iterate)

edited Feb 13 '20 at 13:05

answered Feb 13 '20 at 13:02

Mohammad Jafari

1,742
13
17

score 0 · Answer 2 · answered Feb 13 '20 at 15:55

0

yeild is one of the best approach to handle huge data. Following link will helpful for you

https://stackoverflow.com/questions/519633/lazy-method-for-reading-big-file-in-python

answered Feb 13 '20 at 15:55

Saisiva A

595
6
24

Getting Memory error to perform operation with readline python

2 Answers2