Searching fast in big binary file in python

Asked Jul 06 '16 at 11:41

Active Jul 06 '16 at 11:48

Viewed 84 times

I have list of ~6000 data patterns for which I need to search in a relatively large (100 MB) binary file, so in worst case I need to traverse this binary file 6000 times.

Is there any way or any property of python data structure that I can use for fast search within a large binary file?

edited Jul 06 '16 at 11:48

asked Jul 06 '16 at 11:41

Pradeep Goswami

1,785
1
15
24

Multiprocess. If you're performing read-only operations, there's no reason this isn't safe. – erip Jul 06 '16 at 11:43
yes I am performing read only operation. Any other idea ? – Pradeep Goswami Jul 06 '16 at 11:44
Also, can you define "data pattern"? I've never heard this term. – erip Jul 06 '16 at 11:45
here data pattern means simple stream of bytes, I will update question – Pradeep Goswami Jul 06 '16 at 11:46

Searching fast in big binary file in python

0 Answers0