Big Binary Code into File in Python

Question

I have been working on a program and I have been trying to convert a big binary file (As a string) and pack it into a file. I have tried for days to make such thing possible. Here is the code I had written to pack the large binary string.

binaryRecieved="11001010101....(Shortened)"
f=open(fileName,'wb')
m=long(binaryRecieved,2)
struct.pack('i',m)
f.write(struct.pack('i',m))
f.close()
quit()

I am left with the error

struct.pack('i',x)
struct.error: integer out of range for 'i' format code

My integer is out of range, so I was wondering if there is a different way of going about with this.

Thanks

I'm guessing you mean `m` instead of `x`? In that case `long` is too much for something that only supports an integer — Andrew Li, Sep 17 '16 at 05:23

score 1 · Answer 1 · edited May 23 '17 at 10:27

1

Convert your bit string to a byte string: see for example this question Converting bits to bytes in Python. Then pack the bytes with struct.pack('c', bytestring)

edited May 23 '17 at 10:27

Community

1
1

answered Sep 17 '16 at 06:05

James K

3,692
1
28
36

janbrohl · Answer 2 · 2016-09-18T08:55:39.970

For encoding m in big-endian order (like "ten" being written as "10" in normal decimal use) use:

def as_big_endian_bytes(i):
    out=bytearray()
    while i:
        out.append(i&0xff)
        i=i>>8
    out.reverse()
    return out

For encoding m in little-endian order (like "ten" being written as "01" in normal decimal use) use:

def as_little_endian_bytes(i):
    out=bytearray()
    while i:
        out.append(i&0xff)
        i=i>>8
    return out

both functions work on numbers - like you do in your question - so the returned bytearray may be shorter than expected (because for numbers leading zeroes do not matter).

For an exact representation of a binary-digit-string (which is only possible if its length is dividable by 8) you would have to do:

def as_bytes(s):
    assert len(s)%8==0
    out=bytearray()
    for i in range(0,len(s)-8,8):
        out.append(int(s[i:i+8],2))
    return out

score 0 · Accepted Answer · edited Sep 17 '16 at 07:21

0

In struct.pack you have used 'i' which represents an integer number, which is limited. As your code states, you have a long output; thus, you may want to use 'd' in stead of 'i', to pack your data up as double. It should work.

See Python struct for more information.

edited Sep 17 '16 at 07:21

Christopher Bottoms

11,218
8
50
99

answered Sep 17 '16 at 05:37

Mehrdad Dadvand

340
4
19

While doubles are (almost) unilimited in how large the numbers may be, they can represent only integers up to 56bit exacly. – janbrohl Sep 17 '16 at 07:07
+jahbrohl Do you have an alternative? – Dan Sep 18 '16 at 07:45
1

Yes, see my answer – janbrohl Sep 18 '16 at 08:41

Big Binary Code into File in Python

3 Answers3