Convert Java byte array to Python byte array

Question

I know that if I figure this one out or if somebody shows me, it'll be a forehead slapper. Before posting any questions, I try for at least three hours and quite a bit of searching. There are several hints that are close, but nothing I have adopted/tried seems to work.

I am taking a byte[] from Java and passing that via JSON (with Gson) to a python JSON using Flask. This byte[] is stored in a python object as an integer list when received, but now I need to send it to MySQLdb and store it as a blob. The data contents is binary file data.

How do I convert a python integer list [1,2,-3,-143....] to something that I can store in MySQL? I have tried bytearray() and array.array(), but those choke when I access the list directly from the object and try and convert to a string to store thorugh MySQLdb.

Any links or hints are greatly appreciated.

score 6 · Accepted Answer · edited Feb 24 '11 at 09:59

You can join it into a bytestring (just a string under python 2.x). The simplest, if not most efficient, way would be to just mod the data, then convert to chars and join. Something like:

data = [1,2,-3,-143, ...]
binData = ''.join(map(lambda x: chr(x % 256), data))

binData = ''.join(map(lambda x: chr(x % 256), attach.attcoll))
    sql_stmt = """INSERT INTO attachments (attno,filename,fileextension,projNo,procNo,wpattachment) \
    VALUES ('%s','%s','%s','%s','%s','%s') ON DUPLICATE KEY UPDATE filename='%s',fileextension='%s'""" % (attach.attno,\
    attach.filename,attach.fileextension,attach.projNo,attach.procNo,binData,attach.filename,attach.fileextension)

    try:
        cursor.execute(sql_stmt)
        conn.commit()
        cursor.close()
        conn.close()
        return 'SUCCESS'
    except MySQLdb.Error:
        cursor.close()
        conn.close()
        print "My SQL cursor execute error."
        return 'FAILURE'

That's awesome and easier than I thought. Any ideas on how to get that into MySQL? — kirtcathey, Feb 24 '11 at 09:54
@kirtcathey I've barely ever used MySQL, and never from python, so unfortunately no. — cobbal, Feb 24 '11 at 09:57

score 3 · Answer 2 · answered Dec 13 '17 at 06:44

3

data = [1,2,-3,-143, ...]
binData = bytearray([x % 256 for x in data])

answered Dec 13 '17 at 06:44

Harold Liu

51
2

8

Please provide some explanation to go along with your code. – Trent Dec 13 '17 at 06:47

score 0 · Answer 3 · answered Jul 02 '15 at 14:35

0

I found ''.join(map(lambda x: chr(x % 256), data)) to be painfully slow (~4 minutes) for my data on python 2.7.9, where a small change to str(bytearray(map(lambda x: chr(x % 256), data))) only took about 10 seconds.

answered Jul 02 '15 at 14:35

qwertasdf

1
1

Convert Java byte array to Python byte array

3 Answers3

Linked