2

Anyone know how to expose python 2.x _hashlib.pyd internals using ctypes? I especially need to extract the EVP_MD_CTX struct for serialization of python HASH objects.

est
  • 11,429
  • 14
  • 70
  • 118

1 Answers1

3

Mapping C structures from header files (openssl/evp.h and _hashopenssl.c in your case) is straightforward, but is not always portable across different versions. Here it is for my environment:

from ctypes import *

PyObject_HEAD = [
    ('ob_refcnt', c_size_t),
    ('ob_type', c_void_p),
]

class EVP_MD(Structure):
    _fields_ = [
        ('type', c_int),
        ('pkey_type', c_int),
        ('md_size', c_int),
        ('flags', c_ulong),
        ('init', c_void_p),
        ('update', c_void_p),
        ('final', c_void_p),
        ('copy', c_void_p),
        ('cleanup', c_void_p),
        ('sign', c_void_p),
        ('verify', c_void_p),
        ('required_pkey_type', c_int*5),
        ('block_size', c_int),
        ('ctx_size', c_int),
    ]

class EVP_MD_CTX(Structure):
    _fields_ = [
        ('digest', POINTER(EVP_MD)),
        ('engine', c_void_p),
        ('flags', c_ulong),
        ('md_data', POINTER(c_char)),
    ]

class EVPobject(Structure):
    _fields_ = PyObject_HEAD + [
        ('name', py_object),
        ('ctx', EVP_MD_CTX),
    ]

Below is an example on how to use it to save and restore state of hash object:

import hashlib

hash = hashlib.md5('test')
print hash.hexdigest()

c_evp_obj = cast(c_void_p(id(hash)), POINTER(EVPobject)).contents
ctx = c_evp_obj.ctx
digest = ctx.digest.contents
state = ctx.md_data[:digest.ctx_size]

hash2 = hashlib.md5()
c_evp_obj = cast(c_void_p(id(hash2)), POINTER(EVPobject)).contents
ctx = c_evp_obj.ctx
digest = ctx.digest.contents
memmove(ctx.md_data, state, digest.ctx_size)
print hash2.hexdigest()
Community
  • 1
  • 1
Denis Otkidach
  • 32,032
  • 8
  • 79
  • 100
  • 1
    @est, beware: you will have to track openssl code, if you stay with this solution: if EVP_MD/EVP_MD_CTX changes in openssl code, your python code will break. For example, the code above won't work with any openssl versions prior to openssl-0.9.7. – abbot May 04 '11 at 12:31
  • Thank you for posting this. To @abbot's point, this code requires an update on Python 3.5+ and 2.7.13+ (`('ctx', EVP_MD_CTX)` becomes `('ctx', POINTER(EVP_MD_CTX))`). I ended up packaging a library based on this and other recipes: https://github.com/kislyuk/rehash – weaver Jul 13 '17 at 20:42