JWE defines a JSON-friendly way to encrypt arbitrary data.
So what you want (encrypt a python dictionary, which maps to a JSON object) is not a JWE but actually a JWT token. A JWT is basically using the JWS and JWE standards to sign and/or encrypt a JSON object.
Just use the JWT part of jwcrypto doc: https://jwcrypto.readthedocs.io/en/latest/jwt.html
Should be something like that:
from jwcrypto.jwt import JWT
from jwcrypto.jwk import JWK
claims = {"my": "claims"} # your claims as a Python dict, that can be JSON-encoded
key = JWK.generate(kty='EC').public() # this generates an EC key, you must replace that with your recipient public key
jwt = JWT(header={"alg": "ECDH-ES+A128KW", "enc": "A256CBC-HS512"}, claims=claims) # set your own alg here according to your needs
jwt.make_encrypted_token(key)
serialized_jwt = jwt.serialize()
Then the deserialization must be done with a library assuming that the token is a JWT otherwise you indeed end up with a string representation of the JSON payload, that you will have to decode yourself to a Python dict.