4

I am using C++ functions in Python by SWIG,and I met a problem now. When I pass a char * from C++ to Python, the char * is truncted by Python.

For example:

example.h:

char * fun()
{
    return "abc\0de";
}

now in Python,we call example.fun() it only print "abc" instead of "abc\0de" the data behind '\0' is deleted by Python.

I want to get all the chars(it is a binary data that can contains '\0') from fun() in C++, and any advise is appreciated

Flexo
  • 87,323
  • 22
  • 191
  • 272
kaitian521
  • 548
  • 2
  • 10
  • 25
  • The reverse situation (passing binary data **to** C/C++) is well covered by the docs. (Your question is not so well covered AFAIK). http://www.swig.org/Doc3.0/Library.html#Library_nn10 – Bjorn Roche Jul 18 '17 at 20:35

3 Answers3

8

First of all, you should not use char * if you are dealing with binary data (swig thinks that they are normal strings). Instead you should use void *. swig provides a module named 'cdata.i' - you should include this in the interface definition file.

Once you include this, it gives two functions - cdata() and memmove().

  • Given a void * and the length of the binary data, cdata() converts it into a string type of the target language.
  • memmove() does the reverse - given a string type, it will copy the contents of the string(including embedded null bytes) into the C void* type.

Handling binary data becomes much simpler with this module. I hope this is what you need.

example.i
%module example
%include "cdata.i"
%{
void *fun()
{
        return "abc\0de";
}
%}

test.py
import example
print example.cdata(example.fun(), 6)
BenMorel
  • 34,448
  • 50
  • 182
  • 322
sunil
  • 3,507
  • 18
  • 25
6

C/C++ strings are NULL-terminated which means that the first \0 character denotes the end of the string.

When a function returns a pointer to such a string, the caller (SWIG in this case) has no way of knowing if there is more data after the first \0 so that's why you only get the first part.

So first thing to do is to change your C function to return not just the string but its length as well. Since there can be only one return value we'll use pointer arguments instead.

void fun(char** s, int *sz)
{
    *s = "abc\0de";
    *sz = 6;
}

The SWIG docs suggest using the cstring.i library to wrap such functions. In particullar, the last macro does exactly what you need.

%cstring_output_allocate_size(parm, szparm, release)

Read the docs to learn how to use it.

yak
  • 8,851
  • 2
  • 29
  • 23
  • Sorry for my poor English(haha,I am a Chinese), and you help me solve the problem that confused me for about one whole week. thank you very much ~~~ – kaitian521 Nov 17 '11 at 09:51
0

See 8.3 C String Handling in the documentation.

Also from the documentation:

The char * datatype is handled as a NULL-terminated ASCII string. SWIG maps this into a 8-bit character string in the target scripting language. SWIG converts character strings in the target language to NULL terminated strings before passing them into C/C++. The default handling of these strings does not allow them to have embedded NULL bytes. Therefore, the char * datatype is not generally suitable for passing binary data. However, it is possible to change this behavior by defining a SWIG typemap. See the chapter on Typemaps for details about this.

codeape
  • 97,830
  • 24
  • 159
  • 188