htmlentites not working for emoji

Question

I am trying to show a characters html entity

echo htmlentities(htmlentities("&"));
//outputs &amp;
echo htmlentities(htmlentities("<"));
//outputs &lt;

but it does not seem to work with emoji

echo htmlentities(htmlentities(""));
//outputs

How can I get it to output 😎?

Edit:

I am trying to display a string input by the user with all of the html entities encoded.
echo htmlentities(htmlentities($input))

Example: "this & that " -> "this & that 😎"

Out of curiosity.. why do this at all? If you're outputting unicode there's no need for entities. — Evert, Jan 22 '16 at 21:25
not if content-type is text/html. the first & gets converted to & — Tony Brix, Jan 22 '16 at 21:28
@TonyBrix no, your browser displays it as `&` but it is not converted, check source of the page — Iłya Bursov, Jan 22 '16 at 21:29
@Evert I am trying to display the html entity code to the user — Tony Brix, Jan 22 '16 at 21:32

score 13 · Accepted Answer · answered Jan 27 '16 at 23:16

This works for regular HTML entities, UTF-8 emoticons (and other utf stuff) as well as regular strings of course.

I was just having trouble with empty string value, so I had to put this condition into the function.

function entities( $string ) {
    $stringBuilder = "";
    $offset = 0;

    if ( empty( $string ) ) {
        return "";
    }

    while ( $offset >= 0 ) {
        $decValue = ordutf8( $string, $offset );
        $char = unichr($decValue);

        $htmlEntited = htmlentities( $char );
        if( $char != $htmlEntited ){
            $stringBuilder .= $htmlEntited;
        } elseif( $decValue >= 128 ){
            $stringBuilder .= "&#" . $decValue . ";";
        } else {
            $stringBuilder .= $char;
        }
    }

    return $stringBuilder;
}

// source - http://php.net/manual/en/function.ord.php#109812
function ordutf8($string, &$offset) {
    $code = ord(substr($string, $offset,1));
    if ($code >= 128) {        //otherwise 0xxxxxxx
        if ($code < 224) $bytesnumber = 2;                //110xxxxx
        else if ($code < 240) $bytesnumber = 3;        //1110xxxx
        else if ($code < 248) $bytesnumber = 4;    //11110xxx
        $codetemp = $code - 192 - ($bytesnumber > 2 ? 32 : 0) - ($bytesnumber > 3 ? 16 : 0);
        for ($i = 2; $i <= $bytesnumber; $i++) {
            $offset ++;
            $code2 = ord(substr($string, $offset, 1)) - 128;        //10xxxxxx
            $codetemp = $codetemp*64 + $code2;
        }
        $code = $codetemp;
    }
    $offset += 1;
    if ($offset >= strlen($string)) $offset = -1;
    return $code;
}

// source - http://php.net/manual/en/function.chr.php#88611
function unichr($u) {
    return mb_convert_encoding('&#' . intval($u) . ';', 'UTF-8', 'HTML-ENTITIES');
}

/* ---- */

var_dump( entities( "&" ) ) . "\n";
var_dump( entities( "<" ) ) . "\n";
var_dump( entities( "" ) ) . "\n";
var_dump( entities( "☚" ) ) . "\n";
var_dump( entities( "" ) ) . "\n";
var_dump( entities( "A" ) ) . "\n";
var_dump( entities( "Hello  world" ) ) . "\n";
var_dump( entities( "this & that " ) ) . "\n";

score 4 · Answer 2 · edited May 23 '17 at 12:17

4

$emoji = "\xF0\x9F\x98\x8E"; // its your emoji

I get this callback from convert unicode to html entities hex

$hex = preg_replace_callback('/[\x{80}-\x{10FFFF}]/u', function ($m) {
    $char = current($m);
    $utf = iconv('UTF-8', 'UCS-4', $char);
    return sprintf("&#x%s;", ltrim(strtoupper(bin2hex($utf)), "0"));
}, $emoji);

echo $hex;

echo json_encode(("\xF0\x9F\x98\x8E")); // its decoded. htmlentities doesn't work with it.

Is this OK ?

edited May 23 '17 at 12:17

Community

1
1

answered Jan 27 '16 at 19:56

FZE

1,587
12
35

This doesn't work for regular html entities. The string I am trying to convert is input from the user so I don't know if it will be "" or "&" or "A". I would need a function that takes any input and outputs a string with html entities encoded – Tony Brix Jan 27 '16 at 21:03
The input could also be a string with more than one character – Tony Brix Jan 27 '16 at 21:10
How about to use something like this instead of htmlentities ? http://php.net/manual/en/function.bin2hex.php#48861 you may need to make a benchmark. But it looks OK. – FZE Jan 27 '16 at 22:04
1

Btw, it is not possible to sanitize these input with html_special_chars or htmlentities check this out. https://github.com/php/php-src/blob/PHP-5.6.18/ext/standard/tests/strings/get_html_translation_table_basic1.phpt it is table using for htmlentities and special chars – FZE Jan 27 '16 at 22:18

Mihai Răducanu · Answer 3 · 2016-01-29T13:52:35.550

htmlentities documentation states that

all characters which have HTML character entity equivalents are translated into these entities.

Your emoji does not have an equivalent like < is for <, so it doesn't get converted. 😎 is just an HTML code, not an HTML entity.

function htmlEntitiesOrCode($string) {
    //try htmlentities first
    $result = htmlentities($string, ENT_COMPAT, "UTF-8");

    //if the output is different from input, an entity was returned
    if ($result != $string) {
        return $result;
    }

    //get the html code
    $offset = 0;
    $code = ord(substr($string, $offset,1));
    if ($code >= 128) {
        if ($code < 224) {
            $bytesnumber = 2;
        } else if ($code < 240) {
            $bytesnumber = 3;
        } else if ($code < 248) {
            $bytesnumber = 4;
        }
        $codetemp = $code - 192 - ($bytesnumber > 2 ? 32 : 0) - ($bytesnumber > 3 ? 16 : 0);
        for ($i = 2; $i <= $bytesnumber; $i++) {
            $offset ++;
            $code2 = ord(substr($string, $offset, 1)) - 128;
            $codetemp = $codetemp*64 + $code2;
        }
        $code = $codetemp;
    }
    $offset += 1;
    if ($offset >= strlen($string)) {
        $offset = -1;
    }

    $result = "&#" . $code;
    return $result;
}

HTML code function taken from here: http://php.net/manual/en/function.ord.php#109812

htmlentites not working for emoji

3 Answers3

Linked