Encode InputStream response as UTF-8

Question

I'm trying to make a connection to a URL which displays some data in plain text on a webpage (it's a block of text in between <pre> tags). Whenever a character with a character with a special character is passed through (for example é or ì) it displays a question mark instead of the character a � is displayed. I've tried using this but that didn't change much. I can't read the page per line so I'm pretty much stuck here.

Here is my code:

 try
        {
            // Open the connection 
            NetworkManager networkManager = NetworkManager.getInstance();
            networkManager.addErrorListener(new ActionListener()
            {
                public void actionPerformed(ActionEvent evt)
                {
                    NetworkEvent n = (NetworkEvent) evt;
                    n.getError().printStackTrace();
                    success = false;
                }
            });
            ConnectionRequest request = new ConnectionRequest()
            {               
                {
                    setTimeout(40000);
                }

            @Override
            protected void readResponse(InputStream input) throws IOException
            {
                InputStreamReader inputStreamReader = new InputStreamReader(input, "UTF-8");
                int chr;
                buffer = new StringBuilder();
                //reading the answer                     
                while ((chr = inputStreamReader.read()) != -1)
                {
                    System.out.println("Append the character " + (char) chr);
                    buffer.append((char) chr);
                }
                response = buffer.toString();
                response = response.trim();

                data = new byte[buffer.length()];
                int tmpCounter = buffer.length();
                counter = 0;                    
                while (counter != buffer.length())
                {
                    for (int i = 0; i < tmpCounter; i++)
                    {
                        data[counter + i] = (byte) buffer.charAt(i);
                    }
                    counter += tmpCounter;
                }
                process(data);
                dataEvent.setDataAvailable();
            }

            @Override
            protected void handleException(Exception err)
            {
                success = false;
                dataEvent.setDataAvailable();
            }
        };
        request.setUrl(url);
        request.setPost(false);
        networkManager.addToQueue(request);
    }
    catch (Exception x)
    {
        x.printStackTrace();
    }

This code is quite inefficient, try reading with `Util.readToString(input, "UTF-8")`. I'm not sure I follow the problem, does the UTF-8 character work after that code? How is the problem expressed? — Shai Almog, Dec 21 '18 at 04:19
I know the code is inefficient but I'm afraid at this moment in time I don't have the time to actually make it efficient. Turns out my response wasn't UTF-8, thanks for the help though. — Rodin10, Dec 21 '18 at 07:16
That single line of code would be MUCH faster than that block ;-) — Shai Almog, Dec 22 '18 at 05:29

score 0 · Accepted Answer · answered Dec 21 '18 at 07:16

0

Turns out the actual response didn't respond using UTF-8 the characters were just readable in my browser. I fixed it by specifying the response characters should be UTF-8

answered Dec 21 '18 at 07:16

Rodin10

327
3
15

Encode InputStream response as UTF-8

1 Answers1