How to encode UTF-8 CloseableHttpClient request

Question

I have a simple POST:

String url = "https://mysite";
try (CloseableHttpClient httpClient = HttpClients.custom().build()) {   
   URIBuilder uriBuilder = new URIBuilder(url);
   HttpPost request = new HttpPost();
   List<NameValuePair> nameValuePairs = new ArrayList<>(params);
   request.setEntity(new UrlEncodedFormEntity(nameValuePairs, StandardCharsets.UTF_8.name()));
   String encodedAuthorization = URLEncoder.encode(data, StandardCharsets.UTF_8.name());

    request.addHeader("Authorization", encodedAuthorization);
   try (CloseableHttpResponse response = httpClient.execute(request)) {

I have to support UTF-8 encoding and encoding UrlEncodedFormEntity isn't enough, but it's not clear what must be done, following several options available

Using uriBuilder.setCharset:

HttpPost request = new HttpPost(uriBuilder.setCharset(StandardCharsets.UTF_8)).build());

Using http.protocol.content-charset parameter:

HttpPost request = new HttpPost(uriBuilder.setParameter("http.protocol.content-charset", "UTF-8").build());

Or just adding Content-Type"` header:

request.setHeader("Content-Type", "application/x-www-form-urlencoded; charset=UTF-8");

Or use request.getParams():

request.getParams().setParameter("http.protocol.version", HttpVersion.HTTP_1_1);
request.getParams().setParameter("http.protocol.content-charset", "UTF-8");

Or other obvious solution I overlooked?

score 1 · Answer 1 · 2019-04-24T06:19:58.813

1

// Method to encode a string value using `UTF-8` encoding scheme
private static String encodeValue(String value) {
    try {
        return URLEncoder.encode(value, StandardCharsets.UTF_8.toString());
    } catch (UnsupportedEncodingException ex) {
        throw new RuntimeException(ex.getCause());
    }
}

public static void main(String[] args) {
    String baseUrl = "https://www.google.com/search?q=";

    String query = "Hellö Wörld@Java";
    String encodedQuery = encodeValue(query); // Encoding a query string

    String completeUrl = baseUrl + encodedQuery;
    System.out.println(completeUrl);
}

}

Output

https://www.google.com/search?q=Hell%C3%B6+W%C3%B6rld%40Java

I think this may be the solution.

You refer to above: https://www.urlencoder.io/java/

edited Apr 24 '19 at 06:19

answered Apr 24 '19 at 06:17

what's the connection to `CloseableHttpClient`? – Ori Marko Apr 24 '19 at 06:17
I am not sure for this solution but you should consult: httpPost.addRequestHeader("Content-Type", "text/plain;charset=UTF-8"); – Apr 24 '19 at 06:28
If the url you include is text, you can use the code above. – Apr 24 '19 at 06:28

score 0 · Accepted Answer · answered May 30 '19 at 05:37

0

To properly encode I move to use parameters in List<NameValuePair> over URIBuilder

and then encode using

URLEncodedUtils.format(nameValuePairs, StandardCharsets.UTF_8.name());

answered May 30 '19 at 05:37

Ori Marko

56,308
23
131
233

How to encode UTF-8 CloseableHttpClient request

2 Answers2

Output