Encoding issue with Axios

Question

I am fetching a web page with axios, but the content-type of the response is ISO-8859-1, and the result given by axios seems like it parses it as UTF-8 and the result has corrupt characters.

I tried to convert the result encoding but nothing works, and I think it does not because of this

For example in the got library I can set encoding to null and overcome the problem, but I would like to ask you what can I do with axios to disable the auto-encoding or change it?

score 32 · Accepted Answer · edited Jan 05 '22 at 01:08

32

My approach was this:

Make the request with responseType and responseEncoding set as below

const response = await axios.request({
  method: 'GET',
  url: 'https://www.example.com',
  responseType: 'arraybuffer',
  responseEncoding: 'binary'
});

Decode reponse.data to the desired format

let html = iso88592.decode(response.data.toString('binary'));

Note: In my case, I needed to decode it using this package.

edited Jan 05 '22 at 01:08

Dharman

30,962
25
85
135

answered Nov 19 '18 at 10:27

Daniel Turuș

596
6
19

It works very well also if you have to fetch a png and save to disk. You can pass `response.data` to `fs.writeFile()` after setting `responseType` and `responseEncoding` as suggested by @Daniel – Jacopo Sep 14 '19 at 09:31
hi, I really thank your help, I solved just for what you write. I am pretty new coding, could you reply these questions? - I didn't use decode, just => $('.aditem', result.data.toString('binary')).each((i, element) => { - last posted here, said lating1 too, what's the difference? - could you send where to start learning about this? your resource, please thanks a lot – titoih May 22 '20 at 15:03
Which type is `iso88592`? I get `Cannot find name 'iso88592'.ts(2304)`. You may need `import * as iso88592 from 'iso-8859-2'` from `iso-8859-2` npm package. I see your link at the end, please put it on top of your answer. – Timo Nov 29 '22 at 12:16
iso88592 is undefined and I have no idea what its meant to be :D – Jamie Hutber Mar 02 '23 at 14:12

score 13 · Answer 2 · edited Oct 06 '20 at 09:53

13

Without using interceptor or another package, I got the response on a buffer with:

notifications = await axios.request({
    method: 'GET',
    url: Link,
    responseType: 'arraybuffer',
    reponseEncoding: 'binary'
});

And next converting it with:

let html = notifications.data.toString('latin1');

edited Oct 06 '20 at 09:53

ThreeCheeseHigh

1,429
5
22
40

answered Dec 09 '19 at 14:32

Carlos Gutierrez

131
1
3

score 4 · Answer 3 · edited Oct 06 '20 at 10:34

4

In this github issue Matt Zabriskie recommends using an axios response interceptor, which I think is the cleanest option.

axios.interceptors.response.use(response => {
    let ctype = response.headers["content-type"];
    if (ctype.includes("charset=ISO-8859-1")) {
        response.data = iconv.decode(response.data, 'ISO-8859-1');
    }
    return response;
})

edited Oct 06 '20 at 10:34

ThreeCheeseHigh

1,429
5
22
40

answered Jan 10 '19 at 12:10

Guido

46,642
28
120
174

score 3 · Answer 4 · answered Sep 20 '21 at 15:16

const notifications = await axios.request({
    method: 'GET',
    url: 'https://...your link',
    responseType: 'arraybuffer',
    reponseEncoding: 'binary'
});

const decoder = new TextDecoder('ISO-8859-1');
let html = decoder.decode(notifications.data)

Encoding issue with Axios

4 Answers4

Linked

Related