Scraping site with Request and Cheerio gets strange html content

Question

I'm trying to scrape a simple website with Cheerio and Request

Here is my code:

import request from 'request';
request('http://michaelhyatt.com/page/2', function(err, res, html) {
  console.log(html);
});

But the HTML that I get back is gibberish, some kind of weird encoded content:

���r� �lE�?��iSZb�,�DI�<��[k��-yy��v(@H�U������nE��y��y��9;��D����S֗�����M�duϲ�M�
H$�D"3��x����gg?�{����:�z���v�����4��7�c |���&����V��ڇ␌��3⎼�┌["�:��

What am I doing wrong? Other websites I have tried to scrape do not experience this issue.

Does [this answer](http://stackoverflow.com/a/22027928/771848) or [this answer](http://stackoverflow.com/a/23406813/771848) help? — alecxe, Jul 20 '16 at 22:55
Possible duplicate of [nodejs encoding using request](http://stackoverflow.com/questions/12040643/nodejs-encoding-using-request) — k.chao.0424, Jul 20 '16 at 23:25

score 1 · Answer 1 · answered Nov 27 '22 at 22:06

1

I solve the same issue with axios, by just disable encoding on headers by:

            const response = await axios.get(baseUrl, {
                headers: {
                    "Accept-Encoding" : null
                }
            });
            console.log(response)

The answer was found from the comments above from here

answered Nov 27 '22 at 22:06

Lagamura

59
1
7

1

THANK GOD! I LOOK FOR THIS ANSWER FOR HOURS! – Roni Jack Vituli Nov 30 '22 at 09:08

Scraping site with Request and Cheerio gets strange html content

1 Answers1