Scrapy Request GET url, How can I add keyword in url?

Question

I have this url www.example.com. I need to send this url in scrapy Request method,How can I attain that? url_final = https://www.example.com/sch/i.html?_from=R40&_trksid=m570.l1313&_nkw=MYSEARCHKEY&_sacat=0

url = 'httpss://www.example.com/'
MYSEARCHKEY = 'MYSEARCHKEY'
yield Request(url_final, callback=self.parse_new)

Possible duplicate of [Add params to given URL in Python](https://stackoverflow.com/questions/2506379/add-params-to-given-url-in-python) — Mike Scotty, Feb 22 '19 at 12:02

score 0 · Answer 1 · answered Feb 22 '19 at 19:19

You can use python library for urlencoding to create final URL.

from urllib.parse import urlencode
params={'_from':'R40',
        '_trksid':'m570.l1313',
        '_nkw':'MYSEARCHKEY',
        '_sacat':0}
base_url=' https://www.example.com/sch/i.html'
final_url= '{}?{}'.format(base_url,urlencode(params))

Scrapy Request GET url, How can I add keyword in url?

1 Answers1