How to make http/https POST requests manually?

Question

I want to test some url's on a small custom server i am working on. i have used Wfetch on windows and its awesome

My requirements for these tests are: - should be able to run on linux(ubuntu) - should be able to set all params manually - should support digest aunthentication

can someone suggest some gui or extension for such a work.

I have already tried RESTclient and Poster but they do not support digest aunthentication.

Possible duplicate of How do I manually fire HTTP POST requests with Firefox or Chrome?

I think CURL is the standard way to do this on Linux. http://curl.haxx.se/docs/manpage.html — EricLaw, Mar 29 '13 at 21:46
https://stackoverflow.com/questions/32341518/asking-a-http-get-request-with-netcat/52662497#52662497 — Ciro Santilli OurBigBook.com, Oct 05 '18 at 09:30

score 32 · Answer 1 · answered Mar 30 '13 at 02:40

32

wget may help you.

get:

wget http://example.com

post:

wget --post-data "username=Yarkee" http://example.com

answered Mar 30 '13 at 02:40

Yarkee

9,086
5
28
29

// , What if the site requires a cookie or something, though? – Nathan Basanese Aug 06 '15 at 05:35
1

It has `--load-cookies file` and `--save-cookies file` options, as well as a `--keep-session-cookies` option. – machineghost Aug 08 '17 at 04:42
What about custom headers? – N M Oct 24 '17 at 06:38

score 9 · Accepted Answer · answered Mar 29 '13 at 22:21

9

You can use wget for this. From the manual it supports digest authentication and can send POST requests.

There seems to be a GUI at wget::gui, but I don't know how reliable or complete it is.

answered Mar 29 '13 at 22:21

Olaf Dietsche

72,253
8
102
198

Can this work with cookies? Many web sites are protected by either authentification forms or vicious access rules like "you must first see some introductory or advertisement pages". Such sites can't be downloaded with the well known WGET tool alone, that I know of. – Nathan Basanese Aug 06 '15 at 05:35
1

@NathanBasanese I haven't thought about it, but you might try [`wget --load-cookies`](http://www.gnu.org/software/wget/manual/wget.html#index-loading-cookies) and the following `--save-cookies` option. You can also download more than just one URL, so loading some entry page and then the actual page should be doable. If it becomes more complicated, you should rather look at a web scraping framework, e.g. [Scrapy](http://scrapy.org/). – Olaf Dietsche Aug 06 '15 at 13:17

How to make http/https POST requests manually?

2 Answers2