Getting data from a website where posted data is required

Question

I am new at php, so bear with me.

I want to parse some html-data from a website, and i can do it with http://simplehtmldom.sourceforge.net/ pretty easy. The problem is that i need to get the data from a website, where i need to post some data, which means i can't just use the url which the library needs. I can use the action and post i a form to redirect to the website, but i can't get the information. Can you help me here?

Regards Jesper

score 2 · Accepted Answer · edited May 23 '17 at 12:27

2

This code queries stackoverflow for your question using CURL:

$url = 'https://stackoverflow.com/search';

$params = preparePostFields( array(
     'q' => 'Getting data from a website where posted data is required',
   ));

$ch = curl_init($url);

curl_setopt($ch, CURLOPT_POST, 1);
curl_setopt($ch, CURLOPT_POSTFIELDS, $params);
curl_setopt($ch, CURLOPT_RETURNTRANSFER, true);
$result = curl_exec($ch);

curl_close($ch);

echo $result;

exit;

function preparePostFields($array) {
  $params = array();

  foreach ($array as $key => $value) {
    $params[] = $key . '=' . urlencode($value);
  }

  return implode('&', $params);
}

Regarding the CURLOPT_POSTFIELDS, please review this manual page:

edited May 23 '17 at 12:27

Community

1
1

answered Sep 01 '12 at 22:03

SteAp

11,853
10
53
88

I tried that, but when i echo my $result it says "Missing parameter". The website only use one form, with name=aarskort and my $params is: $params = array('aarskort' => '20113670'); You know why? – gedemagt Sep 01 '12 at 23:15
Post the form's definition to provide more details. – SteAp Sep 01 '12 at 23:16
Opslag for mine tilmeldinger - Indtast årskortnr – gedemagt Sep 01 '12 at 23:19
You probably need to set B1 too, since the form-handler might check its value too. – SteAp Sep 01 '12 at 23:27
Ehm, how? :) In the $params-array? – gedemagt Sep 01 '12 at 23:31
@gedemagt Fixed my post to be an complete working example. Additionally: Could you disclose the actual form's URL, you'd like to get data from? – SteAp Sep 03 '12 at 21:08

Getting data from a website where posted data is required

1 Answers1