Curl Post method, more then 16000 character unable to send the data

Question

In PHP Curl code, we can send 16,000 characters only at once. If at all the data sent contains more than 16,000 characters, then the data is broken down and sent to server.

Here is how the data is broken down:

How the data is passed:

$parameters {
   "Data1" => 1.
   "Data2" => <string_containing_20000_characters>,
   "Data3" => <string_containing_25000_characters>,
   "Data4" => 4
}

How it is sent to the server:

_POST {
   "Data1" => 1.
   "Data2" => <first_16000_characters><first_4000_characters>,
   "Data3" => <first_16000_characters><first_9000_characters>,
   "Data4" => 4
}

My PHP Code :

$curl_post_data = array("Data1" => "1", "Data2" => "<string_containing_20000_characters>", "Data3" => "<string_containing_25000_characters>", "Data4" => "4");

$curl = curl_init($rest_webservice_url);
curl_setopt($curl, CURLOPT_POST, true);
curl_setopt($curl, CURLOPT_POSTFIELDS, $curl_post_data);
curl_setopt($curl, CURLOPT_RETURNTRANSFER, true);
$rest_return_data = curl_exec($curl);
curl_close($curl);
echo $rest_return_data;

In php.ini below changes has been done.

max_execution_time = 300
max_input_time = 600
memory_limit = 1280M
post_max_size = 2048M
upload_max_filesize = 2048M
max_file_uploads = 200

Could please anyone can help me out what is the wrong with my above code.

in your php code check output of this – Javed Sayyed Feb 17 '18 at 08:21 — Javed Sayyed, Feb 17 '18 at 08:21
memory_limit : 1280M – Naveen D Almeida Feb 17 '18 at 08:41 — Naveen D Almeida, Feb 17 '18 at 08:41

score 2 · Answer 1 · edited Oct 07 '21 at 11:04

Give this a try:

curl_setopt($curl, CURLOPT_HTTP_VERSION, CURL_HTTP_VERSION_1_0)

Seems that CURL will set an extra header when sending large data: Expect: 100-Continue, which in your case you do not want. Mozilla Developer network describes it as:

The Expect HTTP request header indicates expectations that need to be fulfilled by the server in order to properly handle the request.

The only expectation defined in the specification is Expect: 100-continue, to which the server shall respond with:

100 if the information contained in the header is sufficient to cause an immediate success, 417 (Expectation Failed) if it cannot meet the expectation; or any other > 4xx status otherwise. For example, the server may reject a request if its Content-Length is too large.

No common browsers send the Expect header, but some other clients such as cURL do so by default.

https://developer.mozilla.org/en-US/docs/Web/HTTP/Headers/Expect

The RFC states: (https://www.rfc-editor.org/rfc/rfc7231#section-5.1.1)

A server that receives a 100-continue expectation in an HTTP/1.0 request MUST ignore that expectation.

When I tried above code, Returning Parse error: syntax error, unexpected 'curl_setopt' (T_STRING) in...,. @3xIUG — Naveen D Almeida, Feb 17 '18 at 08:42
Thank's, I had issue with a proxy (somehow) bouncing me back after 1kb of data (put request). And by using the 1.0 (due to the 100-continue), everything started to work also on the server. +1 ;) — Nordes, Jan 09 '19 at 06:55

Paolo · Answer 2 · 2018-02-25T00:09:30.767

1

You have to edit your web sever configuration file too (on the server that receives the data).

If your're using nginx set client_max_body_size 10M or any other value you think is appropriate.

On apache you would have LimitRequestBody 10485760 (10MB)

It is advisable to set reasonable values, ex. not 2GB

See Upload max size in PHP?

edited Feb 25 '18 at 00:09

answered Feb 25 '18 at 00:03

Paolo

15,233
27
70
91

Curl Post method, more then 16000 character unable to send the data

2 Answers2