Unfortunately, pagination (or paging) is not something you enable with just a config attribute or something as simple as that as far as I know.
It assumes first that your can handle it in your calculation view using the $skip & $count request parameters.
This will most likely require you to use XSJS instead of a straight forward XSOData service.
For example, you would need to extend your calculation view and:
- add a column with the Rank of the row
- add placeholder attributes to be used for the first row to be selected
- add placeholder attributes to be used for the row count
Once this is done, create a XSJS service where you can handle a $skip & $count request parameters.
Also, have you looked into the max_message_size_mb parameter in the SAP HANA XS Configuration Parameters