Batch Processing in MySQL and PHP?

Question

I am making an application in which once a week will have to perform multiple operations (calculations) based on all users of the system. Initially estimated about 300 users.

My question is, is there a method to perform this type of operation? like batch processing? At this moment, I test the script with only an user and on my localhost, I use a foreach cycle to cycle users and made all queries, calculations and insert the results ..

I have the doubt if more users saturate the script or hosting or similar things.. How can i handle such situations?

Cheers ;)

[`PDO`](http://php.net/manual/pt_BR/book.pdo.php) + http://dev.mysql.com/doc/refman/5.0/en/commit.html — Wesley Schleumer de Góes, Jun 11 '13 at 13:59
Cron jobs is you best option! See this [answer](https://stackoverflow.com/questions/18737407/how-to-create-cron-job-using-php) — Develop4Life, Oct 22 '15 at 16:35

score 1 · Answer 1 · answered Jun 11 '13 at 14:08

This kind of situation is usually done with Cron (or something similiar on Windows). So if your script is run only by cron in off-peak hours (e.g. 3am on Sunday if all your users are in one timezone), you are almost certain that it neither run twice in the same time nor does affect your users.

Since MySQL supports transaction and stored procedures and functions, I would recommend you to use stored procedure in database rather than PHP script for looping through data. You can then store logic in db functions and do something like insert-select in a transaction. It should be faster, safer and more convenient way than plain loop.

Batch Processing in MySQL and PHP?

1 Answers1