I have a remote database table that I need to pull the data from. Because I have no control over the remote database, other than read access, I can't update indices to make the queries faster.
mysqldump is not an option.
Methods I've tried so far:
- Pagination (using limit and offset); basically operating like a cursor
Issues that I'm running into:
- High CPU load on the database due to being unable to set new indices
- Seems to be unreliable due to long query times (20+ seconds per query)
Any advice would he greatly appreciate. Thank you!