2

I want to use boilerpipe for scraping all acrticles (news) of a site for data mining purpose. In demo page of boilerpipe is noted:

Due to heavy use of this free service in the past, the number of requests per user is limited

has boilerpipe library any restriction at all or this limitation is for demo page?

afruzan
  • 1,454
  • 19
  • 20

1 Answers1

0

Unless there are licensing terms that I have not seen the boilerpipe library should not have any such restriction. The restriction you see is probably because the free site is a shared resource and unrestricted use will be abused by some (why use the library when there is a free service online that will do it for me?) and have a negative effect on those who are actually trying to use the demo site as intended.

Mark Sholund
  • 1,273
  • 2
  • 18
  • 32