I am using the web crawler in OpenSearchServer and while crawling, it gets stuck during the Extracting url list action. It also gets stuck at times when finishing a session. Is there anyway to set a time limit or a timeout so it aborts if something takes too long to run?
Asked
Active
Viewed 520 times
0
Get Off My Lawn
- 34,175
- 38
- 176
- 338
1 Answers
0
I suppose you are using the default web template. In this case each time a crawl session ends, OpenSearchServer build the autocompletion index, even if you abort the session.
To avoid that, go in the panel "/Crawler/Web/Crawl process" and select the blank job.
Emmanuel Keller
- 3,384
- 1
- 14
- 16