Support: FAQs

Question:

Scheduled tasks and activity curfews. What impact does daily 12-hour "off-peak" spidering have on the server?

Answer

Creating a scheduled task or activity curfew to allow the spider/indexer to only work during off peak hours can:

1. Decrease query time and server load by allowing the CPU and memory to serve just search requests.
   
   
2. Decrease spidering/indexing time by allowing the CPU and memory to focus on downloading/parsing/indexing documents.

In general; It distributes the work load by indexing and serving search requests separately.

Please note that if you are not having any problems with network traffic / indexing time / server loads / querying times, or general; you may want to consider omitting scheduling altogether. This would distribute the spidering work even further and potentially provide even better index currency.

You can setup a spider / indexer schedule or Activity Curfew in the Ultraseek administration interface, under the tab "Collections" --> "Tuning".