The Advanced tab:

Downloading information from the internet is usually very slow. Because of that it makes sense to download more than one file at a time. Using the Max.Thread# setting it's possible to specify how many files can be downloaded simultaneously. Also because the net is very slow, it is to your advantage to start the Crawler at a specified time, preferrably at low-traffic-times. If you are unable to personally monitor the Crawler, the Max. Time function allows you to set the numer of minutes the Crawler should be working online.

Max. Thread# ..... The max. number of threads (readers+parsers) working simultaneously. At the beginning there will be max/2 readers and max/2 parsers, but this can change at runtime according to the workload. There will never be more threads than "Max. Thread#" running at any time, though. For a slow connection you set this value higher (30), for faster connections, however, it should be lower. Remember: your computer can't handle infinite numbers of threads and your server can't handle infinite numbers of connections!

Follow links from same host only ..... Check this box if you only want to load links from the same host as the start-host specified in the General tab in the Start URL field. If this box is not checked, all links will be loaded. Some commercial sites contain links to lots of other companies. If you are only interested in the content of the site you specified the Start URL from, then check this box. Sometimes, however, the URL you specify doesn't contain any info itself, it only connects you to another host that holds the site. In this case you should not check this box or you won't get any interesting results.

Start Time ..... The time the Crawler should start working. Please use the same format as the Current Time shows you and specify a time later than the current time !!!

Max Time ..... Maximum number of minutes the Crawler should work.

You need to enable Start Time and/or Max Time by checking the boxes on the left before you can use these functions.