Seeking for a hardware sponsor
Slowly we are arriving at the limits of our current hardware due to the increasing amount of time required for crawling Swiss websites. As a matter of fact it is quite normal that the crawling takes more and more time due to the increasing index size and the amount of data gathered. The crawling process itself is still quite fast but merging the update crawls to the master index as… Continue reading