tweak limits for dodis
We see allot of errors during the crawl of dodis. We need a more polite crawler
-
higher limits -
better politeness -
scrap sitemap synchronous
We see allot of errors during the crawl of dodis. We need a more polite crawler