If crawling takes a long time or does not finish after crawling has started, the following are possible causes.


■Cause 1.

It is possible that similar pages are crawled during the crawling process, resulting in a large number of target pages, which is taking time.

There are two ways to exclude similar pages from crawling before crawling.


・Method 1.

You can change the strength of the exclusion decision from the "Exclusion Decision for Similar Pages" in the scan settings.

Please see below.

What is the "Exclude Similar Pages"?


・Method 2.

Similar pages can be excluded by specifying the URLs of similar pages in the "Crawl/Scan Target Settings".

Please check the following.

What should I do if the crawl does not end?


■Cause 2.

If Cause 1 does not apply, or if the crawl does not finish after 2 days (48 hours) or more, please contact our support team for further assistance.


For inquiries and support services