Crawl

What sites are uncrawlable or difficult to crawl?
Sites that meet the "Crawlable Conditions" below are crawlable.  The information listed in the "Cases that cannot be handled" is only a...
Mon, Feb 13, 2023 at 5:53 PM
Cannot auto-crawl. Some pages cannot be crawled by auto-crawl.
If you are having trouble getting pages through the automatic crawl or feel that the number of pages is less than expected, please try the following. ■D...
Tue, Nov 1, 2022 at 11:44 AM
Can more than one user simultaneously crew and scan?
The number of concurrent executions depends on the number of concurrent option subscriptions for the license. It can be added by purchasing the option. ...
Mon, Mar 7, 2022 at 10:08 AM
I want to remove the admin panel from the crawl/scan target.
It is possible to exclude crawling/scanning from the target in Crawl/Scan Target Settings. The Crawl/Scan Target Settings can be accessed from Scan List...
Tue, May 16, 2023 at 4:52 PM
How do I crawl if I am loading a library from an external site such as jQuery?
Even libraries from external sites can be loaded without problems and can be crawled in the usual way.
Tue, Mar 8, 2022 at 6:07 AM
Can Google's reCAPTCHA and other CAPTCHAs be crawled after the page where the CAPTCHA is installed?
Pages with Google's reCAPTCHA cannot be broken through. (Once a bot is detected, it is blocked based on IP address, so it is difficult to break through ...
Tue, Mar 8, 2022 at 6:11 AM
Is it possible to crawl a button that does not have a form (a button that dynamically generates a form element and submits when pressed)?
There is a crawling mechanism corresponding to the button that dynamically generates and submits a form element when the button is pressed. Therefore, depe...
Tue, Mar 8, 2022 at 6:13 AM
When I enable safe mode and let it crawl, the page after login is not crawled.
The login is still performed when safe mode is enabled. However, in cases where the page after login is not patrolled, this may be due to the fact that the ...
Wed, Mar 30, 2022 at 9:26 AM
How can I exclude certain pages from being crawled or scanned?
■I want to be excluded from both crawling and scanning in advance. If there are pages that you want to exclude from both crawl and scan, set the exclusion ...
Tue, May 16, 2023 at 4:58 PM
What values should be entered into the form during auto-crawl?
You can check it from Scan List > + New Scan > Form Entry Value Settings. You can also change the input values. The following strings are included...
Wed, Mar 9, 2022 at 9:53 AM