If you are having trouble getting pages or feel that the number of pages is less than expected, please try the following.
1. Add a domain to be crawled
2. Review crawl/scan target settings
3. Use manual crawl(remote browser)
4. Check for errors in form submission input
5. Specify the waiting time for drawing (page)
6. Change settings related to AeyeScan's automatic crawl
7. Edit recorded operations in the remote browser
1. Add a domain to be crawled
AeyeScan only crawls pre-approved domains, so in the following cases, the domain may not be registered enough.
- Use of an external site (e.g., Amazon Cognito) for authentication
- The GUI and API are configured with different FQDNs
(https://www.example.com and https://api.example.com )
Register the required domain name in one of the following ways.
a）Add manually (before automatic crawl)
How do I set up authentication for a different domain?
b）Add based on candidates found by AeyeScan (during / after automatic crawl)
2. Review crawl/scan target settings
If you have set a path to be excluded in Scan List > New Scan > Scan for Crawl/Scan Target Settings,
it may prevent the acquisition of crawl targets.
Please reduce the exclusion settings to the minimum necessary and crawl again.
3. Use manual crawl(remote browser)
If the automatic crawl cannot crawl the login transition or the post-login page, manual patrolling for the
login process(remote browser) may solve the problem.
In this case, it is possible to use automatic crawl(combining manual and automatic crawls) on the page
after the login process.
See "Troubleshooting" below for details.
My login fails in the automatic crawl.
4. Check for errors in form submission input
In some cases, the form entered by AeyeScan may have resulted in an error and you may not have been
able to move on to the next page.
Please refer to the "FAQ" below to confirm the nature of the error.
Is there a way to check the page on which the form submission was filled out in error?
Please refer to the "FAQ" below for common errors and their solutions.
5. Specify the waiting time for drawing (page)
If some screens take a long time to page, the automatic navigation of subsequent screens may fail.
Refer to "Troubleshooting" below to specify the drawing wait time (Wait time) individually.
After crawling, no results are displayed while loading.
6. Change settings related to AeyeScan's automatic crawl
Depending on the behavior and implementation of the target system, the automatic crawl may fail.
If any of the following scenes are present, please change the contents of Scan List > New Scan >
Scan Basic Options.
※Editing is possible only when the status of the corresponding scan is "Wait" or "Crawl Error" on
the "Scan List" screen. For any other status, please recreate the scan.
Item Name | Value | Item Description | Scenes where setting changes are effective |
Window Automatic Crawl | Yes ✓ No | Sets whether automatic control is performed (yes) or not (no) when opening a new tab (window) on a site with multiple tabs (windows) open. | This is useful when the transition to open a new tab (window) cannot be reproduced by crawling, and when neither auto-crawling nor remote browsers can be used for crawling. |
On automatic crawl Shortcut Access | Yes ✓ No | When accessing a screen that has already been registered in the screen transition diagram again, this setting determines whether some transitions are omitted (yes) or not (no). | This setting is effective when a site that checks the order of screen transitions cannot be crawled, such as sites where the "Back" and "Reload" buttons on the browser cannot be used. Note that this setting change will not solve the problem if the remote browser is also unable to navigate the site. |
| Operation on A tag | automatic ✓ click jump | The operation for the "a" tag can be either a click operation or a direct jump to the URL set in the href. | This is useful when screen transitions by the a tag cannot be patrolled. |
Based on XHR Similarity Judgment | Yes ✓ No | Controls whether (or not) similarity judgments are made based on the contents of XHRs when multiple XHRs are sent. | This is useful when there are pages that cannot be crawled due to excessive similarity judgments made by the automatic crawl. |
※ Values marked with "✓" are default values
7. Edit recorded operations in the remote browser
Depending on the behavior and implementation of the target system, manual traversal by remote browsers may fail.
For example, in cases where a transition to a URL link that does not exist in the displayed screen is required,
In some cases, it may be possible to use the remote browser's operation editing functionality to patrol and scan.