Issue with Spider
Hi,
I have an issue with spider while I try to scan a site it keeps giving me this error message while attempting to crawl:
[-] Spider: Giving up on: http://www.xxxxxx.co.xx/xx/
[-] Spider: Couldn't get a response after 5 tries.
[-] Spider: Because: Couldn't resolve host name
[*] Resolver: Resolving hostnames...
[*] Resolver: Done!
If I access the same url from a browser it takes about a min before the page is loaded, so I think if I can increase the number of times the spider will attempt to resolve the hostname maybe that will solve the problem.
How can you help me with this.
Thanks for your anticipated response.
Comments are currently closed for this discussion. You can start a new one.
Keyboard shortcuts
Generic
| ? | Show this help |
|---|---|
| ESC | Blurs the current field |
Comment Form
| r | Focus the comment reply box |
|---|---|
| ^ + ↩ | Submit the comment |
You can use Command ⌘ instead of Control ^ on Mac
Support Staff 1 Posted by Tasos Laskos on 24 Jun, 2013 12:06 PM
Hey, you can try increasing the
--http-timeout, it expects the value in milliseconds.Tasos Laskos closed this discussion on 24 Jun, 2013 12:06 PM.