Screaming Frog SEO Spider 19.0 instal the new

Response Timeout – The amount of time the SEO spider waits for a response from a URL is now configurable, which is useful for very slow loading websites.

Request Authentication – Users now have the ability to switch off messages from websites which require authentication.

5XX Response Retries – There is now an ‘advanced’ tab in the spider configuration which allows the user to adjust the number of automatic retries for 5XX responses.

Now when you start to reach the memory allocation, the SEO spider will automatically pause and recommend saving the crawl and increasing memory allocation, before uploading the crawl again and resuming.

Auto Pause On Reaching Memory – One of our most frequent queries is, how many URLs can the SEO spider crawl? Well, this is dependent on memory allocation.

This feature is still turned off as default as of course, search bots do not accept cookies.

Accept Cookies – The SEO spider can now accept cookies, which can be useful for some websites which require it to be able to crawl.

Bulk Export Out Links – You can now bulk export out link data via the ‘advanced export’ menu.

Filter Totals – There is now a filter total in the GUI, to save exporting to Excel and calculating.

This should help identify slow loading pages!

Response Time – The SEO spider now collects response times for URLs under the ‘Response Codes’ tab.This feature is fairly basic currently, but will be developed further to allow a number of configurations to be saved and accessed quickly. Save Configuration – You can now save the spider configuration to be default on start-up.The updated version of the SEO spider has plenty of new features, which include –

Just a quick post to let you all know we have released an update of the Screaming Frog SEO spider to version 2.10.

Screaming Frog SEO Spider 19.0 instal the new