![]() This feature is only available to licensed users and we ask everyone to use this responsibly. We also have a custom user-agent feature which allows you to specify your own user agent. User Agent Switcher – The SEO spider now have a user-agent switcher with inbuilt preset user agents for Googlebot, Bingbot, Yahoo! Slurp, various browsers and more. ![]() ![]() It narrows the default search by only crawling the URLs that match the REGEX which is particularly useful for larger sites, or sites with less intuitive URL structures. Include (REGEX Crawling) – This new feature allows you to control URLs the spider crawls using REGEX.So lets get straight to it, what new features are there in version 1.70 of the tool? I am excited to announce another update to the Screaming Frog SEO spider, to version 1.70.
0 Comments
Leave a Reply. |
AuthorWrite something about yourself. No need to be fancy, just an overview. ArchivesCategories |