Comments Off on Google May Be Using Generic & Undocumented Google Crawler
There are numerous reports that Google may be using a more generic and undocumented Googlebot, Google crawler. The crawler user agent is just named “Google,” and it is not listed in any of the documented crawlers that Google has provided.