» Media Bot http://www.copperbridgemedia.com/blog Bridging the Bytes... Thu, 12 Aug 2010 12:35:43 +0000 http://wordpress.org/?v=2.9.2 en hourly 1 The Family of Google crawlers! http://www.copperbridgemedia.com/blog/the-family-of-google-crawlers/ http://www.copperbridgemedia.com/blog/the-family-of-google-crawlers/#comments Tue, 14 Jul 2009 04:49:47 +0000 Vince Buffon http://www.copperbridgemedia.com/blog/?p=57 Most of us who are engaged in the serious practice of  Site optimization are focused on the routine visits of Google crawlers – while sites with regular content updates love the FB aka ‘FreshBots’.

But, as the web is moving towards a higher bandwidth era and a more multi-media content - capable of being consumed and distributed – the data collection task has to be performed by multiple crawlers. Google utilizes a suit of crawlers for its ‘Universal Search’ …. The Graphics below gives a family picture of the Google crawlers.

GOOGLE-CRAWLERS2

]]> http://www.copperbridgemedia.com/blog/the-family-of-google-crawlers/feed/ 0