Yo, Sam, I was confused by this issue as well, so...I found this: http://sebastians-pamphlets.com/crawling-vs-indexing/It clears things up a bit for me. I guess crawlers are idiot bots and index bots are the smarter of the pair.
Post a Comment
1 comment:
Yo, Sam, I was confused by this issue as well, so...I found this: http://sebastians-pamphlets.com/crawling-vs-indexing/
It clears things up a bit for me. I guess crawlers are idiot bots and index bots are the smarter of the pair.
Post a Comment