....that I type this post, in the hope that at least one of you bright lot out there can solve a mystery that has puzzled me from almost the first day I made my first keystroke!
Spiders, it's spiders that puzzle and confound me so utterly. Please don't run off in horror, I am not talking here of heinous eight legged creatures that promote horror into some of us. No, instead I am referring to web-spiders and crawlers and whatever other strange names they have been given. The kind of spider that decides who and what will appear in the returns for a web search, those little creatures that control the likelihood (or not) that one's webpage will be thrown in the face of those likely searching for something entirely different.
So, this is my question....how do they work? The reason I am asking is this. If I search 'gemmak' (not that it is a word one would normally search) it can return anything from 17000 to 59000 results. On an almost daily basis it fluctuates between those two figures and I have to admit my complete ignorance in not having the remotest idea why!
So please, any bright spark with the knowledge, would you be so kind as to enlighten me a little and take a moment to explain to the intellectually challenged. And whilst on the subject, don't be even remotely tempted to be impressed at the above figures even for a moment, if you want impressive you need to check out the likes of Dooce, Instapundit or Random Acts of Reality! Now that is impressive!
Tuesday, 14 February 2006
Subscribe to:
Post Comments (Atom)


2 Comments:
No idea if any of this will help, I found it mildly interesting :)
See you made me learn something :)
http://searchenginewatch.com/webmasters/article.php/2168031
http://www.metamend.com/search-engine-bots.html
http://dollar.biz.uiowa.edu/~pant/Papers/crawling.pdf
Mildly interesting and madly frustrating...I think I've opened my own little can of worms with this....thanks for the links, I'm off for a read :o)
Post a Comment