Welcome, Guest. Please Login
 
  HomeHelpSearchLogin FAQ Radified Ghost.Classic Ghost.New Bootable CD Blog  
 
Page Index Toggle Pages: 1
Send Topic Print
Forum indexing bots (Read 8029 times)
zmdmw52
Radmeister
**
Offline


+ve rad.i.cal

Posts: 81


Back to top
Forum indexing bots
Aug 31st, 2009 at 4:19am
 
Just happened to notice this in the 'Forum Statistics' section:

56 MSN bots = 1 Google indexer = 1 Yahoo Indexer !


...
 

Linux User 483705  |  (openSUSE 11.1,  Ubuntu 9.04,  i686)   w/ Windows XP
jaylinux  
IP Logged
 

Rad
Radministrator
*****
Offline


Sufferin' succotash

Posts: 4090
Newport Beach, California


Back to top
Re: Forum indexing bots
Reply #1 - Aug 31st, 2009 at 7:42pm
 
I noticed that. They've been here for a couple of weeks. We have more than 5,000 threads. Many with multiple pages. (All good stuff, too.) Takes a while to index.

If you notice, we've had as many as 167 search engine bots here. Back then, it was Yahoo that was taking over.

Do you know where Round Lake is? I used to date a girl who lived there. Engineer. (Kathy Ireland.) Met her at the Indian Point nuke plant in Buchanan. She got tired of traveling and took a job in Schenectady with GE. (or was it Westinghouse?) I forget. Anyay, didn't last long. Long drive. Taconic prkwy. Surprisingly clean area. I remember hanging out in Clifton Park .. hitting golf balls at a driving range there.
 
WWW  
IP Logged
 
zmdmw52
Radmeister
**
Offline


+ve rad.i.cal

Posts: 81


Back to top
Re: Forum indexing bots
Reply #2 - Sep 1st, 2009 at 7:07am
 
Rad wrote on Aug 31st, 2009 at 7:42pm:
I noticed that. They've been here for a couple of weeks. We have more than 5,000 threads. Many with multiple pages. (All good stuff, too.) Takes a while to index.

If you notice, we've had as many as 167 search engine bots here. Back then, it was Yahoo that was taking over.

The point was it takes 56 MSN bots to do the work of 1 or 2 Google/Yahoo bots ! Or am I making some kind of error of judgement ?

About Part 2, pl check your Inbox (sent PM), but don't qote any of that here on boards.

 

Linux User 483705  |  (openSUSE 11.1,  Ubuntu 9.04,  i686)   w/ Windows XP
jaylinux  
IP Logged
 
MrMagoo
Übermensch
*****
Offline


Resident Linux Guru

Posts: 1026
Phoenix, AZ (USA)


Back to top
Re: Forum indexing bots
Reply #3 - Sep 1st, 2009 at 6:28pm
 
zmdmw52 wrote on Sep 1st, 2009 at 7:07am:
The point was it takes 56 MSN bots to do the work of 1 or 2 Google/Yahoo bots ! Or am I making some kind of error of judgement ?

I don't think you can compare them like that.  They could be at different phases of indexing.  They also could have different methods of crawling that make the forum see more bots, even though they are doing equal work.  You'd have to know the intricacies of each web crawler to make that comparison.
 
WWW  
IP Logged
 
Page Index Toggle Pages: 1
Send Topic Print