Spiders online

[aerog]

(note: tongue placed firmly in cheek)

I just noticed that there are 35 registered users, 29 guests, and <span style="font-weight: bold">38 spiders</span> online.

Amazing technology this internet stuff. Spiders online eh? :wink:

 

[Basil]

And 90 percent of them are Yahoo...they have a very inefficient spider tecnology compared to Google, for example.

 

[aerog]

Hrumphf. There are now 46 of the suckers online!

 

[Brooklands]

I just hope they keep their "Spidey" powers out of my CPU.

 

[GregW]

I bet eight legs makes for a fast typer.

 

[Camshaft]

Friends of Dr. E's, perhaps?

 

[PAUL161]

Can spider software be blocked?

 

[GregW]

I don't know if you'd want them blocked. I think those spiders are searches that bring in new members. They find the place through Google or Yahoo and decide to stay awhile. That's how I came to be here. :laugh:

 

[aerog]

If you have your own server, yes... sort of... kind of... maybe. You can create a robots.txt file that will instruct cooperating spiders on where they can and can't gather information. The key is whether or not they will ignore your instructions.

The other way is to flat out deny their access in the .htaccess file. Problem is not all spiders are yahoo or google, individuals have their own spiders running (I've seen them come from cable internet accounts) so you can't always catch them all using this method.