• Hey Guest!
    British Car Forum has been supporting enthusiasts for over 25 years by providing a great place to share our love for British cars. You can support our efforts by upgrading your membership for less than the dues of most car clubs. There are some perks with a member upgrade!
    **Upgrade Now**
    (PS: Upgraded members don't see this banner, nor will you see the Google ads that appear on the site.)

Spiders online

  • Thread starter Thread starter aerog
  • Start date Start date

Share this page

A

aerog

Guest
Guest
Offline
(note: tongue placed firmly in cheek)

I just noticed that there are 35 registered users, 29 guests, and <span style="font-weight: bold">38 spiders</span> online.

Amazing technology this internet stuff. Spiders online eh? :wink:
 
And 90 percent of them are Yahoo...they have a very inefficient spider tecnology compared to Google, for example.
 
Hrumphf. There are now 46 of the suckers online!

255462205_DrU4Y-M.jpg
 
Can spider software be blocked?
 
I don't know if you'd want them blocked. I think those spiders are searches that bring in new members. They find the place through Google or Yahoo and decide to stay awhile. That's how I came to be here. :laugh:
 
If you have your own server, yes... sort of... kind of... maybe. You can create a robots.txt file that will instruct cooperating spiders on where they can and can't gather information. The key is whether or not they will ignore your instructions.

The other way is to flat out deny their access in the .htaccess file. Problem is not all spiders are yahoo or google, individuals have their own spiders running (I've seen them come from cable internet accounts) so you can't always catch them all using this method.
 
Back
Top