|
|
 |
RE: FN-FORUM robots meta tag
date posted 20th January 2002 13:15
Yup - robots.txt rather than meta tags is preferable. Most search engines
WILL honour robots.txt unless configured not too. Certainly most of the
large crawlers will pick up and use robots.txt and you are possibly adding
unnecessary load on any system if you don't utilise it.
Lee
-----Original Message-----
From: [EMAIL REMOVED]
[EMAIL REMOVED] Behalf Of Vendetta Sales
and Admin
Sent: 20 January 2002 12:50
To: [EMAIL REMOVED]
Subject: Re: FN-FORUM robots meta tag
I think Lycos and maybe one other use it. If you want to stop robots
crawling your site, it's better to use robots.txt. No point using index,
follow because that's what they do anyway.
+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
Kathy
http://www.vendetta.co.uk
DNRC Minister for Useful but Irritating Information and Trivia
+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
----- Original Message -----
From: "technoir" [EMAIL REMOVED]
To: [EMAIL REMOVED]
Sent: Sunday, January 20, 2002 11:32 AM
Subject: FN-FORUM robots meta tag
> is it worth adding the robots meta tag for search engines ?
> do they work ?
>
>
> ============================================================
> = Get your message here for as little as £1 per week =
> = =
> = http://www.freelancers.net/cgi/sponsor.cgi?action=show =
> ============================================================
>
> * Free listing for freelancers
> * Free to advertise jobs
> * Free jobs distribution service
> * Free database of 5000 freelancers
>
> Freelancers and Freelance Jobs:
> http://www.freelancers.net
>
> Forum FAQs:
> http://freelancers.netrickery.com
>
> To unsubscribe please email:
> [EMAIL REMOVED]
>
> If you have difficulties unsubscribing please email:
> [EMAIL REMOVED]
>
============================================================
= Get your message here for as little as £1 per week =
= =
= http://www.freelancers.net/cgi/sponsor.cgi?action=show =
============================================================
* Free listing for freelancers
* Free to advertise jobs
* Free jobs distribution service
* Free database of 5000 freelancers
Freelancers and Freelance Jobs:
http://www.freelancers.net
Forum FAQs:
http://freelancers.netrickery.com
To unsubscribe please email:
[EMAIL REMOVED]
If you have difficulties unsubscribing please email:
[EMAIL REMOVED]
|
|
|
