Re: FN-FORUM robots meta tag

date posted 20th January 2002 23:54

Tell me more about this robots.txt file of which you speak - verily it doth
sound like that which mayhaps be of use....yet I know not of it, nor have I
ever understood the damnable robot metatag and have thus ignored their
existence thus far.

um ........

one too many thus's I feel

and perhaps beers!

Iain


----- Original Message -----
From: "Lee Jackson" [EMAIL REMOVED]
To: [EMAIL REMOVED]
Sent: Sunday, January 20, 2002 1:17 PM
Subject: RE: FN-FORUM robots meta tag


> Yup - robots.txt rather than meta tags is preferable. Most search engines
> WILL honour robots.txt unless configured not too. Certainly most of the
> large crawlers will pick up and use robots.txt and you are possibly adding
> unnecessary load on any system if you don't utilise it.
>
> Lee
>
> -----Original Message-----
> From: [EMAIL REMOVED]
> [EMAIL REMOVED] Behalf Of Vendetta Sales
> and Admin
> Sent: 20 January 2002 12:50
> To: [EMAIL REMOVED]
> Subject: Re: FN-FORUM robots meta tag
>
>
> I think Lycos and maybe one other use it. If you want to stop robots
> crawling your site, it's better to use robots.txt. No point using index,
> follow because that's what they do anyway.
> +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> Kathy
> http://www.vendetta.co.uk
> DNRC Minister for Useful but Irritating Information and Trivia
> +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>
> ----- Original Message -----
> From: "technoir" [EMAIL REMOVED]
> To: [EMAIL REMOVED]
> Sent: Sunday, January 20, 2002 11:32 AM
> Subject: FN-FORUM robots meta tag
>
>
> > is it worth adding the robots meta tag for search engines ?
> > do they work ?
> >
> >
> > ============================================================
> > = Get your message here for as little as £1 per week =
> > = =
> > = http://www.freelancers.net/cgi/sponsor.cgi?action=show =
> > ============================================================
> >
> > * Free listing for freelancers
> > * Free to advertise jobs
> > * Free jobs distribution service
> > * Free database of 5000 freelancers
> >
> > Freelancers and Freelance Jobs:
> > http://www.freelancers.net
> >
> > Forum FAQs:
> > http://freelancers.netrickery.com
> >
> > To unsubscribe please email:
> > [EMAIL REMOVED]
> >
> > If you have difficulties unsubscribing please email:
> > [EMAIL REMOVED]
> >
>
>
> ============================================================
> = Get your message here for as little as £1 per week =
> = =
> = http://www.freelancers.net/cgi/sponsor.cgi?action=show =
> ============================================================
>
> * Free listing for freelancers
> * Free to advertise jobs
> * Free jobs distribution service
> * Free database of 5000 freelancers
>
> Freelancers and Freelance Jobs:
> http://www.freelancers.net
>
> Forum FAQs:
> http://freelancers.netrickery.com
>
> To unsubscribe please email:
> [EMAIL REMOVED]
>
> If you have difficulties unsubscribing please email:
> [EMAIL REMOVED]
>
>
> ============================================================
> = Get your message here for as little as £1 per week =
> = =
> = http://www.freelancers.net/cgi/sponsor.cgi?action=show =
> ============================================================
>
> * Free listing for freelancers
> * Free to advertise jobs
> * Free jobs distribution service
> * Free database of 5000 freelancers
>
> Freelancers and Freelance Jobs:
> http://www.freelancers.net
>
> Forum FAQs:
> http://freelancers.netrickery.com
>
> To unsubscribe please email:
> [EMAIL REMOVED]
>
> If you have difficulties unsubscribing please email:
> [EMAIL REMOVED]
>