public inbox for [email protected]  

help / color / mirror / Atom feed

From: Marc G. Fournier <[email protected]>
To: Jeroen Ruigrok/asmodai <[email protected]>
Cc: Marc G. Fournier <[email protected]>
Cc: Oleg Bartunov <[email protected]>
Cc: [email protected]
Subject: Re: META Tags on Archives
Date: Mon, 2 Feb 2004 10:52:57 -0400 (AST)
Message-ID: <[email protected]> (raw)
In-Reply-To: <[email protected]>
References: <[email protected]>
	<[email protected]>
	<[email protected]>
	<[email protected]>
	<[email protected]>
	<[email protected]>
	<[email protected]>
	<[email protected]>

On Mon, 2 Feb 2004, Jeroen Ruigrok/asmodai wrote:

> -On [20040201 23:43], Marc G. Fournier ([email protected]) wrote:
> >     <META NAME="robots" CONTENT="nofollow, index, archive">
>
> According to http://www.robotstxt.org/wc/meta-user.html
> archive|noarchive does not exist.
>
> Where'd you find it?

Actually, that one was in the original .resource file, but a quick search
on google shows:

http://www.bauser.com/websnob/meta/robots.html

and

http://www.google.com/webmasters/faq.html#cached

the funny thing is that this one:

http://www.katpatuka.org/pub/doc/robotexclusion.html

refers to the NOARCHIVE, but puts to:

http://www.w3.org/Search/9605-Indexing-Workshop/ReportOutcomes/Spidering.txt

which doesn't include it ...

I love standards that everyone follows *roll eyes*

I'm gathering its somethign that some use (Google does, apparently), and
some don't ...

----
Marc G. Fournier           Hub.Org Networking Services (http://www.hub.org)
Email: [email protected]           Yahoo!: yscrappy              ICQ: 7615664

view thread (13+ messages)

reply

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Reply to all the recipients using the --to and --cc options:
  reply via email

  To: [email protected]
  Cc: [email protected], [email protected], [email protected]
  Subject: Re: META Tags on Archives
  In-Reply-To: <[email protected]>

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

This inbox is served by agora; see mirroring instructions
for how to clone and mirror all data and code used for this inbox