X-Original-To: pgsql-www-postgresql.org@localhost.postgresql.org
Received: from localhost (unknown [200.46.204.2])
	by svr1.postgresql.org (Postfix) with ESMTP
	id E00FED1D8AE; Mon,  2 Feb 2004 14:57:36 +0000 (GMT)
Received: from svr1.postgresql.org ([200.46.204.71])
	by localhost (neptune.hub.org [200.46.204.2]) (amavisd-new, port 10024)
	with ESMTP id 28691-10; Mon,  2 Feb 2004 10:57:37 -0400 (AST)
Received: from ganymede.hub.org (u46n208.hfx.eastlink.ca [24.222.46.208])
	by svr1.postgresql.org (Postfix) with ESMTP
	id 1ED0BD1D597; Mon,  2 Feb 2004 10:57:33 -0400 (AST)
Received: by ganymede.hub.org (Postfix, from userid 1000)
	id D859735145; Mon,  2 Feb 2004 10:52:57 -0400 (AST)
Received: from localhost (localhost [127.0.0.1])
	by ganymede.hub.org (Postfix) with ESMTP
	id D78A6343D2; Mon,  2 Feb 2004 10:52:57 -0400 (AST)
Date: Mon, 2 Feb 2004 10:52:57 -0400 (AST)
From: "Marc G. Fournier" <scrappy@postgresql.org>
X-X-Sender: scrappy@ganymede.hub.org
To: Jeroen Ruigrok/asmodai <asmodai@wxs.nl>
Cc: "Marc G. Fournier" <scrappy@postgresql.org>,
	Oleg Bartunov <oleg@sai.msu.su>, pgsql-www@postgresql.org
Subject: Re: META Tags on Archives
In-Reply-To: <20040202144649.GJ39523@nexus.ninth-circle.org>
Message-ID: <20040202104913.G4513@ganymede.hub.org>
References: <03AF4E498C591348A42FC93DEA9661B87206B3@mail.vale-housing.co.uk>
	<Pine.GSO.4.58.0401310845100.19778@ra.sai.msu.su>
	<20040131014838.U29077@ganymede.hub.org>
	<200401302201.15585.josh@agliodbs.com>
	<20040131020112.E29077@ganymede.hub.org>
	<Pine.GSO.4.58.0401311539560.28603@ra.sai.msu.su>
	<20040201183311.M63159@ganymede.hub.org>
	<20040202144649.GJ39523@nexus.ninth-circle.org>
MIME-Version: 1.0
Content-Type: TEXT/PLAIN; charset=US-ASCII
X-Virus-Scanned: by amavisd-new at postgresql.org
X-Archive-Number: 200402/17
X-Sequence-Number: 3582

On Mon, 2 Feb 2004, Jeroen Ruigrok/asmodai wrote:

> -On [20040201 23:43], Marc G. Fournier (scrappy@postgresql.org) wrote:
> >     <META NAME="robots" CONTENT="nofollow, index, archive">
>
> According to http://www.robotstxt.org/wc/meta-user.html
> archive|noarchive does not exist.
>
> Where'd you find it?

Actually, that one was in the original .resource file, but a quick search
on google shows:

http://www.bauser.com/websnob/meta/robots.html

and

http://www.google.com/webmasters/faq.html#cached

the funny thing is that this one:

http://www.katpatuka.org/pub/doc/robotexclusion.html

refers to the NOARCHIVE, but puts to:

http://www.w3.org/Search/9605-Indexing-Workshop/ReportOutcomes/Spidering.txt

which doesn't include it ...

I love standards that everyone follows *roll eyes*

I'm gathering its somethign that some use (Google does, apparently), and
some don't ...

----
Marc G. Fournier           Hub.Org Networking Services (http://www.hub.org)
Email: scrappy@hub.org           Yahoo!: yscrappy              ICQ: 7615664