Message-ID: <47D7F733.6000908@kaltenbrunner.cc>
Date: Wed, 12 Mar 2008 16:30:59 +0100
From: Stefan Kaltenbrunner <stefan@kaltenbrunner.cc>
User-Agent: Icedove 1.5.0.14pre (X11/20080208)
MIME-Version: 1.0
To: Dave Page <dpage@pgadmin.org>
CC: Alvaro Herrera <alvherre@commandprompt.com>,
	Bruce Momjian <bruce@momjian.us>, PostgreSQL www <pgsql-www@postgresql.org>
Subject: Re: Email not searchable in our archives
References: <200803112135.m2BLZ6625071@momjian.us>	
	<20080312130902.GC4926@alvh.no-ip.org>	
	<937d27e10803120714h21f1f661s657fad641f35c3d5@mail.gmail.com>
	<937d27e10803120825k67fc19c1h27f977a8038dfdd7@mail.gmail.com>
In-Reply-To: <937d27e10803120825k67fc19c1h27f977a8038dfdd7@mail.gmail.com>
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding: 7bit

Dave Page wrote:
> On Wed, Mar 12, 2008 at 2:14 PM, Dave Page <dpage@pgadmin.org> wrote:
>>  Confirmed. I added a test mode to a copy of the archives indexer, and
>>  running that it claims it would index a further 715 messages, which
>>  would give us a total of 1187.
>>
>>  So I guess the next step is to try running out of test mode to see if
>>  the data actually makes it into the index now, but I didn't want to do
>>  that and stomp on any testing you're doing.
> 
> OK, so running it properly has added those missing 715 messages. I
> think we need to run a full index run which should restore any missing
> pages, but before we do that, I'd kinda like to gather any ideas on
> why this has happened before removing any evidence.

hmm weird ...

> 
> My best guess is simply that the indexer failed for some time and
> noone noticed for a few weeks. By the time it was re-run, some
> messages that it had missed were outside the timeframe that an
> incremental crawl would have picked up (the current, plus last month).
> Thoughts?
> 
> Stefan; any thoughts on how we might monitor that the indexer has been
> running correctly? I assume that should be fairly easy if we have it
> drop a timestamp someplace?

yes - iirc there is even some discussion on that on pmt - will work 
something out for that in the next days.


Stefan