From: Darren Reed <darrenr+postgres@fastmail.net>
To: Scott Marlowe <scott.marlowe@gmail.com>
Cc: Tom Lane <tgl@sss.pgh.pa.us>
Cc: Joshua D. Drake <jd@commandprompt.com>
Cc: pgsql-admin@postgresql.org
Subject: Re: Is my database now too big?
Date: Mon, 15 Oct 2007 20:53:53 -0700
Message-ID: <471435D1.4030806@fastmail.net> (raw)
In-Reply-To: <dcc563d10710151346w430da8a2s265bd8e129ee7d@mail.gmail.com>
References: <1191730382.18880.1214536197@webmail.messagingengine.com>
<dcc563d10710070114m35df7741tcaa01700b21baec@mail.gmail.com>
<4708A9DC.5060306@fastmail.net>
<dcc563d10710070713q6aa1fbfdqe8f07e5356d39d41@mail.gmail.com>
<47097EA7.902@fastmail.net>
<dcc563d10710071803ia92a046neef1296999173d13@mail.gmail.com>
<4712D97E.7010004@fastmail.net>
<4712E15B.8000405@fastmail.net>
<17093.1192464190@sss.pgh.pa.us>
<4713CA8C.5020303@fastmail.net>
<dcc563d10710151346w430da8a2s265bd8e129ee7d@mail.gmail.com>
Scott Marlowe wrote:
> ...
>
> Again, I'm kinda shooting in the dark here as you reveal more and more
> what you are doing a little at a time. A test case that can invoke
> this failure would be most useful.
>
After seeing this today:
ERROR: duplicate key violates unique constraint "ers_pkey"
ERROR: duplicate key violates unique constraint "foo_pkey"
ERROR: duplicate key violates unique constraint "foo_pkey"
ERROR: duplicate key violates unique constraint "foo_pkey"
ERROR: duplicate key violates unique constraint "foo_pkey"
ERROR: duplicate key violates unique constraint "foo_pkey"
ERROR: could not open segment 1 of relation 1663/10793/2659 (target
block 858862642): No such file or directory
ERROR: could not open segment 1 of relation 1663/10793/2659 (target
block 858862642): No such file or directory
ERROR: could not open segment 1 of relation 1663/10793/2659 (target
block 858862642): No such file or directory
ERROR: could not open segment 1 of relation 1663/10793/2659 (target
block 858862642): No such file or directory
...
...there was little or no activity during this time, apart from
some inserts, maybe some selects, etc. Nothing that should
have caused this kind of upset.
There is a file that matches this:
-rw------- 1 postgres wheel 57344 Oct 14 22:57
/data/db/second/base/10793/2659
but it isn't in the directory where I moved most of the indexes to:
ls /data/index/ext/10793/
16390 16397 16399 16406 16407 16410 16414 16425 16434 16435
I don't know if the file numbers have any meaning?
But in addition, the list of tables (\dp) is now fubar'd.
I'm starting to wonder if it is a combination of:
- the operating system (NetBSD 4.99.20)
- the hardware (small HP box, not meant for hard work like this but
shouldn't be impossible for it)
- the way pkgsrc compiles postgresql for NetBSD
I'm shying away from the hardware (or at least RAM/CPU) because I'd
expect there to be some other kind kinds of faults show up, ultimately
leading to a panic due to just random corruption of some kernel data
structure. As it is, everything else seems to be functioning ok.
Darren
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Reply to all the recipients using the --to and --cc options:
reply via email
To: pgsql-admin@postgresql.org
Cc: darrenr+postgres@fastmail.net, scott.marlowe@gmail.com, tgl@sss.pgh.pa.us, jd@commandprompt.com
Subject: Re: Is my database now too big?
In-Reply-To: <471435D1.4030806@fastmail.net>
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox