From: Mr. Dan <bitsandbytes88@hotmail.com>
To: pgsql-admin@postgresql.org
Cc: bitsandbytes88@hotmail.com
Subject: COPY FROM command v8.1.4
Date: Mon, 11 Sep 2006 14:55:26 -0400
Message-ID: <BAY116-F16BCF6E15545D8EFE3AD3FD12A0@phx.gbl> (raw)
We are having some serious problems with the PostgreSQL COPY FROM command
and we have no clue what to do with this at this point. I think we need to
ask for 'guru' help in diagnosing this problem. Here is exactly what we are
doing:
We have a table with 12028587 records in it.
We do a COPY TO file of the records for this table.
We count the number of records in the file, it has 12028587 lines.
We do a COPY FROM that file into a table with identical structure as the
first table.
We count the number of records in the second table and there are only
12028538 records.
We do another COPY FROM same file onto a different database on an identical
table and this time there were 12028487 records in the count.
Another symptom of this problem is that when we do a pg_dump to file and
then a pg_restore from that file (only on large databases 20+ Gb) the
restore also loses about 100-300 records in the largest tables (the table in
question has 12+ and 6+ million records). The commands used were:
pg_dump -p <port> -U postgres -Fc -f <file> <db_name>
pg_restore -p <post> -U postgres -d <db> <file>
We are using PostgreSQL version 8.1.4 with SLES (suse enterprise linux with
SP3 - 9.3) running on 2 Opteron chips with 16 GB of memory.
Any help in diagnosing or resolving this problem is GREATLY appreciated.
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Reply to all the recipients from your mail client; the link fills in
the headers below: reply via email
Some clients, webmail especially, drop In-Reply-To and References from
a link, and the reply then starts a new thread: use the mbox below.
To: pgsql-admin@postgresql.org
Cc: bitsandbytes88@hotmail.com
Subject: Re: COPY FROM command v8.1.4
In-Reply-To: <BAY116-F16BCF6E15545D8EFE3AD3FD12A0@phx.gbl>
References: <BAY116-F16BCF6E15545D8EFE3AD3FD12A0@phx.gbl>
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox