pg.ddx.io  pgsql-admin@postgresql.org mailing list archive  
help / color / mirror / Atom feed
From: Mr. Dan <bitsandbytes88@hotmail.com>
To: pgsql-admin@postgresql.org
Cc: bitsandbytes88@hotmail.com
Subject: COPY FROM command v8.1.4
Date: Mon, 11 Sep 2006 14:55:26 -0400
Message-ID: <BAY116-F16BCF6E15545D8EFE3AD3FD12A0@phx.gbl> (raw)

We are having some serious problems with the PostgreSQL COPY FROM command 
and we have no clue what to do with this at this point. I think we need to 
ask for 'guru' help in diagnosing this problem. Here is exactly what we are 
doing:

We have a table with 12028587 records in it.
We do a COPY TO file of the records for this table.
We count the number of records in the file, it has 12028587 lines.
We do a COPY FROM that file into a table with identical structure as the 
first table.
We count the number of records in the second table and there are only 
12028538 records.
We do another COPY FROM same file onto a different database on an identical 
table and this time there were 12028487 records in the count.

Another symptom of this problem is that when we do a pg_dump to file and 
then a pg_restore from that file (only on large databases 20+ Gb) the 
restore also loses about 100-300 records in the largest tables (the table in 
question has 12+ and 6+ million records). The commands used were:

pg_dump -p <port> -U postgres -Fc -f <file> <db_name>
pg_restore -p <post> -U postgres -d <db> <file>

We are using PostgreSQL version 8.1.4 with SLES (suse enterprise linux with 
SP3 - 9.3) running on 2 Opteron chips with 16 GB of memory.

Any help in diagnosing or resolving this problem is GREATLY appreciated.





view thread (20+ messages)  latest in thread

Message-ID: <BAY116-F16BCF6E15545D8EFE3AD3FD12A0@phx.gbl>
Permalink:  ../BAY116-F16BCF6E15545D8EFE3AD3FD12A0@phx.gbl/
Also on:    postgresql.org/message-id/BAY116-F16BCF6E15545D8EFE3AD3FD12A0@phx.gbl

 · 

reply

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Reply to all the recipients from your mail client; the link fills in
  the headers below: reply via email
  Some clients, webmail especially, drop In-Reply-To and References from
  a link, and the reply then starts a new thread: use the mbox below.

  To: pgsql-admin@postgresql.org
  Cc: bitsandbytes88@hotmail.com
  Subject: Re: COPY FROM command v8.1.4
  In-Reply-To: <BAY116-F16BCF6E15545D8EFE3AD3FD12A0@phx.gbl>
  References: <BAY116-F16BCF6E15545D8EFE3AD3FD12A0@phx.gbl>

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox