X-Original-To: pgsql-admin-postgresql.org@postgresql.org Received: from localhost (mx1.hub.org [200.46.208.251]) by postgresql.org (Postfix) with ESMTP id 82B629FB228 for ; Mon, 11 Sep 2006 15:55:40 -0300 (ADT) Received: from postgresql.org ([200.46.204.71]) by localhost (mx1.hub.org [200.46.208.251]) (amavisd-new, port 10024) with ESMTP id 16988-04 for ; Mon, 11 Sep 2006 15:55:31 -0300 (ADT) X-Greylist: domain auto-whitelisted by SQLgrey- Received: from bay0-omc3-s28.bay0.hotmail.com (bay0-omc3-s28.bay0.hotmail.com [65.54.246.228]) by postgresql.org (Postfix) with ESMTP id B0EB49FA304 for ; Mon, 11 Sep 2006 15:55:31 -0300 (ADT) Received: from hotmail.com ([64.4.38.26]) by bay0-omc3-s28.bay0.hotmail.com with Microsoft SMTPSVC(6.0.3790.1830); Mon, 11 Sep 2006 11:55:29 -0700 Received: from mail pickup service by hotmail.com with Microsoft SMTPSVC; Mon, 11 Sep 2006 11:55:29 -0700 Message-ID: Received: from 64.4.38.200 by by116fd.bay116.hotmail.msn.com with HTTP; Mon, 11 Sep 2006 18:55:26 GMT X-Originating-IP: [66.160.12.211] X-Originating-Email: [bitsandbytes88@hotmail.com] X-Sender: bitsandbytes88@hotmail.com From: "Mr. Dan" To: pgsql-admin@postgresql.org Cc: bitsandbytes88@hotmail.com Subject: COPY FROM command v8.1.4 Date: Mon, 11 Sep 2006 14:55:26 -0400 Mime-Version: 1.0 Content-Type: text/plain; format=flowed X-OriginalArrivalTime: 11 Sep 2006 18:55:29.0756 (UTC) FILETIME=[D9EBC1C0:01C6D5D3] X-Virus-Scanned: Maia Mailguard 1.0.1 X-Spam-Status: No, hits=1.515 tagged_above=0 required=5 tests=AWL, DNS_FROM_RFC_ABUSE, DNS_FROM_RFC_POST, MSGID_FROM_MTA_HEADER, SPF_PASS X-Spam-Level: * X-Archive-Number: 200609/93 X-Sequence-Number: 23007 We are having some serious problems with the PostgreSQL COPY FROM command and we have no clue what to do with this at this point. I think we need to ask for 'guru' help in diagnosing this problem. Here is exactly what we are doing: We have a table with 12028587 records in it. We do a COPY TO file of the records for this table. We count the number of records in the file, it has 12028587 lines. We do a COPY FROM that file into a table with identical structure as the first table. We count the number of records in the second table and there are only 12028538 records. We do another COPY FROM same file onto a different database on an identical table and this time there were 12028487 records in the count. Another symptom of this problem is that when we do a pg_dump to file and then a pg_restore from that file (only on large databases 20+ Gb) the restore also loses about 100-300 records in the largest tables (the table in question has 12+ and 6+ million records). The commands used were: pg_dump -p -U postgres -Fc -f pg_restore -p -U postgres -d We are using PostgreSQL version 8.1.4 with SLES (suse enterprise linux with SP3 - 9.3) running on 2 Opteron chips with 16 GB of memory. Any help in diagnosing or resolving this problem is GREATLY appreciated.