Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtp (Exim 4.80) (envelope-from ) id 1aanVi-0007Ro-1r for pgsql-hackers@arkaria.postgresql.org; Tue, 01 Mar 2016 16:50:58 +0000 Received: from localhost ([127.0.0.1] helo=postgresql.org) by malur.postgresql.org with smtp (Exim 4.84) (envelope-from ) id 1aanVh-0004HJ-KM for pgsql-hackers@arkaria.postgresql.org; Tue, 01 Mar 2016 16:50:57 +0000 Received: from magus.postgresql.org ([2a02:c0:301:0:ffff::29]) by malur.postgresql.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_CBC_SHA384:256) (Exim 4.84) (envelope-from ) id 1aanVh-0004Fw-10 for pgsql-hackers@postgresql.org; Tue, 01 Mar 2016 16:50:57 +0000 Received: from sss.pgh.pa.us ([66.207.139.130]) by magus.postgresql.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_CBC_SHA384:256) (Exim 4.84) (envelope-from ) id 1aanVd-00017D-JX for pgsql-hackers@postgresql.org; Tue, 01 Mar 2016 16:50:56 +0000 Received: from sss1.sss.pgh.pa.us (localhost [127.0.0.1]) by sss.pgh.pa.us (8.14.4/8.14.4) with ESMTP id u21GoaCN014621; Tue, 1 Mar 2016 11:50:36 -0500 From: Tom Lane To: "Daniel Verite" cc: "Alvaro Herrera" , "Robert Haas" , "Jim Nasby" , "Ronan Dunklau" , "pgsql-hackers" Subject: Re: pg_dump / copy bugs with "big lines" ? In-reply-to: <4023faba-72cc-4949-b11c-8c67a0ecf407@mm> References: <4023faba-72cc-4949-b11c-8c67a0ecf407@mm> Comments: In-reply-to "Daniel Verite" message dated "Tue, 01 Mar 2016 17:43:00 +0100" Date: Tue, 01 Mar 2016 11:50:36 -0500 Message-ID: <14620.1456851036@sss.pgh.pa.us> X-Pg-Spam-Score: -1.9 (-) List-Archive: List-Help: List-ID: List-Owner: List-Post: List-Subscribe: List-Unsubscribe: X-Mailing-List: pgsql-hackers Precedence: bulk Sender: pgsql-hackers-owner@postgresql.org "Daniel Verite" writes: > Alvaro Herrera wrote: >> If others can try this patch to ensure it enables pg_dump to work on >> their databases, it would be great. > It doesn't seem to help if one field exceeds 1Gb, for instance when > inflated by a bin->hex translation. It's not going to be possible to fix that without enormously invasive changes (affecting individual datatype I/O functions, for example). And in general, fields approaching that size are going to give you problems in all kinds of ways, not only COPY. I think we should be satisfied if we can make COPY deal with the sum of a line's fields exceeding 1GB. regards, tom lane -- Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-hackers