Received: from maia.hub.org (maia-2.hub.org [200.46.204.251]) by mail.postgresql.org (Postfix) with ESMTP id 85E791337B85 for ; Wed, 8 Dec 2010 04:50:16 -0400 (AST) Received: from mail.postgresql.org ([200.46.204.86]) by maia.hub.org (mx1.hub.org [200.46.204.251]) (amavisd-maia, port 10024) with ESMTP id 16122-04 for ; Wed, 8 Dec 2010 08:50:09 +0000 (UTC) X-Greylist: from auto-whitelisted by SQLgrey-1.7.6 Received: from smtp.dc.baikal.ru (smtp.dc.baikal.ru [87.103.128.133]) by mail.postgresql.org (Postfix) with ESMTP id C18211337B6F for ; Wed, 8 Dec 2010 04:50:08 -0400 (AST) Received: from it319k5.dc-local (it319k5.dc-local [10.0.4.75]) (authenticated bits=0) by smtp.dc.baikal.ru (8.13.8/8.13.8) with ESMTP id oB88o5LD031955 for ; Wed, 8 Dec 2010 16:50:05 +0800 Message-ID: <4CFF46BD.8070004@dc.baikal.ru> Date: Wed, 08 Dec 2010 16:50:05 +0800 From: Vlad Arkhipov User-Agent: Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.1.9) Gecko/20100317 Thunderbird/3.0.4 MIME-Version: 1.0 To: pgsql-performance@postgresql.org Subject: Re: Slow BLOBs restoring References: <4CFDF22B.7060209@dc.baikal.ru> In-Reply-To: <4CFDF22B.7060209@dc.baikal.ru> Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit X-Virus-Scanned: Maia Mailguard 1.0.1 X-Spam-Status: No, hits=-1.91 tagged_above=-10 required=5 tests=BAYES_00=-1.9, T_RP_MATCHES_RCVD=-0.01 X-Spam-Level: X-Archive-Number: 201012/103 X-Sequence-Number: 41555 I discovered this issue a bit more. -j option is slowing down BLOBs restoring. It's about 1000x times slower if you specify this option. Does anybody plan to fix it? > I have encountered a problem while restoring the database. There is a > table that contains XML data (BLOB), ~ 3 000 000 records, ~ 5.5Gb of > data. pg_restore has been running for a week without any considerable > progress. There are plenty of lines like these in the log: > > pg_restore: processing item 3125397 BLOB 10001967 > pg_restore: executing BLOB 10001967 > > CPU usage is 100% always. The total database size is about 100 Gb and > it restores in an hour or so without BLOBs. >