Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtp (Exim 4.80) (envelope-from ) id 1WZqP0-0006xQ-HP for pgsql-hackers@arkaria.postgresql.org; Mon, 14 Apr 2014 23:35:02 +0000 Received: from localhost ([127.0.0.1] helo=postgresql.org) by malur.postgresql.org with smtp (Exim 4.80) (envelope-from ) id 1WZqOz-0004Cf-VM for pgsql-hackers@arkaria.postgresql.org; Mon, 14 Apr 2014 23:35:02 +0000 Received: from magus.postgresql.org ([2a02:c0:301:0:ffff::29]) by malur.postgresql.org with esmtp (Exim 4.80) (envelope-from ) id 1WZqOy-0004B6-9a for pgsql-hackers@postgresql.org; Mon, 14 Apr 2014 23:35:00 +0000 Received: from wsip-72-214-29-243.sd.sd.cox.net ([72.214.29.243] helo=joeconway.com) by magus.postgresql.org with esmtp (Exim 4.80) (envelope-from ) id 1WZqOv-0003rm-JS for pgsql-hackers@postgresql.org; Mon, 14 Apr 2014 23:35:00 +0000 Received: from [192.168.4.41] (account jconway [192.168.4.41] verified) by joeconway.com (CommuniGate Pro SMTP 4.1.8) with ESMTP-TLS id 13930938; Mon, 14 Apr 2014 16:36:03 -0700 Message-ID: <534C70A0.6070805@joeconway.com> Date: Mon, 14 Apr 2014 16:34:56 -0700 From: Joe Conway User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:24.0) Gecko/20100101 Thunderbird/24.4.0 MIME-Version: 1.0 To: Andres Freund CC: Tom Lane , "Hackers (PostgreSQL)" Subject: Re: Excessive WAL generation and related performance issue References: <534C540F.4030905@joeconway.com> <20140414215059.GA4161@awork2.anarazel.de> <3627.1397517449@sss.pgh.pa.us> <534C6DC8.7000004@joeconway.com> <20140414232532.GB4161@awork2.anarazel.de> In-Reply-To: <20140414232532.GB4161@awork2.anarazel.de> X-Enigmail-Version: 1.6 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit X-Pg-Spam-Score: -0.9 (/) List-Archive: List-Help: List-ID: List-Owner: List-Post: List-Subscribe: List-Unsubscribe: X-Mailing-List: pgsql-hackers Precedence: bulk Sender: pgsql-hackers-owner@postgresql.org -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On 04/14/2014 04:25 PM, Andres Freund wrote: > On 2014-04-14 16:22:48 -0700, Joe Conway wrote: >> That'll help performance, but lets say I generally keep WAL files >> for PITR and don't turn that off before starting -- shouldn't I >> be very surprised to need over 3TB of archive storage when >> loading a 50GB table with a couple of indexes? > > The point is that more frequent checkpoints will increase the WAL > volume *significantly* because more full page writes will have to > be generated. OK, I'll see how much it can be brought down through checkpoint tuning and report back. Thanks! Joe - -- Joe Conway credativ LLC: http://www.credativ.us Linux, PostgreSQL, and general Open Source Training, Service, Consulting, & 24x7 Support -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.14 (GNU/Linux) Comment: Using GnuPG with Thunderbird - http://www.enigmail.net/ iQIcBAEBAgAGBQJTTHCgAAoJEDfy90M199hlRnUP/3kJket9GmwEQoMUhndpxmDu 7+qDX4gFsZEGkndF6OxivSxZdRrjdioJA0STinx82w+GTpwZuBbjBfPmmjbW7kY+ t8QfuJzAauoSnscaE/NRVL2IJivRsAWbNpwWvC7nbLIhZmE4rXytN53izJwAHwP6 qJlyLmlvMB3IH75uoVo3AMQggE+gMy6kmDSfQST7e0RpkxE7Zsp51B7m6MLOxXjc gpf8ukZztCUvxFwI1ds++hEeUR7qpAT5V/1hhcFBqKOCoYXeTxH7PUrPofdcg7PT rzlGyBARQNz6apnEUCB3/bhQENHdXjmrXBeeyNUNug2jSXsi7BJpccJhPYN49XB4 FAGGxyQLB4Gl75oSO9cYJ8B0b0peYYIm9VhBOPUw1iPgouNsdlh+yA4QagPp3VnW O8+Fdf/6lcBgbABEfDwCRBBkyaVSvckqrzp946YnasiCENad3zz4UEWfekEpRzk6 QTyVsObjjKHmOFt9mGeUOH7hGpTwleT5oXDttCWOxPtDkwB6tT1pC7DnRPpmYCvt FWQC11sN0RNIeOl2W2Zo18P3dtlI8anQ/ano4FE1Dx8GKypncxAIm7RlRCKuax+C anL7fNie/ObZRMNxQ0m7nJvbzOKjVooslUDnBTje4um1Aw1ljS74brqqKkWUOP6C 3GReDBEE20wLsD/5t6L+ =/L/M -----END PGP SIGNATURE----- -- Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-hackers