Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtp (Exim 4.80) (envelope-from ) id 1a7XRI-0007kr-Je for pgsql-performance@arkaria.postgresql.org; Fri, 11 Dec 2015 23:49:28 +0000 Received: from localhost ([127.0.0.1] helo=postgresql.org) by malur.postgresql.org with smtp (Exim 4.84) (envelope-from ) id 1a7XRI-0007fS-6P for pgsql-performance@arkaria.postgresql.org; Fri, 11 Dec 2015 23:49:28 +0000 Received: from magus.postgresql.org ([2a02:c0:301:0:ffff::29]) by malur.postgresql.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_CBC_SHA384:256) (Exim 4.84) (envelope-from ) id 1a7XPd-0005oz-VA for pgsql-performance@postgresql.org; Fri, 11 Dec 2015 23:47:46 +0000 Received: from mail-bl2on0067.outbound.protection.outlook.com ([65.55.169.67] helo=na01-bl2-obe.outbound.protection.outlook.com) by magus.postgresql.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_CBC_SHA384:256) (Exim 4.84) (envelope-from ) id 1a7XPa-0002f1-Gt for pgsql-performance@postgresql.org; Fri, 11 Dec 2015 23:47:45 +0000 Authentication-Results: spf=none (sender IP is ) smtp.mailfrom=Jim.Nasby@bluetreble.com; Received: from aca8637d.ipt.aol.com (162.199.209.141) by SN1PR11MB0686.namprd11.prod.outlook.com (10.163.207.144) with Microsoft SMTP Server (TLS) id 15.1.337.19; Fri, 11 Dec 2015 23:47:37 +0000 Subject: Re: checkpoints, proper config To: Tomas Vondra , Alvaro Herrera References: <5669B47B.9010504@commandprompt.com> <5669FF52.2030303@2ndquadrant.com> <20151210224541.GQ2763@alvherre.pgsql> <566A24DD.8020106@2ndquadrant.com> CC: From: Jim Nasby Message-ID: <566B6098.6020508@BlueTreble.com> Date: Fri, 11 Dec 2015 17:47:36 -0600 User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.9; rv:38.0) Gecko/20100101 Thunderbird/38.4.0 MIME-Version: 1.0 In-Reply-To: <566A24DD.8020106@2ndquadrant.com> Content-Type: text/plain; charset="windows-1252"; format=flowed Content-Transfer-Encoding: 7bit X-Originating-IP: [162.199.209.141] X-ClientProxiedBy: BY1PR17CA0002.namprd17.prod.outlook.com (25.162.18.140) To SN1PR11MB0686.namprd11.prod.outlook.com (25.163.207.144) X-Microsoft-Exchange-Diagnostics: 1; SN1PR11MB0686; 2:YVTPZiflisIAAZwtz+3JFEzKkhBxmi9Yl1GY1cDgsHMwNWnOxIug/WRRzs5dmlYQQSz9afGDmVE1dfW1k7SkKSKOOK61wrbS9hXWNcfM0X27Dw/bMpTLrCcjYMC/yKBrdGwV52dWoyoo5M4dKuBnbw==; 3:/4CwmLnMZO+iMJLxwzqFswTmdKShHb/CgyHCujcAdd/AvcqwxUyXt9XkvoeTfVmygDuOy7mjuHGBqmey29uG2zOGl48YncZUmNhIYbV4BIjtzxYBpxvKxSoWTItQ9b0f; 25:Trk4Ba59cmN0eh3pLaHckPrdRD/ZK6e49zMRPDaiDFXeACElzcwOJUP4t9E/tKFRQ4JkIZsp3yGpSDywzCXGpURXyAASo02RGY9qHccqOxqDUGCZmZsjDOhmUeB8D48qdcb1gdEb2iXQoPy4LTufiG0wrUsn7XPaDb1cfJSOWlL/2e+ItD8+xqy2cHcHaVpAYfRh8gZ0xI6ILqW7YwovliQ+q2IPo70f/6El+IuaKAMwXrI78lu2Y5h9Z7DV6bofK+CtD+0SnP3ubFGg4D6pzw==; 20:GgRNlIxvt4P/NdwcVov+hjEm6EyyN6wxuErhy2RKKnIvlgz5LzGY1dUR2ZDIikzDEYGqy9KNmQRyefC/D4Yl6B+Q0sqfNY9MbfjdNO6Nn0CCyqYbBT1e+/nmN2vOkDMg1Bg8gVOIH0Q2ExTOY/qejxauKkxXVDoP8hjT6hfu2dw= X-Microsoft-Antispam: UriScan:;BCL:0;PCL:0;RULEID:;SRVR:SN1PR11MB0686; X-Microsoft-Antispam-PRVS: X-Exchange-Antispam-Report-Test: UriScan:; X-Exchange-Antispam-Report-CFA-Test: BCL:0; PCL:0; RULEID:(601004)(2401047)(5005006)(520078)(8121501046)(3002001)(10201501046); SRVR:SN1PR11MB0686; BCL:0; PCL:0; RULEID:; SRVR:SN1PR11MB0686; X-Microsoft-Exchange-Diagnostics: 1; SN1PR11MB0686; 4:Go1/pndxIK4PQNR2y94NwQaH/WHaFAiMCPiZIRKBKOnf2npYWAZU2+dtsUC+4811Hy0w9YimKWC4T3K08o9imUYiVHV95binM9uai4LNHFEuJIHFRFx5xUO4Gif5/yiMqwScW/3qy2E1h1PKlZCP8XnDb2lhpaShkSVyV3i8E11ChF3ij0w8UZky14bWm0udehvfQQwEHt24t5BwcCkAYj7IZTw5VrBwoPh0m+1a42LSfhvzutalq4mT6urZVBqgO0IAvBlbpbaI0x0eEsYgW6/MA1cIsLqiyQAXBqKE6sEq0WqSmzkS932Ex4u7HnRQLYqhN8d62lRSiXGN+wvM9W8m+o8eMb2p9yjCf/eq7AGftDl31n0OJpXsWH5HdGd3 X-Forefront-PRVS: 0787459938 X-Forefront-Antispam-Report: SFV:NSPM; SFS:(10009020)(6009001)(377454003)(24454002)(479174004)(189002)(199003)(101416001)(122386002)(80316001)(4001350100001)(106356001)(93886004)(87266999)(1096002)(5008740100001)(3846002)(105586002)(65806001)(6116002)(40100003)(83506001)(230700001)(50466002)(19580395003)(586003)(50986999)(2950100001)(5004730100002)(86362001)(54356999)(189998001)(64126003)(33656002)(65816999)(15975445007)(65956001)(97736004)(77096005)(66066001)(36756003)(47776003)(92566002)(76176999)(23746002)(42186005)(87976001)(59896002)(5001770100001)(85282002)(336755003)(18886065003); DIR:OUT; SFP:1101; SCL:1; SRVR:SN1PR11MB0686; H:aca8637d.ipt.aol.com; FPR:; SPF:None; PTR:InfoNoRecords; MX:1; A:1; LANG:en; Received-SPF: None (protection.outlook.com: bluetreble.com does not designate permitted sender hosts) X-Microsoft-Exchange-Diagnostics: =?Windows-1252?Q?1; SN1PR11MB0686; 23:0gZphQUpcjz6RcvRg4eJRS6NOktwcOkoAoafp?= =?Windows-1252?Q?ACitbOAtf+di6jGaleQIVyKPXvnQndHeJmkNY5VbaSk9PZ3ebGPwI93m?= =?Windows-1252?Q?p73bu9bGSd4uzMRBwouKWkIHAubvHKQkCZonVgJkFqYHgdv0ucf3nAYv?= =?Windows-1252?Q?o+0x614WOQ8B2IWec9fbM3YVZYShyoOpL3HBiFTnfzZXoqYDa2brolgn?= =?Windows-1252?Q?9b9wHDgd6ctE8P38dyw8kRxCN2cVyyu18aqew9XQiKUji4ihToEICcgD?= =?Windows-1252?Q?EkCnBxMyDbCVb5O71fwbFlLPgx7CLQ+St376P4UZPLTFevWdKkwG8sOw?= =?Windows-1252?Q?iLumgUv81BVA6sPc7VgB6yiil/tL/xsX/331r8hySA3Meu0IqqVBEXUX?= =?Windows-1252?Q?y+gRj4fAljWtVsaKsiQXU1jpQyYarmZ4e8HvbuxjbJJcqc9tx/cjlob/?= =?Windows-1252?Q?xVUBEa6m/gUtuB7U38aZhO4yT8cAKwlzjvDvHBIlzxxYiC8sAJthENca?= =?Windows-1252?Q?/CiUpP33iB1NirpEo80/F6+4IKuQBFOX/p3ss/cm1UYbtZX0+fhCFU2v?= =?Windows-1252?Q?XUnvSxyOEdyMnyI8WD8z7o7ez6eFRqJGxA74rtNgTofRFtKq7PFmkXT2?= =?Windows-1252?Q?8MSrt57fwWkvDkPKIBDzvGbEBYMrE1NolIynjzrVXJcPXPZ+OlU5iCrp?= =?Windows-1252?Q?R6dquAK0wlIpZpp/Ebh24ryCqVo2x+mhs9AxAf8GG5auYP1DCJ1MW55h?= =?Windows-1252?Q?G7W5esjj6S76eDotsP7qJ+vdGl28rOyia8Tr9zMbSEChEXDyQ/Lx4+fR?= =?Windows-1252?Q?Hfiv8KvKrQvE3OjoKZw7OGuaVfVroo9IhMqVgHdg5OsScOYXhzqKH30s?= =?Windows-1252?Q?EBjWH8TyYwu2l37tXsLMed5OLT6S025UXYrm8C23EMsMw4zxjCxy414i?= =?Windows-1252?Q?ZgpQCmVEU9ahfCIY/66MtvjQO+q1IaryBIgDjVlNXa2EiXrr0KAuKI3V?= =?Windows-1252?Q?2MlDCQ4xUtu2XocOElxMpO1XIu6r00K62WzyKAEnYydRMH4IVd/ZnQY4?= =?Windows-1252?Q?rJtY9QWAAVP3iA1SbYrIdLwwEcMg20hGjtgFzEPQgmExYF85wHVaWss4?= =?Windows-1252?Q?5hBfsgZPAbYijB+v7/nrkorVIb3GJcrb0KEeVXvK24pDYFKKX6KAQOqu?= =?Windows-1252?Q?vA8XquozJnmxulJKTN9twiO5qZqhcl4wi+8sS/5GrOj74+4V6tfvNCYu?= =?Windows-1252?Q?Ihz8oYJuMima1c4PP92HacFCbWMQLxyvU6c81LdJqfHF8z4TWXuIhGIU?= =?Windows-1252?Q?CcrurfoBA71C1RnoZeGStAG5VZMk/iP7bjfG1vlh/bDesNf0+S1uMxe8?= =?Windows-1252?Q?t5DSX20sqEstS4NmImGr/Y3kiY/Rr0eaextP9rTxI5e/r8cWGCFMBs?= =?Windows-1252?Q?=3D?= X-Microsoft-Exchange-Diagnostics: 1; SN1PR11MB0686; 5:d5toY2ThsfTZfMqz+RhvOCnyUdpCvmGleoHH/oOReGiEgU9TZyyGvfq7EXcj/d/Wg27zocMlhzXj87N3aRLYum0mQCMEWyLgHdBZGeM57kiBnQyr0rqE06tyXdzdJZJLVxlDr71mTwWuMN+3fQrGRw==; 24:MKzraPL+dPTeaEg/s8+aW70DuA0IHA1vJ0RpHYV3svjAKJBYXLrSv1ks5irolbnBBP5iedUb0cbZtYiP7I8nbFAja3uxzm1RuqY9CzOWvos= SpamDiagnosticOutput: 1:23 SpamDiagnosticMetadata: NSPM X-OriginatorOrg: bluetreble.com X-MS-Exchange-CrossTenant-OriginalArrivalTime: 11 Dec 2015 23:47:37.8207 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-Transport-CrossTenantHeadersStamped: SN1PR11MB0686 X-Pg-Spam-Score: -1.9 (-) List-Archive: List-Help: List-ID: List-Owner: List-Post: List-Subscribe: List-Unsubscribe: X-Mailing-List: pgsql-performance Precedence: bulk Sender: pgsql-performance-owner@postgresql.org On 12/10/15 7:20 PM, Tomas Vondra wrote: >> I agree, but actually, what is the sense of checkpoint_warning? I think >> it was useful back when we didn't have log_checkpoints, but now that we >> have detailed checkpoint logging I think it's pretty much useless noise. >> > > Not entirely. The WARNING only triggers when you get below the 30s (or > whatever value is set in the config) and explicitly warns you about > doing checkpoints too often. log_checkpoints=on logs all checkpoints and > you have to do further analysis on the data (and it's just LOG). Agree, though I also find it pretty useless to set it significantly less than checkpoint_timeout in almost all cases. If you want ~5 minutes between checkpoints checkpoint_timeout=30 seconds is way too low to be useful. We should really change the default. -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in Analytics, Data Architecture and PostgreSQL Data in Trouble? Get it in Treble! http://BlueTreble.com -- Sent via pgsql-performance mailing list (pgsql-performance@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-performance