Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtp (Exim 4.84_2) (envelope-from ) id 1cd6Of-00045S-R0 for pgsql-hackers@arkaria.postgresql.org; Mon, 13 Feb 2017 02:29:45 +0000 Received: from localhost ([127.0.0.1] helo=postgresql.org) by malur.postgresql.org with smtp (Exim 4.84_2) (envelope-from ) id 1cd6Oe-0000V8-Tw for pgsql-hackers@arkaria.postgresql.org; Mon, 13 Feb 2017 02:29:44 +0000 Received: from magus.postgresql.org ([2a02:c0:301:0:ffff::29]) by malur.postgresql.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_CBC_SHA384:256) (Exim 4.84_2) (envelope-from ) id 1cd6Oe-0000V1-8o for pgsql-hackers@postgresql.org; Mon, 13 Feb 2017 02:29:44 +0000 Received: from mail-by2nam01on0065.outbound.protection.outlook.com ([104.47.34.65] helo=NAM01-BY2-obe.outbound.protection.outlook.com) by magus.postgresql.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_CBC_SHA384:256) (Exim 4.84_2) (envelope-from ) id 1cd6OY-0005Gn-Pk for pgsql-hackers@postgresql.org; Mon, 13 Feb 2017 02:29:43 +0000 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=BlueTreble.onmicrosoft.com; s=selector1-bluetreble-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version; bh=iojwvfyVWTYI8YbJKTF9aOuSjhghYvyjM724XELSKSU=; b=W0xaX70QqiMOOyo87vj4D1KvUcE7BnBiHHLsOKcVpnt1pKf0E6MRrpN2ixc3xk6nQ1WV+bOsohOK/k7Yn01kc7x9aCUR3IGVhfzxaWT/AM0DninkPi52YxOXZWz4+aqgzvP1AP26OPcDMdlunsBT10fRbgF3tOnDUNwfWoCB+4A= Authentication-Results: spf=none (sender IP is ) smtp.mailfrom=Jim.Nasby@bluetreble.com; Received: from decina.local (70.113.18.142) by BN6PR11MB1636.namprd11.prod.outlook.com (10.172.24.9) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384_P384) id 15.1.888.16; Mon, 13 Feb 2017 02:29:33 +0000 Subject: Re: gitlab post-mortem: pg_basebackup waiting for checkpoint To: Michael Banck , Magnus Hagander References: <1486805889.24568.96.camel@credativ.de> <1486808720.24568.103.camel@credativ.de> <1486809384.14426.1.camel@credativ.de> CC: Pg Hackers From: Jim Nasby Message-ID: Date: Sun, 12 Feb 2017 20:29:25 -0600 User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.11; rv:45.0) Gecko/20100101 Thunderbird/45.7.1 MIME-Version: 1.0 In-Reply-To: <1486809384.14426.1.camel@credativ.de> Content-Type: text/plain; charset="utf-8"; format=flowed Content-Transfer-Encoding: 7bit X-Originating-IP: [70.113.18.142] X-ClientProxiedBy: BY2PR1001CA0008.namprd10.prod.outlook.com (10.164.163.146) To BN6PR11MB1636.namprd11.prod.outlook.com (10.172.24.9) X-MS-Office365-Filtering-Correlation-Id: c6c42555-d660-4dc6-3793-08d453b825e9 X-Microsoft-Antispam: UriScan:;BCL:0;PCL:0;RULEID:(22001);SRVR:BN6PR11MB1636; X-Microsoft-Exchange-Diagnostics: 1;BN6PR11MB1636;3:RJC/pNTTF/j7g7M1oRsFF9AInH/JAq+ibBhn5vQQxnTpZer8Dx/YkajZMZ198cY/4wHcx8u/kzqEZBwIwQUooHrr9z3ilWjoM0OafAweIPLKsdgCtz2gqdfKZ6q/Cgl7RQ6VY9Omv2vAfJyb1y7s5zZ2s3AVeWNA0dkBPXTxC2SIowa1PiJnkkVdcoLyjmmZtHa9/WcAKqo2uNW7f7EWF96UgDsJ+hXtjUzTyikD+KhXURTWQw/Wi0/HsbrH/vfCVPeAhIt6J+2qyOispscjDw==;25:UluaVKKDHUCq4VTlka7g1/JC47xg/kCU1Hj2sNnJO/16gQmoiyYvodVqHko1rLBotBlmXWNLwd2BTvaTKA5TP0Gkq7lWVapxRXmeBqyIS4la5DByOlza5Fu3107968QCNCnsoxl9w8I6QY8hIS78tX6qf/EtA+8JV+AgS0hU35I64pGBLrpANtnjN/Zbj4v08XZag8WW3JlGxH4R7oXAcph6wiuYPkAKwfnFnrfLVb/yiutFDRtvCFqdEhVXaP4WBvO0Lob6orL2sZinQai2u2WliB+4q+kel0IjWgmXW3GgI81Whl1lWqUjyWLdvwFi8J9ubOt0OHFTkxktsAjN0gO4zjMJDMkdLvNgoNFx+fTzVs4q1mRagMMGLzmCeAJtPXKeV4KhjUk7qRFbiSb97fr2+ZdU5hyS8vpiqCYKmFZXUvW+ceiia74LL2XDYbJ0xRBfa2tdbQfXJ1qk3RDYCA== X-Microsoft-Exchange-Diagnostics: 1;BN6PR11MB1636;31:mkFxbVv/t7Z01qdgI/r8U2oSBn4MSiWMHql7EkgqbvY9PNjKQ+9k1kQBxFCCt8GM8tYM6BmjstylDV3bmEQYg9FXluvldFJe5EwuV7Cse3u2zNBS24VPQgJo6jrwrZutclJMMQioEcBTnKMMzLPFtyvfr/0aXYC3vil9G0TBkd+zrWH/mwLtRFROmUoG+pDMs9nOGm1JrtOw6u2tjwRS/sRbm3hm700MJWOzhyLNCFHTF06/Pjur9JZcfVVzPE/8BE9/nJLMZqTjDxBEujxHfA==;4:dXq8fw9FOmPkMnv86cP67qITlv+IQAslV5CJwKUVPgx8ueMAjxYVLQhEklh8VnrI0zmx3n79Fc9Y9LeE0AG9JOK+idsc2VzY/6wJVOs/62xcaKDJmk8GD0J/2PBoww2G6op91LDmOGl3JugyEiYnA2mFzO7nwELsPYwoh0BlyUW57putZTBUFi9zhOS888y61wnD7/98TxcydlCFyB5e5/0ZntVMOQrPBst5DNTQnXRdrrFbfjQD8dmirP7zddNvr5oPntg0LzlbUYbubKSkt/XvdO4/bjmo7sAs2VwH+TQGwhn3WUsxX+koRgDd6EIicyb5tvst5lTeP9wBQb0aXSv8hECiIoxllsUggmo5yz3II2oEpfxdIJWtD9ysEqX0auejq/eWHMlvhGh234RVyTn9ZT46Nt7pmvKC6rS/9KQhwvbtIxc61xGg4tyBkdI7yYu/tAFhX7GQ6w/HdWC0J2YJAJfFVGhGM5XaRN13kJNh+KNKoWzBrxS2Kz06g1rqrGT9qPe2a2LH74b8V18a/FIKUAtShIvcqZdXgG6ReD7Iq/fG4wpHY2kV8cupg3UTWih1VH8yYLn5CsnBYI6v+3MwSZgV1WjscxkFhL+Q+hJAQT4d7ZFfUh3oZ/gpv+CldH/njrGgLWbPHUC0+BlIDw== X-Microsoft-Antispam-PRVS: X-Exchange-Antispam-Report-Test: UriScan:; X-Exchange-Antispam-Report-CFA-Test: BCL:0;PCL:0;RULEID:(6040375)(601004)(2401047)(8121501046)(5005006)(3002001)(10201501046)(6041248)(20161123555025)(20161123558025)(20161123564025)(2016111802025)(20161123562025)(20161123560025)(6072148)(6043046);SRVR:BN6PR11MB1636;BCL:0;PCL:0;RULEID:;SRVR:BN6PR11MB1636; X-Forefront-PRVS: 02176E2458 X-Forefront-Antispam-Report: SFV:NSPM;SFS:(10009020)(4630300001)(6009001)(7916002)(39410400002)(39830400002)(39450400003)(189002)(377454003)(24454002)(199003)(5660300001)(86362001)(53546003)(6246003)(97736004)(6506006)(65806001)(66066001)(65956001)(47776003)(6512007)(3846002)(6486002)(6306002)(4001350100001)(53936002)(966004)(36756003)(31696002)(25786008)(65826007)(8676002)(2906002)(76176999)(4326007)(305945005)(106356001)(105586002)(64126003)(81166006)(81156014)(33646002)(229853002)(68736007)(50466002)(7736002)(38730400002)(6116002)(230700001)(6666003)(83506001)(2950100002)(189998001)(93886004)(23676002)(31686004)(101416001)(92566002)(42186005)(50986999)(54356999)(53386004)(85282002);DIR:OUT;SFP:1101;SCL:1;SRVR:BN6PR11MB1636;H:decina.local;FPR:;SPF:None;PTR:InfoNoRecords;MX:1;A:1;LANG:en; Received-SPF: None (protection.outlook.com: bluetreble.com does not designate permitted sender hosts) X-Microsoft-Exchange-Diagnostics: =?utf-8?B?MTtCTjZQUjExTUIxNjM2OzIzOkpUbHNCSWdhTUQwMlZ2OC9TSUpIMCs2c0lP?= =?utf-8?B?U0NNbThOUHduSDlSL0JmbFJXWDVnNGRhaUxKUk5iekZjYUd3U0V6cngrMXBp?= =?utf-8?B?MlMvaXVsVE5MVEt4NmpiQXMwdnFCUEtTTk4yWUgzNkFzMEkvTkxaU1hCMHVU?= =?utf-8?B?cTI1dEJMQk0wbzlvOFFqUzk1bHR4cUJKWGQ2dU9uNTNXT2J0cHIzUHRwMFlS?= =?utf-8?B?d3cwNDRLRmZ2dktzK0ROZFhVY0p0U1lFTFZvem9lbDFhSHdVR2g4OTF0SnRD?= =?utf-8?B?M0c5dXRKVE9xMmtPU0V5ZjBaaXRZeWtJV21kMENDUVI1Q01OZjhEQTk0Y0tU?= =?utf-8?B?V29DYzMwLzR4VndPN0R5SXc5cXhjdXNWOGZnMWJhaFp3SkdHVSs1b0V4Wlla?= =?utf-8?B?NkRzM0Z4M2dCdm93a1hMOENqRGs5c1d3cUVmK1ZWbndZdTBmVVVwZS9XeUFG?= =?utf-8?B?djRCY2VFUk9GcCtqOE5nYjFzS1hXczF2UFAwaisyOVZTaXRGYUNub1dXQlhj?= =?utf-8?B?MFRjbHVQL3Q2RUVmdGt5MnF2SitmTXJOeEF3bURzR0c5dHpmVUpuaGRIVElS?= =?utf-8?B?N0dMTTQvRGZyZlNWZlE0TTFiL0E4cGMxQVJpaXR1SDBYQlRUdEFBTXpYeGsx?= =?utf-8?B?ZlA4bE1ZMmJyeWlhYzlxclg2Q3VQbjdKNW1XTUFJTGZvN2kyWmJPR0o2NkZC?= =?utf-8?B?U2pvMHVpdTh4QURicHNGU3dNK0Z1TVBOVEtycjNlcDJYK09CZVZRVXI0Qy9H?= =?utf-8?B?V0JwMm82QkFTbEdvd1B3N1AwLzJOMXRsbXB0QW44Qy9Lb2w1ZUIwNmZvRlRK?= =?utf-8?B?d2pqWXNza3dUOTdyaEZHeE1Vb2dGUSt3S0o2dUx5RVdJajZtY0JjK1A5ZXJ3?= =?utf-8?B?TzQ3T0xRQ1NFaGFWS3lLeGV2aytpRGtXRktjcVRjU3UzSEtEazlmWTRCc21q?= =?utf-8?B?ZldxS3o2QnU2TnVSbTB3WGt6NlVwTSt3YzUrejU4akhHam1DVmJ2UVVDc1cr?= =?utf-8?B?QVJNZ3RYQVpVU0QyV2Y5eExmZkhjdWV6Q0wxSjY0OFd1TDhYdVM1WVJtbXNn?= =?utf-8?B?dWJoT2M0QXhPZU9HS3RHRlNObUhOU2srQnZKSHRVWXZGOGxRY0NwRTFkclIv?= =?utf-8?B?MGVtZXppcUJUeTU0YjFIdXRKRHBsNFBrQXV6YUsrZWc0dUNna3Bab08zek90?= =?utf-8?B?Q2dQWUpKRVVvcmlIckEzeWJYb01lZDdkcHFvUW1nKzViaERZVjMrWEhEc0JJ?= =?utf-8?B?S0FFQ1pKUU4rK3p4NUZ4T0FhZTlXZXdsU2dJQ0RaejFjV2o5WUk5YVBwNmIv?= =?utf-8?B?aWNuNlhlQUJaWW9ycXNBclVjNmNNK3prUEE5NHloNTNpU2pNR1prczdNSnp1?= =?utf-8?B?M3ROa0dZQkcyRUU0ajJQSlpTMnU4d2RWQytsNkZTcTU0bGlBQit3RWhlTGFE?= =?utf-8?B?S2xJOEJjY3FIOUUxcTdwZDJ4OVdkZHRxOXRXZTVFbllsVzA0bnc3bnQ0QU1u?= =?utf-8?B?empFdGVsNldJV2xOdDc2UFpLQXlUVlRVL3NvYTJ2bDFtZmtoTzhhZ2ZnY0k2?= =?utf-8?B?R09uVFdqLzFQQy9JSjNsNzlXVnltYUZLdmwyNEh1dkliMkUwRFVvekdZUUcx?= =?utf-8?B?U3RRMVNPUHFlek01ZEJPbEJQV2RRUSt4eHdOOUxLMEVsUlJWc0dhL2NMdnhz?= =?utf-8?B?QXZnM1pGOEpMdlY3TTZTdVl3QVpiWjNVR05hVnloZGdkbWk2TFA1anE2VnNE?= =?utf-8?B?N2VsMHczYXZaMHg4b3p5SlYwa2tEVGlmVFZjVVFMbUxjZWVLV01CYjVtMkhZ?= =?utf-8?B?d3ZEbG55bWdySXhUZ1NwUUlwaUYxdDVMUm5RN0JYM0VKV0dKSjJ3RW1RZW1p?= =?utf-8?B?b1hxYmJReGJIbGJSbEhPaEJma2hrR1cwdm12ZWxJZXcxaElHTEhrN1dSb0V3?= =?utf-8?B?Z29PdTB3cDNuSDlaeVNRaDRxZzJOT09yTzBHaEdhZm45RUN6dDduTnlyR2Rw?= =?utf-8?B?VEF0aVdvOG1hQWJEVG0vTXNqZWhrVGlHVm9sZz09?= X-Microsoft-Exchange-Diagnostics: 1;BN6PR11MB1636;6:nAvexZnsDY9NRR3gvoGHnf9g76pnVHUyDl4CBdecWfeRXa+zOyVNk+loaWVyWwX4vs3rUPOOPEEiNNa6mQ3Bqr7WtJPK+Cymq8w5VhMd9ZRrZK59X7mjGZ2H2tJFhuTI0bXWQEQdpVks6BJI9Mwhstknjdrkd5ftwom8/C2GPzBPdZHzCSvpE0gkQocJP/RWBbnsizlb9aGg/gXXE/tRdR7Wv92lnt/hLNvn762iJnhoDa5QsrbJxK5GgaN1uKe2KXU52xs5K2IZj63b9kipLuw5oRc2eRfKbLuv6Ti08XlSFXd2ujXwZWd1YzBbbpNBV0vS9HQwk3f4/X9CU9Fkrclum222xfiEoa4x3cLoujtLE37LiZ8S63hu9PxSRdLg4gCqJpaw1HCEF20tJLf/Bw==;5:gJdRcIg0GFo8IpFMbzG1f2Y3mYIVavWouvUrrFJMQcBey+l2D/qXezj3MhAzkQ9l45wP7ZLcCpQAvyB8oCvPiDe9UcyUhVENgePlHzrde7QBX+YhcS6klyLyA0fbBGB4iXbze8V5fJzucwGLFK3NBg==;24:XUCX0b2Z3nSDCDt0nfwhfW/S3e8LDYdG2L4Dt8OaysGr5THO3m5CbdBoBFQN7hFPM3RU2aoRHC4XT3Nox4iNK06qLB0HfOrdMyKhI6uuLXE= SpamDiagnosticOutput: 1:99 SpamDiagnosticMetadata: NSPM X-Microsoft-Exchange-Diagnostics: 1;BN6PR11MB1636;7:W/wsqAw/O446UtzWREObAdxl/t3DYDcdGOeXX84kVWIO8ScxxYnhyZOE7wLskMz5b1YnVKawGL/w5HfjOzuAhsB5LoJloP1ahjgJeueot/XZ+3J45NEHu5yAdHh81mGylD/9dpGUOtVBDlL5UxVCduAWJ5THW47ULSqHqtR8GxZWCqK3tVy01hAMa5GnIEs2miexEvoVxDcoFPtaX0M0sdfpqmw9pAmm1RAAtkrs3Z7yYkdBJSW6OcW3cfy8o5fysdDDjKzP+rcNRdzPaRv+dxak+EHITzwdvvwjxU/15cw0CqaLOoi+8xzXpE8ayOc/r9Zj7kJrjQp9ZM5OtbHj9WhEuWLavrvMCI3cNc6jW+tVqjEMKjOT6I0PIn8QK/+2KCm9aXFwnqMePUe4Z010swBD8290I9SEMdfMGxLZ2HRyZWWE0KPQwp+i0cTOuVa/nbKaJ8tRoGM2JKOnFJrvwTFuiC6Yq95RZhXdw0Oh8709nflf2SBng9vrQ5KmN/4QrVIRaxGugsw92cdwy2WBTQ== X-OriginatorOrg: bluetreble.com X-MS-Exchange-CrossTenant-OriginalArrivalTime: 13 Feb 2017 02:29:33.5036 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-Transport-CrossTenantHeadersStamped: BN6PR11MB1636 X-Pg-Spam-Score: -2.9 (--) List-Archive: List-Help: List-ID: List-Owner: List-Post: List-Subscribe: List-Unsubscribe: X-Mailing-List: pgsql-hackers Precedence: bulk Sender: pgsql-hackers-owner@postgresql.org On 2/11/17 4:36 AM, Michael Banck wrote: > I guess you're right, I've moved it further down. There is in fact a > message about the xlog location (unless you switch off wal entirely), > but having another one right before that mentioning the completed > checkpoint sounds ok to me. 1) I don't think this should be verbose output. Having a program sit there "doing nothing" for no apparent reason is just horrible UI design. 2) I think it'd be useful to have a way to get the status of a running checkpoint. The checkpointer already has that info, and I think it might even be in shared memory already. If there was a function that reported checkpoint status pg_basebackup could poll that to provide users with live status. That should be a separate patch though. -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in Analytics, Data Architecture and PostgreSQL Data in Trouble? Get it in Treble! http://BlueTreble.com 855-TREBLE2 (855-873-2532) -- Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-hackers