Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtp (Exim 4.80) (envelope-from ) id 1Z7Aoz-0002yu-9x for pgsql-hackers@arkaria.postgresql.org; Mon, 22 Jun 2015 23:08:09 +0000 Received: from localhost ([127.0.0.1] helo=postgresql.org) by malur.postgresql.org with smtp (Exim 4.84) (envelope-from ) id 1Z7Aoy-0002qc-7l for pgsql-hackers@arkaria.postgresql.org; Mon, 22 Jun 2015 23:08:08 +0000 Received: from makus.postgresql.org ([2001:4800:1501:1::229]) by malur.postgresql.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_CBC_SHA384:256) (Exim 4.84) (envelope-from ) id 1Z7AnF-0001QG-Dg for pgsql-hackers@postgresql.org; Mon, 22 Jun 2015 23:06:21 +0000 Received: from mail-bn1on0073.outbound.protection.outlook.com ([157.56.110.73] helo=na01-bn1-obe.outbound.protection.outlook.com) by makus.postgresql.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_CBC_SHA384:256) (Exim 4.84) (envelope-from ) id 1Z7An7-0006pc-Ik for pgsql-hackers@postgresql.org; Mon, 22 Jun 2015 23:06:19 +0000 Authentication-Results: wulczer.org; dkim=none (message not signed) header.d=none; Received: from decina.local (70.113.16.71) by BLUPR11MB0675.namprd11.prod.outlook.com (10.163.216.145) with Microsoft SMTP Server (TLS) id 15.1.195.15; Mon, 22 Jun 2015 23:06:10 +0000 Message-ID: <558894DE.20807@BlueTreble.com> Date: Mon, 22 Jun 2015 18:06:06 -0500 From: Jim Nasby User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.9; rv:31.0) Gecko/20100101 Thunderbird/31.4.0 MIME-Version: 1.0 To: Craig Ringer , Taiki Kondo CC: "andres@anarazel.de" , "pgsql-hackers@postgresql.org" , Akio Iwaasa , =?UTF-8?B?SmFuIFVyYmHFhHNraQ==?= Subject: Re: [Proposal] Progress bar for pg_dump/pg_restore References: <12A9442FBAE80D4E8953883E0B84E08855C876@BPXM01GP.gisp.nec.co.jp> <20150612134801.GF28424@awork2.anarazel.de> <12A9442FBAE80D4E8953883E0B84E08856D696@BPXM01GP.gisp.nec.co.jp> In-Reply-To: Content-Type: text/plain; charset="utf-8"; format=flowed Content-Transfer-Encoding: 8bit X-Originating-IP: [70.113.16.71] X-ClientProxiedBy: BLUPR05CA0074.namprd05.prod.outlook.com (10.141.20.44) To BLUPR11MB0675.namprd11.prod.outlook.com (25.163.216.145) X-Microsoft-Exchange-Diagnostics: 1; BLUPR11MB0675; 2:OOx1BeWNkJvWWa47kPOlZT9MDc1Id1iHLyFZw/rljm4z6y1JzSdgL6lBolC6RC9o; 3:xzQgLXgsRwy5tOB3HryNdNDRCq8qaLIycpN+9kpe3QvCWgc9ECHrjjto7PaEETzkZYmwm9KL362ZeccZjUI9BngQ64oqFR29jtjOPGM4v6Luh/2EKkSHPuwA4HOusjqYMOzsouE7mJytM4PddAgqrA==; 4:LybCLSIqumnmaKwC5LGOdz/9/yvM5qIsqT6gy1WnOaHi6Ruy44dgOjxpT9qVXH3lQQTAEkapRBgStJIAws9MoZlL4Gu2HXT2IaaYZ6e0/2357p2F49pCSDEdjhV0RubykDmLrmAkSUGPHovefEA4RWZY9Xe3n0px24s1NR0fodJB2mcHRw40AfxNrA5TkqJADhFPMFf9tFqDAGCeWcFjLJLc1xsnE2Mt/wI6CFKAfwioveZmSQajFZVBM9dM+LZlyMw181sbUVR6ZP56MrZyhGtzI94VTBnzPzTKzdKtarE= X-Microsoft-Antispam: UriScan:;BCL:0;PCL:0;RULEID:;SRVR:BLUPR11MB0675; X-Microsoft-Antispam-PRVS: X-Exchange-Antispam-Report-Test: UriScan:; X-Exchange-Antispam-Report-CFA-Test: BCL:0; PCL:0; RULEID:(601004)(5005006)(3002001); SRVR:BLUPR11MB0675; BCL:0; PCL:0; RULEID:; SRVR:BLUPR11MB0675; X-Forefront-PRVS: 06157D541C X-Forefront-Antispam-Report: SFV:NSPM; SFS:(10009020)(6009001)(479174004)(51704005)(24454002)(377454003)(86362001)(50986999)(4001350100001)(33656002)(54356999)(36756003)(76176999)(50466002)(19580395003)(65816999)(42186005)(92566002)(83506001)(40100003)(122386002)(77156002)(62966003)(189998001)(66066001)(65956001)(47776003)(46102003)(93886004)(15975445007)(23676002)(2950100001)(5001960100002)(77096005)(5001770100001)(85282002); DIR:OUT; SFP:1101; SCL:1; SRVR:BLUPR11MB0675; H:decina.local; FPR:; SPF:None; MLV:sfv; LANG:en; X-Microsoft-Exchange-Diagnostics: =?utf-8?B?MTtCTFVQUjExTUIwNjc1OzIzOmlGWmNZeGI1UHNDR1gwRmIrWWJtNDZ0WE1F?= =?utf-8?B?d1M1eWxBa3NRQ2VjaUdWekFBWTRVd092VjZVU3R5V0c1WjdaL1B1NDFHZWM2?= =?utf-8?B?V0hObEpoenIrWnRUQUhUdTFhYWxiRDg0ckM2U3VNbUgvaWQ5N09VZlhOUFVP?= =?utf-8?B?SVJKc1c1ODRkVFhUaG8vY2hHZHBzdWl2TG1hclY4U0VtT0J2RG1ZdWdWcEo0?= =?utf-8?B?K3ZWSVVvOUtpTEdMSjgvNGxxMVVuWXArNGh4RUV2Z3V2c1lCS0s3Qmk4ZTVO?= =?utf-8?B?M293OW5DQzNHc3BkQWZSb0lESGM2YUdQYXhhQlBHaVBqVW1tUU44NWpGYjRr?= =?utf-8?B?Zm84YUhQeFE3cXF3dlViRjk0ZDJyM0NyT0laVDFHYXgvK3dSMVFLdWtNQ1Q3?= =?utf-8?B?SnhMcTJjdU5RUmd1NVk0TnRnZk1Pc09rUkgwQzhFUlhoRm5tZTQzR1pjbmxy?= =?utf-8?B?YUg3QU1jcXRxbFdKd1U0ZmpKcGlkRFF2bXN6cjlPb3M2b1NqMzNnd3ZoVEtO?= =?utf-8?B?bjRaTmk1bGhRMXNrZi9heDdoMndMY0Vld2dJbnlYaWNJY0FjVDA0Ui80dUZi?= =?utf-8?B?Q3dTd3g1WnZPbTk1NDFtMWI5Zm53dTA1R1JCSnZJMGRjSlN0VXZ5UkN6UVla?= =?utf-8?B?eWxpNUdMd0RSYmpYUFhjWWVlMWs3RUV2cGxHQWdidU0rdzNrNEhFekJHSEVT?= =?utf-8?B?RyswNUhrRjh4UGpoWU5zaVhDcDdReFJidGZQQmNOSEp5S0JYR3I1UDNLR3Nq?= =?utf-8?B?SndIWmNqYWowdGZFKzZhOEFuUGhsbUhIWkRJa3lza0poVWFBQUxqWjN5UFE1?= =?utf-8?B?MjBjWHRvcXJSbi9ia21teW8vQnRER0xYeXJXTEFBZSswWGRPQWc0QVQwRngr?= =?utf-8?B?azRheFZacGwxY1NaQkYxQWZ2MmhERmt0bnc0czZEWFNiZW9LaUNQbms5QWNF?= =?utf-8?B?My8vbFNqaFh1UG5STFBIQTlBbXoxeW5DWVpieWpsOCtDcWZBNVhWWjFjdnNy?= =?utf-8?B?Z2w2MDkxRStWOVBCMVBiZGR5K3g3L3hRUnBqTW1OeTZLM1o0NkdGTDdvZlQy?= =?utf-8?B?bGpSOFpTM01rWDNhT1RwcXR3c29nMzYrWHgrL3FaSTdVbFk3VVVsQ2xiTkd6?= =?utf-8?B?ZHIwMllUQ0lYbHpvODIvSDgyRENaaGpnWFh6anByYlpsSU9iWFlYb3hSQ3BL?= =?utf-8?B?bXNBenRpMmJucjErVjlYUXMraW9MTU1nL0FITWJVNmR4YWFPU25ZczhyQkFD?= =?utf-8?B?NEdRQWRZTFZZRFkxdFFrcWpnV1MvSWo5RTlLRUtyQzZtbGJHUGdaTzVpNkp6?= =?utf-8?B?Y0VWd2Y5dkN3TlE9PQ==?= X-Microsoft-Exchange-Diagnostics: 1; BLUPR11MB0675; 5:J68ZVVVzCG6aRQXq5PkoJpIqzE84pr4Bq5LbCKWUYJHUGeDqlrRsCjC+yGuWQqYTwAFDbX4ulz5G/D/QV0nnCTR52wGy2KKsewQvhjdMJ43dYiGr28R8+x7E83Hjm477C/tstGYsW06i4ajPRHzraw==; 24:yP+yxXyhbafefxV+lOk2gc1mzVS6sornQIevKhSVpP0Sn7m6QmiCLvmGBZeOOGoRDjm0iBXZk9T3gBvq3+ePwB8RzvUN6+0o6JQHe5fNmfk=; 20:/xC4e+R8MyhgvbtsMMMv+AietaWyxICDVpU4AJY+hfmZ6nU1I6Xd4nHPkygoLeWAlO7Nklw3biOa1veXPAFaCg== X-OriginatorOrg: bluetreble.com X-MS-Exchange-CrossTenant-OriginalArrivalTime: 22 Jun 2015 23:06:10.1586 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-Transport-CrossTenantHeadersStamped: BLUPR11MB0675 X-Pg-Spam-Score: -1.9 (-) List-Archive: List-Help: List-ID: List-Owner: List-Post: List-Subscribe: List-Unsubscribe: X-Mailing-List: pgsql-hackers Precedence: bulk Sender: pgsql-hackers-owner@postgresql.org On 6/21/15 9:45 PM, Craig Ringer wrote: >> And, I also understood your concern about "CREATE INDEX", but we have no way to get progress information of "CREATE INDEX". >> >At present, I think it may be good to refer to the same time as estimated time to execute "COPY TO". > You could probably get a handwave-quality estimate by looking at the > average column widths for the cols included in the index plus the > number of tuples in the table. It'd be useless for expression indexes, > partial indexes, etc, but you can't have everything... Jan Urbański demonstrated[1] getting progress stats for long running queries[2] at pgCon 2013. Perhaps some of that code would be useful here (or better yet perhaps we could include at least the measuring portion of his stuff in core... ;) [1] https://www.pgcon.org/2013/schedule/events/576.en.html [2] https://github.com/wulczer/pg-progress -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Data in Trouble? Get it in Treble! http://BlueTreble.com -- Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-hackers