Received: from malur.postgresql.org ([2a02:16a8:dc51::56]) by arkaria.postgresql.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_CBC_SHA384:256) (Exim 4.89) (envelope-from ) id 1frrEj-0007ji-9W for pgsql-hackers@arkaria.postgresql.org; Mon, 20 Aug 2018 20:57:17 +0000 Received: from localhost ([127.0.0.1] helo=malur.postgresql.org) by malur.postgresql.org with esmtp (Exim 4.89) (envelope-from ) id 1frrEh-0001gO-FE for pgsql-hackers@arkaria.postgresql.org; Mon, 20 Aug 2018 20:57:15 +0000 Received: from magus.postgresql.org ([2a02:c0:301:0:ffff::29]) by malur.postgresql.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_CBC_SHA384:256) (Exim 4.89) (envelope-from ) id 1frrEh-0001gH-60 for pgsql-hackers@lists.postgresql.org; Mon, 20 Aug 2018 20:57:15 +0000 Received: from smtp-fw-6001.amazon.com ([52.95.48.154]) by magus.postgresql.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_CBC_SHA384:256) (Exim 4.89) (envelope-from ) id 1frrEZ-0006aU-Ev for pgsql-hackers@postgresql.org; Mon, 20 Aug 2018 20:57:14 +0000 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=amazon.com; i=@amazon.com; q=dns/txt; s=amazon201209; t=1534798627; x=1566334627; h=from:to:cc:subject:date:message-id:references: in-reply-to:content-id:content-transfer-encoding: mime-version; bh=yakAO9/Z/U6+xFP0GDWPu2ZlGOnDgLrzdpCLxWWLSis=; b=UV6xqYdcse5P1HzeUNBJD5cxbcJwAjEnjIFq2cvZ+P1YgAcwAMCidqQm xMPRNiu2kr6g8bspCqAoSQBIntbmOHRDDLaIfdzrUT2dMUT1XNgnwB0wX o6T/yQAv3ncepd2BnfmVGGlgiFTxNEuzpYJ7kS9rS5yD1j+x3TufL7BAc w=; X-IronPort-AV: E=Sophos;i="5.53,266,1531785600"; d="scan'208";a="352973617" Received: from iad6-co-svc-p1-lb1-vlan3.amazon.com (HELO email-inbound-relay-2c-397e131e.us-west-2.amazon.com) ([10.124.125.6]) by smtp-border-fw-out-6001.iad6.amazon.com with ESMTP/TLS/DHE-RSA-AES256-SHA; 20 Aug 2018 20:57:03 +0000 Received: from EX13MTAUWC001.ant.amazon.com (pdx1-ws-svc-p6-lb9-vlan2.pdx.amazon.com [10.236.137.194]) by email-inbound-relay-2c-397e131e.us-west-2.amazon.com (8.14.7/8.14.7) with ESMTP id w7KKv1sF077001 (version=TLSv1/SSLv3 cipher=AES256-SHA bits=256 verify=FAIL); Mon, 20 Aug 2018 20:57:02 GMT Received: from EX13D03UWC002.ant.amazon.com (10.43.162.160) by EX13MTAUWC001.ant.amazon.com (10.43.162.135) with Microsoft SMTP Server (TLS) id 15.0.1367.3; Mon, 20 Aug 2018 20:57:01 +0000 Received: from EX13D03UWC004.ant.amazon.com (10.43.162.49) by EX13D03UWC002.ant.amazon.com (10.43.162.160) with Microsoft SMTP Server (TLS) id 15.0.1367.3; Mon, 20 Aug 2018 20:57:01 +0000 Received: from EX13D03UWC004.ant.amazon.com ([10.43.162.49]) by EX13D03UWC004.ant.amazon.com ([10.43.162.49]) with mapi id 15.00.1367.000; Mon, 20 Aug 2018 20:57:00 +0000 From: "Bossart, Nathan" To: Michael Paquier , Postgres hackers CC: "horiguchi.kyotaro@lab.ntt.co.jp" Subject: Re: Improve behavior of concurrent ANALYZE/VACUUM Thread-Topic: Improve behavior of concurrent ANALYZE/VACUUM Thread-Index: AQHUMorqO3SZxB2DakaO1o8WveOkQ6TDhdKAgAVR8oA= Date: Mon, 20 Aug 2018 20:57:00 +0000 Message-ID: <720DF5E4-053F-46C7-B11F-550EF2C39F6D@amazon.com> References: <20180812222142.GA6097@paquier.xyz> <20180817064223.GH1693@paquier.xyz> In-Reply-To: <20180817064223.GH1693@paquier.xyz> Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-ms-exchange-messagesentrepresentingtype: 1 x-ms-exchange-transport-fromentityheader: Hosted x-originating-ip: [10.43.162.167] Content-Type: text/plain; charset="utf-8" Content-ID: <9AB4BDFB7867D6458EC4F8C07436ABB1@amazon.com> Content-Transfer-Encoding: base64 MIME-Version: 1.0 Precedence: Bulk List-Id: List-Help: List-Subscribe: List-Post: List-Owner: List-Archive: Precedence: bulk SGksDQoNClNvcnJ5IGZvciB0aGUgZGVsYXkhICBJIGxvb2tlZCB0aHJvdWdoIHRoZSBsYXRlc3Qg cGF0Y2guDQoNCk9uIDgvMTcvMTgsIDE6NDMgQU0sICJNaWNoYWVsIFBhcXVpZXIiIDxtaWNoYWVs QHBhcXVpZXIueHl6PiB3cm90ZToNCj4gSSBoYXZlIHJld29ya2VkIHRoZSBwYXRjaCBvbiB0aGlz IHNpZGUsIGNsYXJpZnlpbmcgdGhlIHVzZSBvZiB0aGUgbmV3DQo+IGNvbW1vbiBBUEkgZm9yIHRo ZSBsb2dzLiAgT25lIHRoaW5nIEkgYW0gd29uZGVyaW5nIGFib3V0IGlzIHdoYXQgZG8gd2UNCj4g d2FudCB0byBkbyB3aGVuIFZBQ1VVTSBBTkFMWVpFIGlzIHVzZWQuICBBcyBvZiBIRUFELCBpZiB2 YWN1dW1fcmVsKCkNCj4gc3RvcHMsIHRoZW4gYW5hbHl6ZV9yZWwoKSBpcyBuZXZlciBjYWxsZWQs IGFuZCB0aGUgb25seSBsb2cgc2hvd2luZyB1cA0KPiB0byBhIG5vbi1vd25lciB1c2VyIHdvdWxk IGJlOg0KPiBza2lwcGluZyAiZm9vIiAtLS0gb25seSBzdXBlcnVzZXIgY2FuIHZhY3V1bSBpdA0K Pg0KPiBXaXRoIHRoaXMgcGF0Y2gsIHRoaW5ncyBiZWNvbWUgcGVyaGFwcyBtb3JlIGNvbmZ1c2lu ZyBieSBnZW5lcmF0aW5nIHR3bw0KPiBXQVJOSU5HIGxvZyBlbnRyaWVzOg0KPiBza2lwcGluZyAi Zm9vIiAtLS0gb25seSBzdXBlcnVzZXIgY2FuIHZhY3V1bSBpdA0KPiBza2lwcGluZyAiZm9vIiAt LS0gb25seSBzdXBlcnVzZXIgY2FuIGFuYWx5emUgaXQNCj4NCj4gV2UgY291bGQgZWl0aGVyIGNv bWJpbmUgYm90aCBpbiBhIHNpbmdsZSBtZXNzYWdlLCBvciBqdXN0IGdlbmVyYXRlIHRoZQ0KPiBt ZXNzYWdlIGZvciB2YWN1dW0gYXMgSEVBRCBkb2VzIG5vdy4gIEkgaGF2ZSBhbHNvIGFkZGVkIHNv bWUgc2ltcGxlDQo+IHJlZ3Jlc3Npb24gdGVzdHMgdHJpZ2dlcmluZyB0aGUgc2tpcHBpbmcgbG9n cyBmb3Igc2hhcmVkIGNhdGFsb2dzLA0KPiBub24tc2hhcmVkIGNhdGFsb2dzIGFuZCBub24tb3du ZXJzLiAgVGhpcyBjb3VsZCBiZSBhIHNlcGFyYXRlIHBhdGNoIGFzDQo+IHdlbGwuDQoNCkkgbGlr ZSB0aGUgaWRlYSBvZiBlbWl0dGluZyBhIHNlcGFyYXRlIFdBUk5JTkcgZm9yIGVhY2ggZm9yIGNs YXJpdHkgb24NCndoYXQgb3BlcmF0aW9ucyBhcmUgYmVpbmcgc2tpcHBlZC4gIEhvd2V2ZXIsIEkg dGhpbmsgaXQgY291bGQgYmUgYSBiaXQNCmNvbmZ1c2luZyB3aXRoIHRoZSBjdXJyZW50IHdvcmRp bmcuICBQZXJoYXBzIHNvbWV0aGluZyBsaWtlICJza2lwcGluZw0KdmFjdXVtIG9mLi4uIiBhbmQg InNraXBwaW5nIGFuYWx5emUgb2YuLi4iIHdvdWxkIG1ha2UgdGhpbmdzIGNsZWFyZXIuDQpBbm90 aGVyIHRoaW5nIHRvIGtlZXAgaW4gbWluZCBpcyBob3cgb2Z0ZW4gb25seSBvbmUgb2YgdGhlc2Ug bWVzc2FnZXMNCndpbGwgYXBwbHkuICBJSVVDIHRoZSB2YXN0IG1ham9yaXR5IG9mIFZBQ1VVTSAo QU5BTFlaRSkgc3RhdGVtZW50cw0KdGhhdCBuZWVkIHRvIGVtaXQgc3VjaCBsb2cgc3RhdGVtZW50 cyB3b3VsZCBlbWl0IGJvdGguICBQbHVzLCB3aGlsZQ0KVkFDVVVNIChBTkFMWVpFKSBpcyBjbGVh cmx5IGRvY3VtZW50ZWQgYXMgcGVyZm9ybWluZyBib3RoIG9wZXJhdGlvbnMsDQpJIGNhbiBlYXNp bHkgc2VlIHRoZSBhcmd1bWVudCB0aGF0IHVzZXJzIG1heSB2aWV3IGl0IGFzIG9uZSBiaWcNCmNv bW1hbmQgYW5kIHRoYXQgZW1pdHRpbmcgbXVsdGlwbGUgbG9nIGVudHJpZXMgY291bGQgYmUgYSBj b25mdXNpbmcNCmNoYW5nZSBpbiBiZWhhdmlvci4NCg0KSW4gc2hvcnQsIG15IHZvdGUgd291bGQg YmUgdG8gbWFpbnRhaW4gdGhlIGN1cnJlbnQgYmVoYXZpb3IgZm9yIG5vdw0KYW5kIHRvIGJyaW5n IHVwIGFueSBsb2dnaW5nIGltcHJvdmVtZW50cyBzZXBhcmF0ZWx5Lg0KDQorICAgICAgIC8qDQor ICAgICAgICAqIERlcGVuZGluZyBvbiB0aGUgcGVybWlzc2lvbiBjaGVja3MgZG9uZSB3aGlsZSBi dWlsZGluZyB0aGUgbGlzdA0KKyAgICAgICAgKiBvZiByZWxhdGlvbnMgdG8gd29yayBvbiwgaXQg Y291bGQgYmUgcG9zc2libGUgdGhhdCB0aGUgbGlzdCBpcw0KKyAgICAgICAgKiBlbXB0eSwgaGVu Y2UgZG8gbm90aGluZyBpbiB0aGlzIGNhc2UuDQorICAgICAgICAqLw0KKyAgICAgICBpZiAocmVs YXRpb25zID09IE5JTCkNCisgICAgICAgICAgICAgICByZXR1cm47DQoNCkl0IG1pZ2h0IGJlIGJl dHRlciB0byBsZXQgdGhlIGNvbW1hbmQgZ28gdGhyb3VnaCBub3JtYWxseSBzbyB0aGF0IHdlDQpk b24ndCBtaXNzIGFueSBjbGVhbnVwIGF0IHRoZSBlbmQgKGUuZy4gZGVsZXRpbmcgdmFjX2NvbnRl eHQpLg0KDQorLyoNCisgKiBDaGVjayBpZiBhIGdpdmVuIHJlbGF0aW9uIGNhbiBiZSBzYWZlbHkg dmFjdXVtZWQgb3Igbm90LiAgSWYgdGhlDQorICogdXNlciBpcyBub3QgdGhlIHJlbGF0aW9uIG93 bmVyLCBpc3N1ZSBhIFdBUk5JTkcgbG9nIG1lc3NhZ2UgYW5kIHJldHVybg0KKyAqIGZhbHNlIHRv IGxldCB0aGUgY2FsbGVyIGRlY2lkZSB3aGF0IHRvIGRvIHdpdGggdGhpcyByZWxhdGlvbi4NCisg Ki8NCitib29sDQordmFjdXVtX2lzX3JlbGF0aW9uX293bmVyKE9pZCByZWxpZCwgRm9ybV9wZ19j bGFzcyByZWx0dXBsZSwgaW50IG9wdGlvbnMpDQorew0KKyAgICAgICBBc3NlcnQoKG9wdGlvbnMg JiAoVkFDT1BUX1ZBQ1VVTSB8IFZBQ09QVF9BTkFMWVpFKSkgIT0gMCk7DQorDQorICAgICAgIC8q DQorICAgICAgICAqIENoZWNrIHBlcm1pc3Npb25zLg0KKyAgICAgICAgKg0KKyAgICAgICAgKiBX ZSBhbGxvdyB0aGUgdXNlciB0byB2YWN1dW0gYSB0YWJsZSBpZiBoZSBpcyBzdXBlcnVzZXIsIHRo ZSB0YWJsZQ0KKyAgICAgICAgKiBvd25lciwgb3IgdGhlIGRhdGFiYXNlIG93bmVyIChidXQgaW4g dGhlIGxhdHRlciBjYXNlLCBvbmx5IGlmIGl0J3Mgbm90DQorICAgICAgICAqIGEgc2hhcmVkIHJl bGF0aW9uKS4gIHBnX2NsYXNzX293bmVyY2hlY2sgaW5jbHVkZXMgdGhlIHN1cGVydXNlciBjYXNl Lg0KKyAgICAgICAgKg0KKyAgICAgICAgKiBOb3RlIHdlIGNob29zZSB0byB0cmVhdCBwZXJtaXNz aW9ucyBmYWlsdXJlIGFzIGEgV0FSTklORyBhbmQga2VlcA0KKyAgICAgICAgKiB0cnlpbmcgdG8g dmFjdXVtIHRoZSByZXN0IG9mIHRoZSBEQiAtLS0gaXMgdGhpcyBhcHByb3ByaWF0ZT8NCisgICAg ICAgICovDQoNCkRvIHlvdSB0aGluayBpdCdzIHdvcnRoIGFkZGluZyBBTkFMWVpFIHRvIHRoZXNl IGNvbW1lbnRzIGFzIHdlbGw/DQoNCisgICAgICAgaWYgKCEocGdfY2xhc3Nfb3duZXJjaGVjayhy ZWxpZCwgR2V0VXNlcklkKCkpIHx8DQorICAgICAgICAgICAgICAgICAocGdfZGF0YWJhc2Vfb3du ZXJjaGVjayhNeURhdGFiYXNlSWQsIEdldFVzZXJJZCgpKSAmJiAhcmVsdHVwbGUtPnJlbGlzc2hh cmVkKSkpDQoNClJldHVybmluZyB0cnVlIHJpZ2h0IGF3YXkgd2hlbiB0aGUgcm9sZSBkb2VzIGhh dmUgcGVybWlzc2lvbnMgbWlnaHQgYmUNCmEgbmljZSB3YXkgdG8gc2F2ZSBhIGxldmVsIG9mIGlu ZGVudGF0aW9uLg0KDQorICAgICAgICAgICAgICAgLyoNCisgICAgICAgICAgICAgICAgKiBUbyBj aGVjayB3aGV0aGVyIHRoZSByZWxhdGlvbiBpcyBhIHBhcnRpdGlvbmVkIHRhYmxlIGFuZCBpdHMN CisgICAgICAgICAgICAgICAgKiBvd25lcnNoaXAsIGZldGNoIGl0cyBzeXNjYWNoZSBlbnRyeS4N CisgICAgICAgICAgICAgICAgKi8NCisgICAgICAgICAgICAgICB0dXBsZSA9IFNlYXJjaFN5c0Nh Y2hlMShSRUxPSUQsIE9iamVjdElkR2V0RGF0dW0ocmVsaWQpKTsNCisgICAgICAgICAgICAgICBp ZiAoIUhlYXBUdXBsZUlzVmFsaWQodHVwbGUpKQ0KKyAgICAgICAgICAgICAgICAgICAgICAgZWxv ZyhFUlJPUiwgImNhY2hlIGxvb2t1cCBmYWlsZWQgZm9yIHJlbGF0aW9uICV1IiwgcmVsaWQpOw0K KyAgICAgICAgICAgICAgIGNsYXNzRm9ybSA9IChGb3JtX3BnX2NsYXNzKSBHRVRTVFJVQ1QodHVw bGUpOw0KKw0KKyAgICAgICAgICAgICAgIC8qIGNoZWNrIHBlcm1pc3Npb25zIG9mIHJlbGF0aW9u ICovDQorICAgICAgICAgICAgICAgaWYgKCF2YWN1dW1faXNfcmVsYXRpb25fb3duZXIocmVsaWQs IGNsYXNzRm9ybSwgb3B0aW9ucykpDQorICAgICAgICAgICAgICAgew0KKyAgICAgICAgICAgICAg ICAgICAgICAgUmVsZWFzZVN5c0NhY2hlKHR1cGxlKTsNCisNCisgICAgICAgICAgICAgICAgICAg ICAgIC8qDQorICAgICAgICAgICAgICAgICAgICAgICAgKiBSZWxlYXNlIGxvY2sgYWdhaW4gd2l0 aCBBY2Nlc3NTaGFyZUxvY2sgLS0gc2VlIGJlbG93IGZvcg0KKyAgICAgICAgICAgICAgICAgICAg ICAgICogdGhlIHJlYXNvbiB3aHkgdGhpcyBsb2NrIGlzIHJlbGVhc2VkLg0KKyAgICAgICAgICAg ICAgICAgICAgICAgICovDQorICAgICAgICAgICAgICAgICAgICAgICBVbmxvY2tSZWxhdGlvbk9p ZChyZWxpZCwgQWNjZXNzU2hhcmVMb2NrKTsNCisgICAgICAgICAgICAgICAgICAgICAgIHJldHVy biB2YWNyZWxzOw0KKyAgICAgICAgICAgICAgIH0NCg0KSSB0aGluayB0aGlzIGFjdHVhbGx5IGNo YW5nZXMgdGhlIGJlaGF2aW9yIGZvciBwYXJ0aXRpb25lZCB0YWJsZXMuDQpQcmVzZW50bHksIHdl IHN0aWxsIGdvIHRocm91Z2ggYW5kIGNvbGxlY3QgYWxsIHRoZSBwYXJ0aXRpb25zIGluIHRoZQ0K dmFjcmVscyBsaXN0LiAgV2l0aCB0aGlzIGNoYW5nZSwgd2Ugd2lsbCBza2lwIGNvbGxlY3Rpbmcg YSB0YWJsZSdzDQpwYXJ0aXRpb25zIGlmIHRoZSBjdXJyZW50IHJvbGUgZG9lc24ndCBoYXZlIHRo ZSByZXF1aXJlZCBwZXJtaXNzaW9ucy4NClBlcmhhcHMgd2Ugc2hvdWxkIHNraXAgYWRkaW5nIHRo ZSBjdXJyZW50IHJlbGF0aW9uIHRvIHZhY3JlbHMgaWYNCnZhY3V1bV9pc19yZWxhdGlvbl9vd25l cigpIHJldHVybnMgZmFsc2UsIGFuZCB0aGVuIHdlIGNvdWxkIGdvIHRocm91Z2gNCnRoZSBwYXJ0 aXRpb25zIGFuZCBjaGVjayBwZXJtaXNzaW9ucyBvbiB0aG9zZSBhcyB3ZWxsLiAgU2luY2Ugd2Ug ZG9uJ3QNCnRha2UgYW55IGxvY2tzIG9uIHRoZSBpbmRpdmlkdWFsIHBhcnRpdGlvbnMgeWV0LCBn ZXR0aW5nIHRoZSByZWxhdGlvbg0KbmFtZSBhbmQgY2FsbGluZyBwZ19jbGFzc19vd25lcmNoZWNr KCkgc2FmZWx5IG1pZ2h0IGJlIHRyaWNreSwgdGhvdWdoLg0KDQpOYXRoYW4NCg0K