Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_CBC_SHA1:256) (Exim 4.89) (envelope-from ) id 1gS5Yj-0003Cj-Bg for pgsql-performance@arkaria.postgresql.org; Wed, 28 Nov 2018 19:31:41 +0000 Received: from localhost ([127.0.0.1] helo=malur.postgresql.org) by malur.postgresql.org with esmtp (Exim 4.89) (envelope-from ) id 1gS5Yh-0002kA-Kb for pgsql-performance@arkaria.postgresql.org; Wed, 28 Nov 2018 19:31:39 +0000 Received: from makus.postgresql.org ([2001:4800:3e1:1::229]) by malur.postgresql.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_CBC_SHA1:256) (Exim 4.89) (envelope-from ) id 1gS5Yh-0002k3-8X for pgsql-performance@lists.postgresql.org; Wed, 28 Nov 2018 19:31:39 +0000 Received: from us-smtp-1.mimecast.com ([207.211.31.81] helo=us-smtp-delivery-1.mimecast.com) by makus.postgresql.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_CBC_SHA1:256) (Exim 4.89) (envelope-from ) id 1gS5Yd-0001CW-Uu for pgsql-performance@lists.postgresql.org; Wed, 28 Nov 2018 19:31:37 +0000 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=motus.com; s=mimecast20180725; t=1543433494; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=0XSAOpvHsyxuMuFRtfVWaxj3slmnzkcvi6FOdrj0YJI=; b=SKZ7qwPAA66auz7/HvvBcHb0Xax+/62F/k7N8PHpWfuvU4ZaWJk7MNhZaVRaI2Mo0NYUmjV1xg99eY1TBHWB7k2b3AHrZxDslVuVoKgzzoxVPaKyQ3/vPOgWLbAT/j+Dk1nP85XFakFHvZEzJagPmBgdBtvoGLAhNztwlhTUSMk= Received: from NAM03-BY2-obe.outbound.protection.outlook.com (mail-by2nam03lp0056.outbound.protection.outlook.com [216.32.180.56]) (Using TLS) by relay.mimecast.com with ESMTP id us-mta-231-BBCZ1NyyORqt004m9KRhCQ-1; Wed, 28 Nov 2018 14:31:33 -0500 Received: from BN7PR02MB3985.namprd02.prod.outlook.com (52.132.222.158) by BN7PR02MB5329.namprd02.prod.outlook.com (20.176.176.219) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.1361.15; Wed, 28 Nov 2018 19:31:30 +0000 Received: from BN7PR02MB3985.namprd02.prod.outlook.com ([fe80::1095:dd0a:b64b:82fe]) by BN7PR02MB3985.namprd02.prod.outlook.com ([fe80::1095:dd0a:b64b:82fe%6]) with mapi id 15.20.1339.032; Wed, 28 Nov 2018 19:31:29 +0000 From: Scott Rankin To: Justin Pryzby CC: "pgsql-performance@lists.postgresql.org" , Eric Meaney Subject: Re: Slow Bitmap Index Scan Thread-Topic: Slow Bitmap Index Scan Thread-Index: AQHUh03NW7umFErj90mUKkYaMY370qVlj4OA//+v+4A= Date: Wed, 28 Nov 2018 19:31:29 +0000 Message-ID: References: <05111C93-69B4-4D5B-8AD3-8C9C47E0F01E@motus.com> <20181128191753.GM30707@telsasoft.com> In-Reply-To: <20181128191753.GM30707@telsasoft.com> Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-originating-ip: [45.56.169.252] x-ms-publictraffictype: Email x-microsoft-exchange-diagnostics: 1;BN7PR02MB5329;6:Z+MCLaHfgo1X5t463EnvGYjbAGNq/tDFO48aU92l5IYKKp81ZM3iUy56tF6r/+9OtDYzSYDIZ6sWZA5OoNvdPQ8HSyZF0ZaUPvyHBVt5g0TRUS3AMfUjHNiuqc1/DdQ38x3YBgfaD/R1x/vhs5gyGQwUYXox6a9w0qHfiOggbm11ggp+KJk7WTp7T95/IkmtikWalw+0LA3wujHDlCGAJAU44ZtiuNumFw6b9mhv2q57CbKJ7ac2XQ0KzGq15h/YxchTiZwhektFZk90Z8BwkJMmEGWKRSE6UdS9+ejxovPCkkb8uC8OIFUENcmDkHeaxc5noFv13r4fTd+gm7ziImqyMhssjcqeerkNJcH3aMncPpj7QIDQIWICYGmjV1O3x+IDdYf4y5ZZOfRaN1dDnK1p9sLc3DDzjOZHN+i8rT7MJaFpBxbKKsJFD83JoZd3lvC6g9OlffluvPu2pBeYsQ==;5:EO8E3ppD5ij+TRz4VolXpXEu9cOrN4hhBDEzWyAArlXHJdsb6FY1TP//lAjiCkH4bAS6Gz941Adr0+jyh+qcEUx1+twEN5v+uD4LHKawTNm2kqJiU9h9EH9XgRQeBNJFwzcuRI7C7Vo7J8WsnGsHSR4NWJzomssmb7USaB0BI+Y=;7:UCHA1URaR4nUpTy4JlE/rmGDmmMF6M01osGe2A1pdb7uo3EyGsJ9MBaNB2sOYlRBdaakJK2/5B2kN1JqzR/MnWYfdjgX47IBMiITqHuGCYeun8rEIUkD8YlWpQlHF3MGBTndeqCXWTW46RzeUXvi4Q== x-ms-exchange-antispam-srfa-diagnostics: SOS;SOR; x-ms-office365-filtering-correlation-id: af0bd9f0-19c8-4047-050f-08d6556818bc x-microsoft-antispam: BCL:0;PCL:0;RULEID:(2390098)(7020095)(4652040)(8989299)(4534185)(4627221)(201703031133081)(201702281549075)(8990200)(5600074)(711020)(2017052603328)(7153060)(7193020);SRVR:BN7PR02MB5329; x-ms-traffictypediagnostic: BN7PR02MB5329: x-microsoft-antispam-prvs: x-ms-exchange-senderadcheck: 1 x-exchange-antispam-report-cfa-test: BCL:0;PCL:0;RULEID:(8211001083)(6040522)(2401047)(8121501046)(5005006)(3231443)(999002)(944501410)(52105112)(10201501046)(3002001)(93006095)(93001095)(148016)(149066)(150057)(6041310)(20161123564045)(201703131423095)(201702281528075)(20161123555045)(201703061421075)(201703061406153)(20161123558120)(20161123562045)(20161123560045)(201708071742011)(7699051)(76991095);SRVR:BN7PR02MB5329;BCL:0;PCL:0;RULEID:;SRVR:BN7PR02MB5329; x-forefront-prvs: 0870212862 x-forefront-antispam-report: SFV:NSPM;SFS:(10009020)(376002)(136003)(366004)(396003)(39850400004)(346002)(189003)(199004)(6916009)(6246003)(68736007)(5660300001)(478600001)(8936002)(6116002)(26005)(256004)(82746002)(6506007)(54906003)(71190400001)(25786009)(71200400001)(6436002)(8676002)(107886003)(446003)(53546011)(33656002)(78486014)(229853002)(551934003)(3846002)(486006)(305945005)(11346002)(66066001)(14444005)(14454004)(81156014)(83716004)(86362001)(81166006)(476003)(7736002)(99286004)(102836004)(4326008)(2616005)(97736004)(2906002)(6306002)(6512007)(966005)(36756003)(186003)(53936002)(76176011)(6486002)(106356001)(316002)(3480700005)(105586002);DIR:OUT;SFP:1101;SCL:1;SRVR:BN7PR02MB5329;H:BN7PR02MB3985.namprd02.prod.outlook.com;FPR:;SPF:None;LANG:en;PTR:InfoNoRecords;MX:1;A:1; x-microsoft-antispam-message-info: NN3kZgyyQDHnscPuRi2mSE6iAYd3LLHq+DcmgqbUGbaLgg5HLkRZ0ihbDvVCDPZjy+Ln/kqFLx6AEqwzOftEJqUd/c09V6Gq75Y6FwRkgO1e9LZfF8nnoyb3OklRSuXU+4K+x/B4v//MFURyKdoImmi8AMn51+i4gDQZybrb6sOfbsmqbclOLjS1nncdHntgh+gtsIPJ8PKdGT864zekUKdXxzhvMDdFVWF50zNy7I7DD/sBTR7jA+0++fr4aWKi88PE2JgKd3Hm1aimWVvcAfdxEHQ2KJWxlah99ELDv9y6r8Fa1SBQGjS4KGE3vu2VDuUom/W9m1Ukd3xs8EXqAf7cghCeD+hlMfGakxEZ6FI= spamdiagnosticoutput: 1:99 spamdiagnosticmetadata: NSPM Content-ID: MIME-Version: 1.0 X-OriginatorOrg: motus.com X-MS-Exchange-CrossTenant-Network-Message-Id: af0bd9f0-19c8-4047-050f-08d6556818bc X-MS-Exchange-CrossTenant-originalarrivaltime: 28 Nov 2018 19:31:29.7807 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: 849c4293-31ae-4825-a834-b8bb5ab65c28 X-MS-Exchange-Transport-CrossTenantHeadersStamped: BN7PR02MB5329 X-MC-Unique: BBCZ1NyyORqt004m9KRhCQ-1 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: base64 List-Id: List-Help: List-Subscribe: List-Post: List-Owner: List-Archive: Precedence: bulk DQpPbiAxMS8yOC8xOCwgMjoxOCBQTSwgIkp1c3RpbiBQcnl6YnkiIDxwcnl6YnlAdGVsc2Fzb2Z0 LmNvbT4gd3JvdGU6DQoNCiAgICBPbiBXZWQsIE5vdiAyOCwgMjAxOCBhdCAwNzowODo1M1BNICsw MDAwLCBTY290dCBSYW5raW4gd3JvdGU6DQogICAgPiBXZSByZWNlbnRseSBtb3ZlZCBvdXIgcHJv ZHVjdGlvbiBkYXRhYmFzZSBzeXN0ZW1zIGZyb20gYSA5LjQgcnVubmluZyBvbiBhIHNlbGYtbWFu YWdlZCBFQzIgaW5zdGFuY2UgdG8gOS42LjEwIG9uIEFtYXpvbuKAmXMgQVdTIChzYW1lIFJBTSwg Q1BVKS4gIEFmdGVyIHRoZSBtb3ZlLCB3ZeKAmXJlIGZpbmRpbmcgdGhhdCBjZXJ0YWluIHF1ZXJp ZXMgdGhhdCB3ZSBydW4gYWdhaW5zdCBhIEdJTiBmdWxsLXRleHQgaW5kZXggaGF2ZSBzb21lIG9j Y2FzaW9uYWxseSB2ZXJ5IHNsb3cgZXhlY3V0aW9ucyBhbmQgSeKAmW0gc3RydWdnbGluZyB0byBm aWd1cmUgb3V0IHdoYXQgdG8gZG8gYWJvdXQgaXQuICAgSSB3b3VsZCBiZSB2ZXJ5IGdyYXRlZnVs IGZvciBhbnkgaWRlYXMhDQogICAgPg0KICAgID4gVGhlIHNldHVwIHdlIGhhdmUgaXMgYSAzMi1j b3JlLCAyNDQgR0IgUkFNIHByaW1hcnkgd2l0aCBhIHNhbWUtc2l6ZWQgcmVhZCByZXBsaWNhLiAg VGhlIHF1ZXJpZXMgYXJlIHJ1bm5pbmcgb2ZmIHRoZSByZXBsaWNhLCBidXQgcGVyZm9ybWFuY2Ug aXMgcm91Z2hseSB0aGUgc2FtZSBiZXR3ZWVuIHRoZSBtYXN0ZXIgYW5kIHRoZSByZXBsaWNhLg0K ICAgID4NCiAgICA+IEhlcmXigJlzIGEgcXVlcnkgdGhhdOKAmXMgcGVyZm9ybWluZyBiYWRseToN Cg0KICAgIENhbiB5b3UgY29tcGFyZSBvciBzaG93IHRoZSBleHBsYWluKGFuYWx5emUsYnVmZmVy cykgZm9yIGEgZmFzdCBxdWVyeSBpbnN0YW5jZQ0KICAgIHZzIHNsb3cgcXVlcnkgaW5zdGFuY2Ug PyAgSXMgaXQgc2xvd2VyIGR1ZSB0byBpbmRleCBhY2Nlc3Mgb3IgaGVhcD8gIER1ZSB0bw0KICAg IGNhY2hlIG1pc3NlcyA/DQoNCklmIEkgcmVkdWNlIHRoZSBudW1iZXIgb2Ygc2VhcmNoIHRlcm1z IGluICwgSSBnZXQgdGhpczoNCg0KU0VMRUNUIGxzLmxvY2F0aW9uIEFTIGxvY2F0aW9uSWQgICBG Uk9NIGxvY2F0aW9uX3NlYXJjaCBscyAgV0hFUkUgbHMuY2xpZW50ID0gODMgIEFORCBzZWFyY2hf ZmllbGRfdHN2ZWN0b3IgQEAgdG9fdHNxdWVyeSgnOTAwMDoqJzo6dGV4dCkgIEFORCBscy5mYXZv cml0ZSA9IFRSVUUgIExJTUlUIDEwMA0KDQpMaW1pdCAgKGNvc3Q9MTMyMDMuOTkuLjEzNjI3LjQw IHJvd3M9MTAwIHdpZHRoPTgpIChhY3R1YWwgdGltZT02Ni41NjguLjY2Ljc1OSByb3dzPTEwMCBs b29wcz0xKQ0KICBCdWZmZXJzOiBzaGFyZWQgaGl0PTE5NzUNCiAgLT4gIEJpdG1hcCBIZWFwIFNj YW4gb24gbG9jYXRpb25fc2VhcmNoIGxzICAoY29zdD0xMzIwMy45OS4uMTM5MjMuNzkgcm93cz0x NzAgd2lkdGg9OCkgKGFjdHVhbCB0aW1lPTY2LjU2OC4uNjYuNzI5IHJvd3M9MTAwIGxvb3BzPTEp DQogICAgICAgIFJlY2hlY2sgQ29uZDogKChzZWFyY2hfZmllbGRfdHN2ZWN0b3IgQEAgdG9fdHNx dWVyeSgnOTAwMDoqJzo6dGV4dCkpIEFORCAoY2xpZW50ID0gODMpKQ0KICAgICAgICBGaWx0ZXI6 IGZhdm9yaXRlDQogICAgICAgIEhlYXAgQmxvY2tzOiBleGFjdD04Ng0KICAgICAgICBCdWZmZXJz OiBzaGFyZWQgaGl0PTE5NzUNCiAgICAgICAgLT4gIEJpdG1hcEFuZCAgKGNvc3Q9MTMyMDMuOTku LjEzMjAzLjk5IHJvd3M9MTcwIHdpZHRoPTApIChhY3R1YWwgdGltZT02Ni40NzEuLjY2LjQ3MiBy b3dzPTAgbG9vcHM9MSkNCiAgICAgICAgICAgICAgQnVmZmVyczogc2hhcmVkIGhpdD0xODg5DQog ICAgICAgICAgICAgIC0+ICBCaXRtYXAgSW5kZXggU2NhbiBvbiBsb2NhdGlvbl9zZWFyY2hfdHN2 ZWN0b3JfaWR4ICAoY29zdD0wLjAwLi4yMjM1LjAyIHJvd3M9MTE1NzAgd2lkdGg9MCkgKGFjdHVh bCB0aW1lPTIwLjYwMy4uMjAuNjA0IHJvd3M9MjkxNTUgbG9vcHM9MSkNCiAgICAgICAgICAgICAg ICAgICAgSW5kZXggQ29uZDogKHNlYXJjaF9maWVsZF90c3ZlY3RvciBAQCB0b190c3F1ZXJ5KCc5 MDAwOionOjp0ZXh0KSkNCiAgICAgICAgICAgICAgICAgICAgQnVmZmVyczogc2hhcmVkIGhpdD01 NDYNCiAgICAgICAgICAgICAgLT4gIEJpdG1hcCBJbmRleCBTY2FuIG9uIGxvY2F0aW9uX3NlYXJj aF9jbGllbnRfaWR4ICAoY29zdD0wLjAwLi4xMDk2OC42MyByb3dzPTQ0MjY3NiB3aWR0aD0wKSAo YWN0dWFsIHRpbWU9NDAuNjgyLi40MC42ODIgcm93cz00ODI0MTUgbG9vcHM9MSkNCiAgICAgICAg ICAgICAgICAgICAgSW5kZXggQ29uZDogKGNsaWVudCA9IDgzKQ0KICAgICAgICAgICAgICAgICAg ICBCdWZmZXJzOiBzaGFyZWQgaGl0PTEzNDMNClBsYW5uaW5nIHRpbWU6IDAuMTgxIG1zDQpFeGVj dXRpb24gdGltZTogNjYuODA2IG1zDQoNCkkgc2VlIGFsbW9zdCBubyBJTyByZWFkcywgYW5kIHBn X3N0YXRfc3RhdGVtZW50cyBzaG93cyBubyBjYWNoZSBtaXNzZXMuDQoNCiAgICBBbHNvLCB5b3Ug aGF2ZSBiaWcgcmFtIC0gaGF2ZSB5b3UgdHJpZWQgZGlzYWJsaW5nIEtTTSBvciBUSFAgPw0KICAg IGh0dHBzOi8vd3d3LnBvc3RncmVzcWwub3JnL21lc3NhZ2UtaWQvMjAxNzA3MTgxODAxNTIuR0Ux NzU2NiU0MHRlbHNhc29mdC5jb20NCg0KU2luY2UgdGhpcyBpcyBBbWF6b24gUkRTLCB3ZSBkb24n dCBoYXZlIGFueSBjb250cm9sIG92ZXIgb3IgYWNjZXNzIHRvIHRoZSB1bmRlcmx5aW5nIE9TLiAg SSBrbm93IHRoYXQgaHVnZV9wYWdlIHN1cHBvcnQgaXMgb24gZm9yIHRoZXNlIGluc3RhbmNlcy4g IEkgd291bGQgaG9wZSB0aGF0IEFtYXpvbidzIGFscmVhZHkgZG9uZSB0aGF0Li4uDQoNCiAgICBK dXN0aW4NCg0KDQoNClRoaXMgZW1haWwgbWVzc2FnZSBjb250YWlucyBpbmZvcm1hdGlvbiB0aGF0 IE1vdHVzLCBMTEMgY29uc2lkZXJzIGNvbmZpZGVudGlhbCBhbmQvb3IgcHJvcHJpZXRhcnksIG9y IG1heSBsYXRlciBkZXNpZ25hdGUgYXMgY29uZmlkZW50aWFsIGFuZCBwcm9wcmlldGFyeS4gSXQg aXMgaW50ZW5kZWQgb25seSBmb3IgdXNlIG9mIHRoZSBpbmRpdmlkdWFsIG9yIGVudGl0eSBuYW1l ZCBhYm92ZSBhbmQgc2hvdWxkIG5vdCBiZSBmb3J3YXJkZWQgdG8gYW55IG90aGVyIHBlcnNvbnMg b3IgZW50aXRpZXMgd2l0aG91dCB0aGUgZXhwcmVzcyBjb25zZW50IG9mIE1vdHVzLCBMTEMsIG5v ciBzaG91bGQgaXQgYmUgdXNlZCBmb3IgYW55IHB1cnBvc2Ugb3RoZXIgdGhhbiBpbiB0aGUgY291 cnNlIG9mIGFueSBwb3RlbnRpYWwgb3IgYWN0dWFsIGJ1c2luZXNzIHJlbGF0aW9uc2hpcCB3aXRo IE1vdHVzLCBMTEMuIElmIHRoZSByZWFkZXIgb2YgdGhpcyBtZXNzYWdlIGlzIG5vdCB0aGUgaW50 ZW5kZWQgcmVjaXBpZW50LCBvciB0aGUgZW1wbG95ZWUgb3IgYWdlbnQgcmVzcG9uc2libGUgdG8g ZGVsaXZlciBpdCB0byB0aGUgaW50ZW5kZWQgcmVjaXBpZW50LCB5b3UgYXJlIGhlcmVieSBub3Rp ZmllZCB0aGF0IGFueSBkaXNzZW1pbmF0aW9uLCBkaXN0cmlidXRpb24sIG9yIGNvcHlpbmcgb2Yg dGhpcyBjb21tdW5pY2F0aW9uIGlzIHN0cmljdGx5IHByb2hpYml0ZWQuIElmIHlvdSBoYXZlIHJl Y2VpdmVkIHRoaXMgY29tbXVuaWNhdGlvbiBpbiBlcnJvciwgcGxlYXNlIG5vdGlmeSBzZW5kZXIg aW1tZWRpYXRlbHkgYW5kIGRlc3Ryb3kgdGhlIG9yaWdpbmFsIG1lc3NhZ2UuDQoNCkludGVybmFs IFJldmVudWUgU2VydmljZSByZWd1bGF0aW9ucyByZXF1aXJlIHRoYXQgY2VydGFpbiB0eXBlcyBv ZiB3cml0dGVuIGFkdmljZSBpbmNsdWRlIGEgZGlzY2xhaW1lci4gVG8gdGhlIGV4dGVudCB0aGUg cHJlY2VkaW5nIG1lc3NhZ2UgY29udGFpbnMgYWR2aWNlIHJlbGF0aW5nIHRvIGEgRmVkZXJhbCB0 YXggaXNzdWUsIHVubGVzcyBleHByZXNzbHkgc3RhdGVkIG90aGVyd2lzZSB0aGUgYWR2aWNlIGlz IG5vdCBpbnRlbmRlZCBvciB3cml0dGVuIHRvIGJlIHVzZWQsIGFuZCBpdCBjYW5ub3QgYmUgdXNl ZCBieSB0aGUgcmVjaXBpZW50IG9yIGFueSBvdGhlciB0YXhwYXllciwgZm9yIHRoZSBwdXJwb3Nl IG9mIGF2b2lkaW5nIEZlZGVyYWwgdGF4IHBlbmFsdGllcywgYW5kIHdhcyBub3Qgd3JpdHRlbiB0 byBzdXBwb3J0IHRoZSBwcm9tb3Rpb24gb3IgbWFya2V0aW5nIG9mIGFueSB0cmFuc2FjdGlvbiBv ciBtYXR0ZXIgZGlzY3Vzc2VkIGhlcmVpbi4NCg==