Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtp (Exim 4.84_2) (envelope-from ) id 1b0Lw4-0007sy-M6 for pgsql-hackers@arkaria.postgresql.org; Wed, 11 May 2016 04:39:48 +0000 Received: from localhost ([127.0.0.1] helo=postgresql.org) by malur.postgresql.org with smtp (Exim 4.84_2) (envelope-from ) id 1b0Lw4-0005WR-5K for pgsql-hackers@arkaria.postgresql.org; Wed, 11 May 2016 04:39:48 +0000 Received: from magus.postgresql.org ([2a02:c0:301:0:ffff::29]) by malur.postgresql.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_CBC_SHA384:256) (Exim 4.84_2) (envelope-from ) id 1b0Luc-0003vJ-R7 for pgsql-hackers@postgresql.org; Wed, 11 May 2016 04:38:19 +0000 Received: from mail-bl2on0089.outbound.protection.outlook.com ([65.55.169.89] helo=na01-bl2-obe.outbound.protection.outlook.com) by magus.postgresql.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_CBC_SHA384:256) (Exim 4.84_2) (envelope-from ) id 1b0LuY-0004UE-9t for pgsql-hackers@postgresql.org; Wed, 11 May 2016 04:38:18 +0000 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=BlueTreble.onmicrosoft.com; s=selector1-bluetreble-com; h=From:To:Date:Subject:Message-ID:Content-Type:MIME-Version; bh=41a8mK1CeK8g7pz1Z8L0/qkhHWvIVWxqiKfPMcpcgGw=; b=Y6t+yNg2vc2rnkKVHkpunv6TQ21xLBDHf31VksVWdr12MIG/6ndnDj67dHL9xT1pF+S8O4z3lPgWSuTz6Ncp2vAT+j+OLGAd7OykibMezOvlhfm3CllYeNgvy2kDeknLc1FFJvMNelnxPWgR1or6VQB0dT7U4v3q/twoDsbWXdo= Authentication-Results: postgresql.org; dkim=none (message not signed) header.d=none;postgresql.org; dmarc=none action=none header.from=BlueTreble.com; Received: from decina.attlocal.net (108.232.179.70) by BLUPR11MB0673.namprd11.prod.outlook.com (10.163.216.143) with Microsoft SMTP Server (TLS) id 15.1.492.11; Wed, 11 May 2016 04:38:09 +0000 Subject: Re: Reviewing freeze map code To: Andres Freund , Josh berkus References: <20160506205824.ysst7mk3k26ztok2@alap3.anarazel.de> <572D062E.5030308@agliodbs.com> <572D068F.3050608@commandprompt.com> <20160506210806.f6pnk6ueirjqrlmu@alap3.anarazel.de> <572D082C.3050704@agliodbs.com> <20160506211254.4rknrxpjzav7f66r@alap3.anarazel.de> <572D0983.6030109@agliodbs.com> <20160506212016.p57itx2ivjrvb4eu@alap3.anarazel.de> CC: "Joshua D. Drake" , Robert Haas , Masahiko Sawada , "pgsql-hackers@postgresql.org" From: Jim Nasby Message-ID: Date: Tue, 10 May 2016 23:38:01 -0500 User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.11; rv:45.0) Gecko/20100101 Thunderbird/45.0 MIME-Version: 1.0 In-Reply-To: <20160506212016.p57itx2ivjrvb4eu@alap3.anarazel.de> Content-Type: text/plain; charset="windows-1252"; format=flowed Content-Transfer-Encoding: 7bit X-Originating-IP: [108.232.179.70] X-ClientProxiedBy: CY1PR19CA0037.namprd19.prod.outlook.com (10.162.38.175) To BLUPR11MB0673.namprd11.prod.outlook.com (10.163.216.143) X-MS-Office365-Filtering-Correlation-Id: 5b3c43ec-0cd6-4e67-5151-08d379560e2b X-Microsoft-Exchange-Diagnostics: 1;BLUPR11MB0673;2:xlVthcAfUHmW+maDdu4SIvZc1NkpIRyBliEAv/P5VEiUz2nSVlOyBcsQNmzFtYeTmtbzgTMMhZxxIxh3ph+vHJFeTY4VGrZiejeYgDf5qu00TBKh7jHpx0gce38ljd8b5YCzX9PpQP8eIp4LxeTKYkj/GHA+9ZRQGF05JEjaJhpRz+8PYdKCGWeJAbQjBY6C;3:6H4eanx8U0MZ3VxeYCV1Ak4FBfHTAoHL+TIp3x4cv7zJ6eEyMl9OyUQgayPdjiHnekTvDJlio2/QvwhIxjJrupFwbbGVeGcDwMxLIMPc1f++bNXQ199HLyBTMFqckEBS X-Microsoft-Antispam: UriScan:;BCL:0;PCL:0;RULEID:;SRVR:BLUPR11MB0673; X-Microsoft-Exchange-Diagnostics: 1;BLUPR11MB0673;25:He5/UvX9Q0v18NvOoatoK9hCw1FjA7HxiJqHnKDzPCHzirmhoiOUx7ge4zXFiH/O6vkOWfV0a4+b/OLi/j2E+0wdveybhf0lkqNkV3Iq8zHSpTFv+CtREvy7aVNmy1FgA+JQ7LzI7uSudU9gFQfbpDkxT3eehHKLuQWxYCrYXxeaBNchCqHHbwL0Rt1d7WRoLiEOo5HxEXV+BVFDRQJj7swJ3xfb6IFnTPVhc9EJfe8i4raN22lSAFbjVmiEN7cpaOMqxf9kKspsleH3lb1POJ9i8QZ1eugzcPj1JLYXL/dNdOprXl4SqPnw5VG1WV1H9cwgnHI0fLSXkJHUnQhAchLSQ1Fyg6oEDxOu8AkRhDHUxgQwMXH8tRxCvR++5/l7E/xhDpYDQn1rEkdotcH5gQFf6FKQ2w2YuGN6ocl5zRP3j5ahFI+jzP6E0j6YVDRrws1BkFhKI83E2CwpCEKDn6Gc5bFFoyDX34tGw30EqAKxh6NPD9MgABW94qteNCu9K2MGz1jNm/6ko239d5Bh8EgX0pd8vJXir4qdZgcmYGmfBJ7PGZxnI9YUudS8K/Tc3BUj7XtkOOwbY4lwlc2O1xN8LvXC9Q8QAFF7MSVdvonetbB/ogT9a+RvBdhpa3O2iDBxmgxG/+eeDtw980f5pb4R77hXYkKr87qew6oSmARRJQf0Ii9DM2SNQ5JTD3h1z1nQSayBqkNxUQRo3dCPLDkSsHcSvhYu5OrIR7UrZXfWftAo2oxAGxb67rusHqF9VN80oKznv+Pinivrnxz0jdfeJeVMQ6bxBJwSeIr21qZFTLPrF7qEmjvn7KZZ4QR/jC+lO9TTjWfCFJHeQAHb36LWEKiVVQ175F5ZW+k3/10= X-Microsoft-Antispam-PRVS: X-Exchange-Antispam-Report-Test: UriScan:; X-Exchange-Antispam-Report-CFA-Test: BCL:0;PCL:0;RULEID:(6040130)(601004)(2401047)(8121501046)(5005006)(10201501046)(3002001)(6041072)(6043046);SRVR:BLUPR11MB0673;BCL:0;PCL:0;RULEID:;SRVR:BLUPR11MB0673; X-Microsoft-Exchange-Diagnostics: 1;BLUPR11MB0673;4:iZUJcb4zBXUBXshY1rwh15E6RLNFkjLe5i8LKfvWaYHsNT9v9GUYx/+RRpAkbuFMWDPvsKMPcXjYVWbVqeGRdcByuuKjAuYDW3oUsE43hAOLvR2ni6y7em7FobROCyG4bQKZD8AvTcPseu11lngDL3UegnFcEkUBCwVkg3D3Ljr4bObeswC2Oj4T2rewpBp+8/41f1lJn+wsKXAdhs+EXk5qvWSTNCqxbcpP1lr//PPj9un46S7f5fltEgWd+L4rE7Of43h3dt1zjxMRBwfptjbQ3SW5ENrTFUlSKnYVdnfpunjEWV9Jvqh7bWQUS2TOvi0+pX3RvZr5r3CJrt0ckcH8yPgLRs8ofms085oxbcsACFAngzkyfqcehqMo8gz0FpDYzfFTdmDnNpHZzqaGZeXOOLL10fZq1zqmL6d1eEA= X-Forefront-PRVS: 0939529DE2 X-Forefront-Antispam-Report: SFV:NSPM;SFS:(10009020)(4630300001)(979002)(6009001)(24454002)(377454003)(377424004)(83506001)(65956001)(66066001)(15975445007)(65806001)(19580395003)(31686004)(53416004)(47776003)(50466002)(230700001)(586003)(2950100001)(16601075003)(81166006)(2906002)(42186005)(92566002)(4326007)(54356999)(76176999)(5004730100002)(50986999)(36756003)(6116002)(3846002)(5008740100001)(33646002)(4001350100001)(97736004)(64126003)(77096005)(23746002)(5001770100001)(189998001)(93886004)(31696002)(86362001)(65826006)(85282002)(969003)(989001)(999001)(1009001)(1019001);DIR:OUT;SFP:1101;SCL:1;SRVR:BLUPR11MB0673;H:decina.attlocal.net;FPR:;SPF:None;MLV:ovrnspm;PTR:InfoNoRecords;LANG:en; X-Microsoft-Exchange-Diagnostics: =?Windows-1252?Q?1;BLUPR11MB0673;23:Z3L7dYxTaCD0xi7IU8MO9tXrceXm28NHAri7p?= =?Windows-1252?Q?nBB9tMizn8+IN9Tei+Ferk7gr+b9GaUq1oNdZj1nAtDfXmek9OlpBsc8?= =?Windows-1252?Q?rbGeAH7yEYuh5wS9swJzURuCY5P3fxbVK758z9vkYtRZTn9tygeOmHS5?= =?Windows-1252?Q?L6zvUCt+Lyk0y/gGGcZRLu7cmhLlDzjSkpDZgBbB7D/BbhY7tOHuotAd?= =?Windows-1252?Q?KAr/SaBpzQAx66zJQ5bQLHcPFIRz/SVWW8991wm1vSVWoOxwTfWoGlDk?= =?Windows-1252?Q?m/lOqu15NosFuVYSZCukkCwxoS1M3RVSMF7iEK78+qKe8XBK+2JIxD/X?= =?Windows-1252?Q?tV5b2kUzAfY8g/r2x6lZWOc8Stgx4dvvWG++cCnBYkIgAwSl5pahfcV/?= =?Windows-1252?Q?LSoXt++g37/rRfO4IIJV5cCGJ7owK4O96LuiNLCbJJ0Lxv9gFBFqqqT5?= =?Windows-1252?Q?ZAeYu5i0DkUZs5jfGlZHABYeJY/SbbiaY378AJsr8qIoZdjlvpnE4Sc9?= =?Windows-1252?Q?rkY/JgmGaT+cn3SZDVWRyFTQkkB20LIF/Jkijgf+rkgrKp9rTM0840Sb?= =?Windows-1252?Q?rz/5CuzzhT463yAUjcG/kfqRt8f3Y98kKFJO5j5A8nAo38rBX1anUVUN?= =?Windows-1252?Q?3vRTq5yrDvvvxrIqhvTZnhOpOC7ZXDfZEvtzDbRKNwqXTQkUTwRL5qd6?= =?Windows-1252?Q?0qBu+nUxagRCoa8s0TyxvusfvkhfkZYiDmHhp/3UbIiRXKuMXzGoudpE?= =?Windows-1252?Q?dYO5i4ZNuOKeTWavw+lXE3o40aFnSnWSUTSoyIs6xgDOpp18Zh9czVBl?= =?Windows-1252?Q?Tb6nzoShQgkhDkw4FAhmrv7SfALd9MOcqtaEkewSooR1Q+SzcSKCcaf8?= =?Windows-1252?Q?xnjWSOjtXKDP+kj0tPHX+l3o8jQGWL7d+EkTaRR/PUF8o7Awj05zBIFQ?= =?Windows-1252?Q?z8YXEvr+C3dnE9/A4KEcbDlejUJ4bb4OfJsp7mkDCgsOsq8sD5kXWP5F?= =?Windows-1252?Q?XxT7wTcdj6i+m1SrEGMcuWl/bwgJy3pKS8FJz8ZDS/MP4j33vAXf3Fs8?= =?Windows-1252?Q?N08T1K45Lvi+FquJjtI8h4t8IU19dtEFUSuLVUdLGMdLLiGWf2bBZdc1?= =?Windows-1252?Q?FQAOB9394FmB6YpK2HRigeiz/ebAFm6bJ5rOjOf9D6LSt20T3qvLPxuF?= =?Windows-1252?Q?DwoKQY/ijm/5iWRxX6k1ZnLvYiiM8uKIJHwj+YHdCZSnRmlDaAa2sT6G?= =?Windows-1252?Q?8ruBi6dUAVdIS26DJ0fX1NvHCsULgUdEwIl/tQ/oPyhZ707dzj/GxpSn?= =?Windows-1252?Q?qexiBxgHEkVjDqw3WS4/kAlIXl0MB/2muGUcjht3xUFIuiBsiH/NBrCD?= =?Windows-1252?Q?AVR9v6FVpc8Yg/+NC58BhpGhElvoUq1Tg=3D=3D?= X-Microsoft-Exchange-Diagnostics: 1;BLUPR11MB0673;5:3rFN72k5ZlDGiuyqN7ojpYyrNkKIR3He/UwmYc0fDVkU7GZNr9v8MSizeWgxxXB38MkAyaiSwXKUW9yMT8dW9LFIP0BbH7vuS2/5AZ/lNsqcNR+2PfDllhP2HDftTHn5IlFiqHeYwiyAP8Mprx2y5Q==;24:dpea7Kumr5vxfqNzXjZLnkfJCMgX7lkXwKXf9cAd/u1PtuvVfV7ZwQdO8dX6DBSo3rcpbOoevpXBnzqzR0dHz8sr2ncUBZwuLCDrVO2Yznc=;7:OII22zWbvE+dFhwgJXkIUarZuLGh0gyMaQGr7SbCJnfrHS7rpXeTgECYAiw/Nbmeq3VnBxO77Sm/BjYKxKKwFIP4SoZiucSNBqXRRCe7ai9fZJpbGboi3P7THQ2G/tUMeF0Spp+V9KA4AfAznQvc5EGeoC+6aapDQBYVZg2vLESRfHCQkIt9K8JbpTr0KDDB SpamDiagnosticOutput: 1:23 SpamDiagnosticMetadata: NSPM X-OriginatorOrg: bluetreble.com X-MS-Exchange-CrossTenant-OriginalArrivalTime: 11 May 2016 04:38:09.2177 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-Transport-CrossTenantHeadersStamped: BLUPR11MB0673 X-Pg-Spam-Score: -1.9 (-) List-Archive: List-Help: List-ID: List-Owner: List-Post: List-Subscribe: List-Unsubscribe: X-Mailing-List: pgsql-hackers Precedence: bulk Sender: pgsql-hackers-owner@postgresql.org On 5/6/16 4:20 PM, Andres Freund wrote: > On 2016-05-06 14:15:47 -0700, Josh berkus wrote: >> For the serious testing, does anyone have a good technique for creating >> loads which would stress-test vacuum freezing? It's hard for me to come >> up with anything which wouldn't be very time-and-resource intensive >> (like running at 10,000 TPS for a week). > > I've changed the limits for freezing options a while back, so you can > now set autovacuum_freeze_max as low as 100000 (best set > vacuum_freeze_table_age accordingly). You'll have to come up with a > workload that doesn't overwrite all data continuously (otherwise > there'll never be old rows), but otherwise it should now be fairly easy > to test that kind of scenario. There's also been a tool for forcibly advancing XID floating around for quite some time. Using that could have the added benefit of verifying anti-wrap still works correctly. (Might be worth testing mxid wrap too...) -- Jim Nasby, Data Architect, Blue Treble Consulting, Austin TX Experts in Analytics, Data Architecture and PostgreSQL Data in Trouble? Get it in Treble! http://BlueTreble.com 855-TREBLE2 (855-873-2532) mobile: 512-569-9461 -- Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-hackers