X-Original-To: pgsql-performance-postgresql.org@localhost.postgresql.org Received: from localhost (unknown [64.117.224.130]) by svr1.postgresql.org (Postfix) with ESMTP id 26D48D1B960 for ; Fri, 5 Sep 2003 20:02:09 +0000 (GMT) Received: from svr1.postgresql.org ([64.117.224.193]) by localhost (neptune.hub.org [64.117.224.130]) (amavisd-new, port 10024) with ESMTP id 15734-06 for ; Fri, 5 Sep 2003 17:01:57 -0300 (ADT) Received: from sss.pgh.pa.us (unknown [192.204.191.242]) by svr1.postgresql.org (Postfix) with ESMTP id 0CA9BD1EC75 for ; Fri, 5 Sep 2003 15:38:21 -0300 (ADT) Received: from sss2.sss.pgh.pa.us (tgl@localhost [127.0.0.1]) by sss.pgh.pa.us (8.12.9/8.12.9) with ESMTP id h85IcFAn007127; Fri, 5 Sep 2003 14:38:15 -0400 (EDT) To: Mary Edie Meredith Cc: pgsql-performance , osdldbt-general Subject: Re: [GENERAL] how to get accurate values in pg_statistic (continued) In-reply-to: <1062783865.6854.4780.camel@ibm-e.pdx.osdl.net> References: <1062697270.6854.3475.camel@ibm-e.pdx.osdl.net> <11537.1062717375@sss.pgh.pa.us> <1062783865.6854.4780.camel@ibm-e.pdx.osdl.net> Comments: In-reply-to Mary Edie Meredith message dated "05 Sep 2003 10:44:25 -0700" Date: Fri, 05 Sep 2003 14:38:15 -0400 Message-ID: <7126.1062787095@sss.pgh.pa.us> From: Tom Lane X-Virus-Scanned: by amavisd-new at postgresql.org X-Archive-Number: 200309/99 X-Sequence-Number: 3465 Mary Edie Meredith writes: > For our testing purposes, however, consistent results are extremely > important. We have observed that small difference in one plan for one of > 22 queries can cause a difference in the DBT-3 results. If this > happens, a small change in performance runs between two Linux kernels > may appear to be due to the kernels, when in fact it is due to the plan > change. Fair enough. If you are trying to force exactly repeatable results, why don't you just "set seed = 0" before you ANALYZE? There's only one random-number generator, so that should force ANALYZE to make the same random sampling every time. Also, it'd be a good idea to ANALYZE the needed tables by name, explicitly, to ensure that they are analyzed in a known order rather than whatever order ANALYZE happens to find them in pg_class. regards, tom lane