Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtps (TLS1.3:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1jjTjB-0007lZ-11 for pgsql-hackers@arkaria.postgresql.org; Thu, 11 Jun 2020 20:23:09 +0000 Received: from localhost ([127.0.0.1] helo=malur.postgresql.org) by malur.postgresql.org with esmtp (Exim 4.92) (envelope-from ) id 1jjTj9-0008RB-SI for pgsql-hackers@arkaria.postgresql.org; Thu, 11 Jun 2020 20:23:07 +0000 Received: from makus.postgresql.org ([2001:4800:3e1:1::229]) by malur.postgresql.org with esmtps (TLS1.3:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1jjTj9-0008R4-Hd for pgsql-hackers@lists.postgresql.org; Thu, 11 Jun 2020 20:23:07 +0000 Received: from mail-pj1-x1036.google.com ([2607:f8b0:4864:20::1036]) by makus.postgresql.org with esmtps (TLS1.3:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.92) (envelope-from ) id 1jjTj2-0006I3-VI for pgsql-hackers@postgresql.org; Thu, 11 Jun 2020 20:23:06 +0000 Received: by mail-pj1-x1036.google.com with SMTP id q24so2842870pjd.1 for ; Thu, 11 Jun 2020 13:23:00 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=j-davis-com.20150623.gappssmtp.com; s=20150623; h=message-id:subject:from:to:cc:date:in-reply-to:references :mime-version:content-transfer-encoding; bh=/9/m9JbJcIjH3hOOwojUl1Uz4O8WNOevpPXTNAZP3GI=; b=RTU+MSARFHCy3+V751/UMsolzZ8U6ixJSZxtNITnjnfIOSivWxWnET9fxLXUC89cTj 3s5e2NENhaTKhpzq0WAflruqwFL6seY1L2XxINM8Kxq/6gMLuh+biphB0ZRWu43WsGPv gPrNpDHAJVC3oGeRywRX9Xg+Uz1qLOujKqm9kkKICZnL3qJ39JfNWyLqOyW/J8/BmHBx IZvz+93PlAPm7A3fEzTcwiCpOOWaWLTrlDAIJLNoEzg+9iqLr9SHJXb8UKpMedWygmVD v6EDsoD6YuDVx/zhVdSCn/Ri9OqJ6dilqmI+1gXrjc+Ux77eqmMCk71u959ncDG3ZpoP 0Wyg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:message-id:subject:from:to:cc:date:in-reply-to :references:mime-version:content-transfer-encoding; bh=/9/m9JbJcIjH3hOOwojUl1Uz4O8WNOevpPXTNAZP3GI=; b=G2XgexQG5Yi3E0JQ5YyQt9flAM0bkbTS6XwcqUKevEIvXIvOi+O2lEzJxQU7+y507m UYeqZbQPSDPwu+N1/t/zCsFVm8ETmWns+cNysjx6QdRFHJbL9qajell2+iYNKFx6fAU1 MDqeDR2FzSEzUOBzxZ9NFYEGsmVgUvV2wU1rN3wJRfQO4DzKfdZMSgttsTe5/RF5gKv7 NaD9hZ3FAHZBHnSCKGfjYHYLI6QjLbFZjYuzer1w1d5q/ozmB92MHeNuT1ZG3TWvFYra Jn81c5p4PidYx97JMcriptStL+9/7F+EffIzVeERWlrb2Nkbqpzw+mB23oNf83FfmEBW y6RA== X-Gm-Message-State: AOAM530lHv2a86xBlMJINzHApaATBY/a4emW5iY/wNwFigmrtEbMQnnE EDGfEEFnsjFrwTPlA5OuHKiQjw== X-Google-Smtp-Source: ABdhPJxOGu6qF65ik2YG8dqnWFc+vhNGeEtF5UpNNwwtyN0gDfdUr5IPPIqvcInZNoR4E/CtYO3eug== X-Received: by 2002:a17:90a:73cb:: with SMTP id n11mr10247439pjk.234.1591906979253; Thu, 11 Jun 2020 13:22:59 -0700 (PDT) Received: from jdavis.lan (c-73-231-146-4.hsd1.ca.comcast.net. [73.231.146.4]) by smtp.gmail.com with ESMTPSA id h3sm3432202pgd.0.2020.06.11.13.22.57 (version=TLS1_2 cipher=ECDHE-ECDSA-CHACHA20-POLY1305 bits=256/256); Thu, 11 Jun 2020 13:22:58 -0700 (PDT) Message-ID: Subject: Re: Default setting for enable_hashagg_disk From: Jeff Davis To: Justin Pryzby , Melanie Plageman Cc: Robert Haas , Tomas Vondra , pgsql-hackers@postgresql.org Date: Thu, 11 Jun 2020 13:22:57 -0700 In-Reply-To: <8bff2e4e8020c3caa16b61a46918d21b573eaf78.camel@j-davis.com> References: <9d9d1e1252a52ea1bad84ea40dbebfd54e672a0f.camel@j-davis.com> <20200407223900.GT2228@telsasoft.com> <20200409114855.h4hh7e2wt77p56sv@development> <6292f5a766198d5745eb8cc17ac736366056671d.camel@j-davis.com> <20200610021544.GA14879@telsasoft.com> <8bff2e4e8020c3caa16b61a46918d21b573eaf78.camel@j-davis.com> Content-Type: text/plain; charset="UTF-8" X-Mailer: Evolution 3.28.5-0ubuntu0.18.04.2 Mime-Version: 1.0 Content-Transfer-Encoding: 7bit List-Id: List-Help: List-Subscribe: List-Post: List-Owner: List-Archive: Precedence: bulk On Wed, 2020-06-10 at 11:39 -0700, Jeff Davis wrote: > 1. Testing the spilling of hashed grouping sets: I'm inclined to just > get rid of enable_groupingsets_hash_disk and use Melanie's stats- > hacking approach instead. Fixed in 92c58fd9. > think the names you suggested quite fit, but the idea to use a more > interesting GUC value might help express the behavior. Perhaps making > enable_hashagg a ternary "enable_hashagg=on|off|avoid_disk"? The word > "reject" is too definite for the planner, which is working with > imperfect information. I renamed enable_hashagg_disk to hashagg_avoid_disk_plan, which I think satisfies the concerns raised here. Also in 92c58fd9. There is still the original topic of this thread, which is whether we need to change the default value of this GUC, or penalize disk-based HashAgg in some way, to be more conservative about plan changes in v13. I think we can wait a little longer to make a decision there. Regards, Jeff Davis