Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtps (TLS1.3:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1joyCu-0002oP-Kl for pgsql-hackers@arkaria.postgresql.org; Fri, 26 Jun 2020 23:56:32 +0000 Received: from localhost ([127.0.0.1] helo=malur.postgresql.org) by malur.postgresql.org with esmtp (Exim 4.92) (envelope-from ) id 1joyCt-00028k-DE for pgsql-hackers@arkaria.postgresql.org; Fri, 26 Jun 2020 23:56:31 +0000 Received: from magus.postgresql.org ([2a02:c0:301:0:ffff::29]) by malur.postgresql.org with esmtps (TLS1.3:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1joyCt-00028d-67 for pgsql-hackers@lists.postgresql.org; Fri, 26 Jun 2020 23:56:31 +0000 Received: from momjian.us ([72.94.173.45]) by magus.postgresql.org with esmtps (TLS1.3:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1joyCq-00059s-0A for pgsql-hackers@postgresql.org; Fri, 26 Jun 2020 23:56:30 +0000 Received: from bruce by momjian.us with local (Exim 4.92) (envelope-from ) id 1joyCk-0005XH-Ar; Fri, 26 Jun 2020 19:56:22 -0400 Date: Fri, 26 Jun 2020 19:56:22 -0400 From: Bruce Momjian To: Peter Geoghegan Cc: Andres Freund , Jeff Davis , Robert Haas , David Rowley , Justin Pryzby , Melanie Plageman , Tomas Vondra , "pgsql-hackers@postgresql.org" Subject: Re: Default setting for enable_hashagg_disk Message-ID: <20200626235622.GE3337@momjian.us> References: <20200624171203.GB17842@momjian.us> <20200624191900.t4sbfk236gndwoa3@alap3.anarazel.de> <20200624231810.GB13627@momjian.us> <20200624233837.GA21436@momjian.us> <20200625171756.GB12486@momjian.us> <8fd82a9e6c00b73191d18940b2da6a94a30477af.camel@j-davis.com> <20200625182512.GC12486@momjian.us> <20200625203629.7m6yvut7eqblgmfo@alap3.anarazel.de> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.10.1 (2018-07-13) List-Id: List-Help: List-Subscribe: List-Post: List-Owner: List-Archive: Precedence: bulk On Fri, Jun 26, 2020 at 01:53:05PM -0700, Peter Geoghegan wrote: > On Thu, Jun 25, 2020 at 1:36 PM Andres Freund wrote: > > 12 28164.865 ms > > > > fast ssd: > > HEAD 92520.680 ms > > > > magnetic: > > HEAD 183968.538 ms > > > > (no reads, there's plenty enough memory. Just writes because the age / > > amount thresholds for dirty data are reached) > > > > In the magnetic case we're IO bottlenecked nearly the whole time. > > I agree with almost everything you've said on this thread, but at the > same time I question the emphasis on I/O here. You've shown that > spinning rust is about twice as slow as a fast SSD here. Fair enough, > but to me the real story is that spilling is clearly a lot slower in > general, regardless of how fast the storage subsystem happens to be (I > wonder how fast it is with a ramdisk). To me, it makes more sense to This blog entry shows ORDER BY using ram disk, SSD, and magnetic: https://momjian.us/main/blogs/pgblog/2012.html#February_2_2012 It is from 2012, but I can re-run the test if you want. -- Bruce Momjian https://momjian.us EnterpriseDB https://enterprisedb.com The usefulness of a cup is in its emptiness, Bruce Lee