X-Original-To: pgsql-performance-postgresql.org@localhost.postgresql.org Received: from localhost (av.hub.org [200.46.204.144]) by svr1.postgresql.org (Postfix) with ESMTP id 3A148D9EB3; Mon, 3 Oct 2005 18:43:37 -0300 (ADT) Received: from svr1.postgresql.org ([200.46.204.71]) by localhost (av.hub.org [200.46.204.144]) (amavisd-new, port 10024) with ESMTP id 43127-10; Mon, 3 Oct 2005 21:43:31 +0000 (GMT) Received: from mail.skype.net (mail.skype.net [195.215.8.149]) by svr1.postgresql.org (Postfix) with ESMTP id EA63CD9EB0; Mon, 3 Oct 2005 18:43:32 -0300 (ADT) Received: from localhost (localhost.localdomain [127.0.0.1]) by mail.skype.net (Postfix) with ESMTP id 6E5894DD6A; Mon, 3 Oct 2005 23:43:34 +0200 (CEST) Received: from [192.168.1.2] (217-159-136-226-dsl.kt.estpak.ee [217.159.136.226]) by mail.skype.net (Postfix) with ESMTP id 79F984DE27; Mon, 3 Oct 2005 23:43:33 +0200 (CEST) Subject: Re: [HACKERS] A Better External Sort? From: Hannu Krosing To: Josh Berkus Cc: "Jeffrey W. Baker" , pgsql-hackers@postgresql.org, Michael Stone , pgsql-performance@postgresql.org In-Reply-To: <200510031416.15620.josh@agliodbs.com> References: <31833713.1128111650174.JavaMail.root@elwamui-polski.atl.sa.earthlink.net> <200510031334.02030.josh@agliodbs.com> <1128372151.28509.1.camel@toonses.gghcwest.com> <200510031416.15620.josh@agliodbs.com> Content-Type: text/plain Date: Tue, 04 Oct 2005 00:43:10 +0300 Message-Id: <1128375790.5882.18.camel@fuji.krosing.net> Mime-Version: 1.0 X-Mailer: Evolution 2.0.4 (2.0.4-6) Content-Transfer-Encoding: 7bit X-Virus-Scanned: by amavisd-new at hub.org X-Spam-Status: No, hits=0 required=5 tests=[none] X-Spam-Level: X-Archive-Number: 200510/70 X-Sequence-Number: 14838 On E, 2005-10-03 at 14:16 -0700, Josh Berkus wrote: > Jeff, > > > > Nope, LOTS of testing, at OSDL, GreenPlum and Sun. For comparison, A > > > Big-Name Proprietary Database doesn't get much more than that either. > > > > I find this claim very suspicious. I get single-threaded reads in > > excess of 1GB/sec with XFS and > 250MB/sec with ext3. > > Database reads? Or raw FS reads? It's not the same thing. Just FYI, I run a count(*) on a 15.6GB table on a lightly loaded db and it run in 163 sec. (Dual opteron 2.6GHz, 6GB RAM, 6 x 74GB 15k disks in RAID10, reiserfs). A little less than 100MB sec. After this I ran count(*) over a 2.4GB file from another tablespace on another device (4x142GB 10k disks in RAID10) and it run 22.5 sec on first run and 12.5 on second. db=# show shared_buffers ; shared_buffers ---------------- 196608 (1 row) db=# select version(); version -------------------------------------------------------------------------------------------- PostgreSQL 8.0.3 on x86_64-pc-linux-gnu, compiled by GCC cc (GCC) 3.3.6 (Debian 1:3.3.6-7) (1 row) -- Hannu Krosing