X-Original-To: pgsql-performance-postgresql.org@localhost.postgresql.org Received: from localhost (av.hub.org [200.46.204.144]) by svr1.postgresql.org (Postfix) with ESMTP id 78C94D9EB0; Mon, 3 Oct 2005 17:42:41 -0300 (ADT) Received: from svr1.postgresql.org ([200.46.204.71]) by localhost (av.hub.org [200.46.204.144]) (amavisd-new, port 10024) with ESMTP id 29216-06; Mon, 3 Oct 2005 20:42:37 +0000 (GMT) Received: from gghcwest.com (adsl-71-128-90-172.dsl.pltn13.pacbell.net [71.128.90.172]) by svr1.postgresql.org (Postfix) with ESMTP id 2D7DDD9EB3; Mon, 3 Oct 2005 17:42:37 -0300 (ADT) Received: from toonses.gghcwest.com (toonses.gghcwest.com [192.168.168.115]) by gghcwest.com (8.12.10/8.12.9) with ESMTP id j93KgUmd027368; Mon, 3 Oct 2005 13:42:31 -0700 Received: from jwb by toonses.gghcwest.com with local (Exim 4.52) id 1EMX8q-0007Vv-5b; Mon, 03 Oct 2005 13:42:32 -0700 Subject: Re: [HACKERS] A Better External Sort? From: "Jeffrey W. Baker" To: josh@agliodbs.com Cc: pgsql-hackers@postgresql.org, Michael Stone , pgsql-performance@postgresql.org In-Reply-To: <200510031334.02030.josh@agliodbs.com> References: <31833713.1128111650174.JavaMail.root@elwamui-polski.atl.sa.earthlink.net> <200509301341.22795.josh@agliodbs.com> <20050930231032.GQ2241@mathom.us> <200510031334.02030.josh@agliodbs.com> Content-Type: text/plain Content-Transfer-Encoding: 7bit Date: Mon, 03 Oct 2005 13:42:31 -0700 Message-Id: <1128372151.28509.1.camel@toonses.gghcwest.com> Mime-Version: 1.0 X-Mailer: Evolution 2.4.0 X-Virus-Scanned: by amavisd-new at hub.org X-Spam-Status: No, hits=-0.415 required=5 tests=[AWL=-0.465, FORGED_RCVD_HELO=0.05] X-Spam-Level: X-Archive-Number: 200510/26 X-Sequence-Number: 14794 On Mon, 2005-10-03 at 13:34 -0700, Josh Berkus wrote: > Michael, > > > >Realistically, you can't do better than about 25MB/s on a > > > single-threaded I/O on current Linux machines, > > > > What on earth gives you that idea? Did you drop a zero? > > Nope, LOTS of testing, at OSDL, GreenPlum and Sun. For comparison, A > Big-Name Proprietary Database doesn't get much more than that either. I find this claim very suspicious. I get single-threaded reads in excess of 1GB/sec with XFS and > 250MB/sec with ext3. -jwb