X-Original-To: pgsql-performance-postgresql.org@localhost.postgresql.org Received: from localhost (unknown [200.46.204.144]) by svr1.postgresql.org (Postfix) with ESMTP id 05C3B32A165 for ; Thu, 21 Oct 2004 12:47:18 +0100 (BST) Received: from svr1.postgresql.org ([200.46.204.71]) by localhost (av.hub.org [200.46.204.144]) (amavisd-new, port 10024) with ESMTP id 78512-07 for ; Thu, 21 Oct 2004 11:47:13 +0000 (GMT) Received: from rproxy.gmail.com (rproxy.gmail.com [64.233.170.200]) by svr1.postgresql.org (Postfix) with ESMTP id EC72532A15F for ; Thu, 21 Oct 2004 12:47:15 +0100 (BST) Received: by rproxy.gmail.com with SMTP id 73so9646rnk for ; Thu, 21 Oct 2004 04:47:15 -0700 (PDT) DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=beta; d=gmail.com; h=received:message-id:date:from:reply-to:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:references; b=a4IEXvhcEt0imSl9ZsbCTf8czV2q5PhOPRzhQea50sB2IOftrF7HeZjxJXhFlJqZN0uRess89681a6MFLMIDGBdc5by13poSIeAa8RVpn4R6wiRpk2dlx3PUc0NU5pi0QITqfymm+rZaTICkf5fHqUCGerAptjLoI4dh/3AiN8M= Received: by 10.39.1.26 with SMTP id d26mr3033814rni; Thu, 21 Oct 2004 04:47:14 -0700 (PDT) Received: by 10.38.151.75 with HTTP; Thu, 21 Oct 2004 04:47:14 -0700 (PDT) Message-ID: <157f6484041021044720eb7520@mail.gmail.com> Date: Thu, 21 Oct 2004 07:47:14 -0400 From: Aaron Werman Reply-To: Aaron Werman To: "Leeuw van der, Tim" Subject: Re: Anything to be gained from a 'Postgres Filesystem'? Cc: "Steinar H. Gunderson" , pgsql-performance@postgresql.org In-Reply-To: Mime-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit References: X-Virus-Scanned: by amavisd-new at hub.org X-Spam-Status: No, hits=0.0 tagged_above=0.0 required=5.0 tests= X-Spam-Level: X-Archive-Number: 200410/347 X-Sequence-Number: 8823 The intuitive thing would be to put pg into a file system. /Aaron On Thu, 21 Oct 2004 12:44:10 +0200, Leeuw van der, Tim wrote: > Hi, > > I guess the difference is in 'severe hacking inside PG' vs. 'some unknown amount of hacking that doesn't touch PG code'. > > Hacking PG internally to handle raw devices will meet with strong resistance from large portions of the development team. I don't expect (m)any core devs of PG will be excited about rewriting the entire I/O architecture of PG and duplicating large amounts of OS type of code inside the application, just to try to attain an unknown performance benefit. > > PG doesn't use one big file, as some databases do, but many small files. Now PG would need to be able to do file-management, if you put the PG database on a raw disk partition! That's icky stuff, and you'll find much resistance against putting such code inside PG. > So why not try to have the external FS know a bit about PG and it's directory-layout, and it's IO requirements? Then such type of code can at least be maintained outside the application, and will not be as much of a burden to the rest of the application. > > (I'm not sure if it's a good idea to create a PG-specific FS in your OS of choice, but it's certainly gonna be easier than getting FS code inside of PG) > > cheers, > > --Tim > > > > -----Original Message----- > From: pgsql-performance-owner@postgresql.org [mailto:pgsql-performance-owner@postgresql.org]On Behalf Of Steinar H. Gunderson > Sent: Thursday, October 21, 2004 12:27 PM > To: pgsql-performance@postgresql.org > Subject: Re: [PERFORM] Anything to be gained from a 'Postgres Filesystem'? > > On Thu, Oct 21, 2004 at 08:58:01AM +0100, Matt Clark wrote: > > I suppose I'm just idly wondering really. Clearly it's against PG > > philosophy to build an FS or direct IO management into PG, but now it's so > > relatively easy to plug filesystems into the main open-source Oses, It > > struck me that there might be some useful changes to, say, XFS or ext3, that > > could be made that would help PG out. > > This really sounds like a poor replacement for just making PostgreSQL use raw > devices to me. (I have no idea why that isn't done already, but presumably it > isn't all that easy to get right. :-) ) > > /* Steinar */ > -- > Homepage: http://www.sesse.net/ > > ---------------------------(end of broadcast)--------------------------- > TIP 1: subscribe and unsubscribe commands go to majordomo@postgresql.org > > ---------------------------(end of broadcast)--------------------------- > TIP 7: don't forget to increase your free space map settings > -- Regards, /Aaron