X-Original-To: pgsql-performance-postgresql.org@localhost.postgresql.org Received: from localhost (unknown [200.46.204.144]) by svr1.postgresql.org (Postfix) with ESMTP id 7843FD1B1A0 for ; Tue, 22 Jun 2004 09:12:52 -0300 (ADT) Received: from svr1.postgresql.org ([200.46.204.71]) by localhost (av.hub.org [200.46.204.144]) (amavisd-new, port 10024) with ESMTP id 00180-02 for ; Tue, 22 Jun 2004 12:12:53 +0000 (GMT) Received: from news.hub.org (news.hub.org [200.46.204.72]) by svr1.postgresql.org (Postfix) with ESMTP id B34C7D1B1BC for ; Tue, 22 Jun 2004 09:12:49 -0300 (ADT) Received: from news.hub.org (news.hub.org [200.46.204.72]) by news.hub.org (8.12.9/8.12.9) with ESMTP id i5MCCmQC033536 for ; Tue, 22 Jun 2004 12:12:48 GMT (envelope-from news@news.hub.org) Received: (from news@localhost) by news.hub.org (8.12.9/8.12.9/Submit) id i5MBoXIi028251 for pgsql-performance@postgresql.org; Tue, 22 Jun 2004 11:50:33 GMT From: Christopher Browne X-Newsgroups: comp.databases.postgresql.performance Subject: Re: Postgres over Linux NBD or NFS Date: Tue, 22 Jun 2004 07:50:34 -0400 Organization: cbbrowne Computing Inc Lines: 58 Message-ID: References: <40D722CC.8000905@ca.afilias.info> <644E3D69-C3F6-11D8-8816-000393A47FCC@ravensfield.com> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii X-Complaints-To: usenet@news.hub.org X-message-flag: Outlook is rather hackable, isn't it? X-Home-Page: http://www.cbbrowne.com/info/ X-Affero: http://svcs.affero.net/rm.php?r=cbbrowne User-Agent: Gnus/5.1006 (Gnus v5.10.6) XEmacs/21.4 (Security Through Obscurity, linux) Cancel-Lock: sha1:MRPQytklXo31g2J3nrqkcOo5wZ0= To: pgsql-performance@postgresql.org X-Virus-Scanned: by amavisd-new at hub.org X-Spam-Status: No, hits=0.0 tagged_above=0.0 required=5.0 tests= X-Spam-Level: X-Archive-Number: 200406/220 X-Sequence-Number: 7278 In an attempt to throw the authorities off his trail, ronz@ravensfield.com (Andrew Rawnsley) transmitted: > On Jun 21, 2004, at 2:02 PM, Andrew Hammond wrote: >> We're looking for an alternative to fiber-channel disk arrays for mass >> storage. One of the ideas that we're exploring would involve having the >> cluster on an NFS mounted filesystem. Another technology we're looking >> at is the Linux NBD (Network Block Device). > > No idea about NBDs, but its generally accepted that running over NFS > would significantly decrease reliability and performance, i.e. it > would be a Bad Move (tm). Not sure what you think to gain. I sure > wouldn't trust NFS with a production database. > > What exactly are you trying to gain, avoid, or do? The point of the exercise is to try to come up with something that is a near-substitute for a SAN. With a SAN, you have a box with a whole lot of disk in it, and then your database servers connect to that box, typically via something like fibrechannel. One of the goals is for this to allow trying out Opterons at low risk. Should performance turn out to suck or there be some other disqualification, it's simple to hook the disk up to something else instead. The other goal is to be able to stick LOTS of disk into one box, and dole it out to multiple servers. It's more expensive to set up and manage 3 RAID arrays than it is to set up and manage just 1, because you have to manage 3 sets of disk hardware rather than 1. But I'm getting convinced that the attempt to get this clever about it is counterproductive unless you have outrageous amounts of money to throw at it. - NFS may well be acceptable if you buy into something with potent FS semantics, as with NetApp boxes. But they're REALLY expensive. - FibreChannel offers interesting options in conjunction with a fairly smart SAN box and Veritas, where you could have 5TB of storage in one box, and then assign 2TB apiece to two servers, and the other 1TB to a third. But the pricing premium again leaps out at ya. The "poor man's approach" involves trying to fake this by building a "disk box" running Linux that exports the storage either as a filesystem (using NFS) or as disk blocks (NBD). NFS clearly doesn't provide the filesystem semantics needed to get decent reliability; with NBD, it's not clear what happens :-(. Barring that, it means building a separate RAID array for each server, and living with the limitation that a full set of disk hardware has to be devoted to each DB server. -- wm(X,Y):-write(X),write('@'),write(Y). wm('cbbrowne','acm.org'). http://www3.sympatico.ca/cbbrowne/ Rules of the Evil Overlord #46. "If an advisor says to me "My liege, he is but one man. What can one man possibly do?", I will reply "This." and kill the advisor."