From gandalf@shopzeus.com Tue Jul 24 12:51:27 2012 Received: from magus.postgresql.org (magus.postgresql.org [87.238.57.229]) by mail.postgresql.org (Postfix) with ESMTP id 46BDA5F9CED for ; Tue, 24 Jul 2012 09:51:27 -0300 (ADT) Received: from 10610.x.rootbsd.net ([204.109.60.69] helo=vps001.shopzeus.com) by magus.postgresql.org with esmtp (Exim 4.72) (envelope-from ) id 1SteaB-00022p-8b for pgsql-performance@postgresql.org; Tue, 24 Jul 2012 12:51:26 +0000 Received: from [192.168.1.105] (localhost [127.0.0.1]) by vps001.shopzeus.com (8.14.3/8.14.3) with ESMTP id q6OCp7B6041558 for ; Tue, 24 Jul 2012 08:51:08 -0400 (EDT) (envelope-from gandalf@shopzeus.com) Message-ID: <500E9A3B.3070609@shopzeus.com> Date: Tue, 24 Jul 2012 14:51:07 +0200 From: Laszlo Nagy User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:14.0) Gecko/20120714 Thunderbird/14.0 MIME-Version: 1.0 To: pgsql-performance@postgresql.org Subject: ZFS vs. UFS Content-Type: multipart/alternative; boundary="------------000305000704060808090806" X-Pg-Spam-Score: -1.9 (-) X-Archive-Number: 201207/293 X-Sequence-Number: 47474 This is a multi-part message in MIME format. --------------000305000704060808090806 Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Hello, Under FreeBSD 9, what filesystem should I use for PostgreSQL? (Dell PowerEdge 2900, 24G mem, 10x2T SATA2 disk, Intel RAID controller.) * ZFS is journaled, and it is more independent of the hardware. So if the computer goes wrong, I can move the zfs array to a different server. * UFS is not journaled. Also I have to rely on the RAID card to build the RAID array. If there is a hw problem with it, then I won't be able to recover the data easily. I wonder if UFS has better performance or not. Or can you suggest another fs? Just of the PGDATA directory. Thanks, Laszlo --------------000305000704060808090806 Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit
  Hello,

Under FreeBSD 9, what filesystem should I use for PostgreSQL? (Dell PowerEdge 2900, 24G mem, 10x2T SATA2 disk, Intel RAID controller.)

  • ZFS is journaled, and it is more independent of the hardware. So if the computer goes wrong, I can move the zfs array to a different server.
  • UFS is not journaled. Also I have to rely on the RAID card to build the RAID array. If there is a hw problem with it, then I won't be able to recover the data easily.

I wonder if UFS has better performance or not. Or can you suggest another fs? Just of the PGDATA directory.

Thanks,

   Laszlo

--------------000305000704060808090806-- From gosho@oles.biz Tue Jul 24 13:04:05 2012 Received: from magus.postgresql.org (magus.postgresql.org [87.238.57.229]) by mail.postgresql.org (Postfix) with ESMTP id E97425F9CED for ; Tue, 24 Jul 2012 10:04:05 -0300 (ADT) Received: from [2002:4e5a:206::1] (helo=mail.oles.biz) by magus.postgresql.org with esmtp (Exim 4.72) (envelope-from ) id 1StemO-0002Bm-3x for pgsql-performance@postgresql.org; Tue, 24 Jul 2012 13:04:04 +0000 Received: from localhost (localhost [127.0.0.1]) by mail.oles.biz (Postfix) with ESMTP id 43D8645E5DC; Tue, 24 Jul 2012 16:03:46 +0300 (EEST) X-Virus-Scanned: Debian amavisd-new at mail.oles.biz Received: from mail.oles.biz ([127.0.0.1]) by localhost (bambi2.oles.biz [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id A4y+2U2WRKro; Tue, 24 Jul 2012 16:03:45 +0300 (EEST) Received: from [IPv6:2002:4e5a:206:1::2] (unknown [IPv6:2002:4e5a:206:1::2]) (using TLSv1 with cipher AES256-SHA (256/256 bits)) (No client certificate requested) by mail.oles.biz (Postfix) with ESMTPSA id C9EF045E5D8; Tue, 24 Jul 2012 16:03:45 +0300 (EEST) Message-ID: <500E9D31.6050107@oles.biz> Date: Tue, 24 Jul 2012 16:03:45 +0300 From: Georgi Naplatanov User-Agent: Mozilla/5.0 (X11; U; Linux x86_64; en-US; rv:1.9.1.16) Gecko/20120613 Icedove/3.0.11 MIME-Version: 1.0 To: Laszlo Nagy CC: pgsql-performance@postgresql.org Subject: Re: ZFS vs. UFS References: <500E9A3B.3070609@shopzeus.com> In-Reply-To: <500E9A3B.3070609@shopzeus.com> Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit X-Host-Lookup-Failed: Reverse DNS lookup failed for 2002:4e5a:206::1 (failed) X-Pg-Spam-Score: -1.1 (-) X-Archive-Number: 201207/294 X-Sequence-Number: 47475 Hi. As far as I know UFS is faster than ZFS on FreeBSD 9.0. Some users reported stability problem with ZFS on AMD64 and maybe UFS is better choice. Best regards Georgi On 07/24/2012 03:51 PM, Laszlo Nagy wrote: > > Hello, > > Under FreeBSD 9, what filesystem should I use for PostgreSQL? (Dell > PowerEdge 2900, 24G mem, 10x2T SATA2 disk, Intel RAID controller.) > > * ZFS is journaled, and it is more independent of the hardware. So > if the computer goes wrong, I can move the zfs array to a > different server. > * UFS is not journaled. Also I have to rely on the RAID card to > build the RAID array. If there is a hw problem with it, then I > won't be able to recover the data easily. > > I wonder if UFS has better performance or not. Or can you suggest > another fs? Just of the PGDATA directory. > > Thanks, > > Laszlo > From ivoras@freebsd.org Tue Jul 24 13:18:55 2012 Received: from makus.postgresql.org (makus.postgresql.org [98.129.198.125]) by mail.postgresql.org (Postfix) with ESMTP id 911EC5F9CED for ; Tue, 24 Jul 2012 10:18:55 -0300 (ADT) Received: from plane.gmane.org ([80.91.229.3]) by makus.postgresql.org with esmtp (Exim 4.72) (envelope-from ) id 1Stf0n-0008Cy-OV for pgsql-performance@postgresql.org; Tue, 24 Jul 2012 13:18:54 +0000 Received: from list by plane.gmane.org with local (Exim 4.69) (envelope-from ) id 1Stf0Z-00078u-5m for pgsql-performance@postgresql.org; Tue, 24 Jul 2012 15:18:39 +0200 Received: from lara.cc.fer.hr ([161.53.72.113]) by main.gmane.org with esmtp (Gmexim 0.1 (Debian)) id 1AlnuQ-0007hv-00 for ; Tue, 24 Jul 2012 15:18:39 +0200 Received: from ivoras by lara.cc.fer.hr with local (Gmexim 0.1 (Debian)) id 1AlnuQ-0007hv-00 for ; Tue, 24 Jul 2012 15:18:39 +0200 X-Injected-Via-Gmane: http://gmane.org/ To: pgsql-performance@postgresql.org From: Ivan Voras Subject: Re: ZFS vs. UFS Date: Tue, 24 Jul 2012 15:18:29 +0200 Lines: 51 Message-ID: References: <500E9A3B.3070609@shopzeus.com> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="------------enig631A938C4C5AC91C96E3D555" X-Complaints-To: usenet@dough.gmane.org X-Gmane-NNTP-Posting-Host: lara.cc.fer.hr User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:10.0) Gecko/20120213 Thunderbird/10.0 In-Reply-To: <500E9A3B.3070609@shopzeus.com> X-Enigmail-Version: 1.3.5 X-Pg-Spam-Score: -1.9 (-) X-Archive-Number: 201207/295 X-Sequence-Number: 47476 This is an OpenPGP/MIME signed message (RFC 2440 and 3156) --------------enig631A938C4C5AC91C96E3D555 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable On 24/07/2012 14:51, Laszlo Nagy wrote: >=20 > Hello, >=20 > Under FreeBSD 9, what filesystem should I use for PostgreSQL? (Dell > PowerEdge 2900, 24G mem, 10x2T SATA2 disk, Intel RAID controller.) >=20 > * ZFS is journaled, and it is more independent of the hardware. So if > the computer goes wrong, I can move the zfs array to a different ser= ver. > * UFS is not journaled. Also I have to rely on the RAID card to build > the RAID array. If there is a hw problem with it, then I won't be > able to recover the data easily. >=20 > I wonder if UFS has better performance or not. Or can you suggest > another fs? Just of the PGDATA directory. Hi, I think you might actually get a bit more performance out of ZFS, depending on your load, server configuration and (more so) the tuning of ZFS... however UFS is IMO more stable so I use it more often. A hardware RAID card would be good to have, but you can use soft-RAID the usual way and not be locked-in by the controller. You can activate softupdates-journalling on UFS if you really want it, but I find that regular softupdates is perfectly fine for PostgreSQL, which has its own journalling. --------------enig631A938C4C5AC91C96E3D555 Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.19 (FreeBSD) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/ iEYEARECAAYFAlAOoKUACgkQ/QjVBj3/HSwyxgCgmGsCC64mv4HBVafqA7QS7/GK 80wAmQFmLzLLiohXMoq7TX0tAvGP4iCh =Y0pw -----END PGP SIGNATURE----- --------------enig631A938C4C5AC91C96E3D555-- From foo@meisterderspiele.de Tue Jul 24 14:27:09 2012 Received: from magus.postgresql.org (magus.postgresql.org [87.238.57.229]) by mail.postgresql.org (Postfix) with ESMTP id B704AF6498E for ; Tue, 24 Jul 2012 11:27:09 -0300 (ADT) Received: from news.hub.org ([200.46.204.72]) by magus.postgresql.org with esmtp (Exim 4.72) (envelope-from ) id 1Stg4o-0003pY-Mj for pgsql-performance@postgresql.org; Tue, 24 Jul 2012 14:27:08 +0000 Received: from news.hub.org (news.hub.org [200.46.204.72]) by news.hub.org (8.14.5/8.14.5) with ESMTP id q6OEQq7N051124 for ; Tue, 24 Jul 2012 11:26:52 -0300 (ADT) (envelope-from news@news.hub.org) Received: (from news@localhost) by news.hub.org (8.14.5/8.14.5/Submit) id q6OENKIa048375 for pgsql-performance@postgresql.org; Tue, 24 Jul 2012 11:23:20 -0300 (ADT) (envelope-from news) From: Torsten Zuehlsdorff X-Newsgroups: pgsql.performance Subject: Re: ZFS vs. UFS Date: Tue, 24 Jul 2012 16:23:19 +0200 Organization: A noiseless patient Spider Lines: 9 Message-ID: References: <500E9A3B.3070609@shopzeus.com> Mime-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Injection-Date: Tue, 24 Jul 2012 14:23:19 +0000 (UTC) Injection-Info: mx04.eternal-september.org; posting-host="02790f52899e1d7bee37b51d1ef224a2"; logging-data="4255"; mail-complaints-to="abuse@eternal-september.org"; posting-account="U2FsdGVkX1/rnJJod71ssXqGoCpCx479" User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:13.0) Gecko/20120620 Thunderbird/13.0.1 In-Reply-To: <500E9A3B.3070609@shopzeus.com> Cancel-Lock: sha1:RBiA7pWP/S/KcIvc5qxkPpUKqX4= To: pgsql-performance@postgresql.org X-Pg-Spam-Score: -0.0 (/) X-Archive-Number: 201207/298 X-Sequence-Number: 47479 On 24.07.2012 14:51, Laszlo Nagy wrote: > * UFS is not journaled. There is journal support for UFS as far as i know. Please have a look at the gjournal manpage. Greetings, Torsten From cjames@emolecules.com Tue Jul 24 14:34:24 2012 Received: from makus.postgresql.org (makus.postgresql.org [98.129.198.125]) by mail.postgresql.org (Postfix) with ESMTP id 40A2EF6498E for ; Tue, 24 Jul 2012 11:34:24 -0300 (ADT) Received: from mail-ob0-f174.google.com ([209.85.214.174]) by makus.postgresql.org with esmtp (Exim 4.72) (envelope-from ) id 1StgBr-0001GX-Bq for pgsql-performance@postgresql.org; Tue, 24 Jul 2012 14:34:23 +0000 Received: by obbuo13 with SMTP id uo13so11195944obb.19 for ; Tue, 24 Jul 2012 07:34:10 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type:x-gm-message-state; bh=+t7XU6Lmj0yYBV8G33Z2Fi6+SMxZYlabIe1bAEPUH8I=; b=oZBAfZpLPp0pDspT7hWBDRKk4rEIAUp4YfS5gwU976f/yjAmxhTTu4jeXP2un8pLnB s92Ac+lhr0ZpHiIQqEMASws8hHuKfiOxbDRKCm8f/HwyD/RbKkVW0eAyM9GfpMZufhm9 a0U0J5U4H/YrX3zyZlm/aUi1Zt0/yWTJYA2sbw7Qd01ufCl+73VnNiX2ViGxCTpo5bkG XF5sy4kswSjxILHK+X7A62VItDTibGgrf61oyeFev6Mr7exnCcwzD1DSBxsTN6BW/mNP AtZlOdIlrcXFxkIM33bx/SkpO7KnCPGvJn3d0uIKoFdmyPSD684YntVa6ZvEx72nX8/M qq3Q== MIME-Version: 1.0 Received: by 10.182.77.170 with SMTP id t10mr27972877obw.24.1343140450707; Tue, 24 Jul 2012 07:34:10 -0700 (PDT) Received: by 10.182.28.106 with HTTP; Tue, 24 Jul 2012 07:34:10 -0700 (PDT) In-Reply-To: References: <500E9A3B.3070609@shopzeus.com> Date: Tue, 24 Jul 2012 07:34:10 -0700 Message-ID: Subject: Re: ZFS vs. UFS From: Craig James To: Ivan Voras Cc: pgsql-performance@postgresql.org Content-Type: multipart/alternative; boundary=f46d044517c172a73d04c59441ef X-Gm-Message-State: ALoCoQkWHpbb1Yuwahe21mCLrlseYdt/NuyWttIwoSrWJViv0tvaz70YfP7P+9VflG622VphGU0T X-Pg-Spam-Score: -2.6 (--) X-Archive-Number: 201207/300 X-Sequence-Number: 47481 --f46d044517c172a73d04c59441ef Content-Type: text/plain; charset=ISO-8859-1 > > On 24/07/2012 14:51, Laszlo Nagy wrote: > > > > Hello, > > > > Under FreeBSD 9, what filesystem should I use for PostgreSQL? (Dell > > PowerEdge 2900, 24G mem, 10x2T SATA2 disk, Intel RAID controller.) > > > > * ZFS is journaled, and it is more independent of the hardware. So if > > the computer goes wrong, I can move the zfs array to a different > server. > > * UFS is not journaled. Also I have to rely on the RAID card to build > > the RAID array. If there is a hw problem with it, then I won't be > > able to recover the data easily. > > > > I wonder if UFS has better performance or not. Or can you suggest > > another fs? Just of the PGDATA directory. > Relying on physically moving a disk isn't a good backup/recovery strategy. Disks are the least reliable single component in a modern computer. You should figure out the best file system for your application, and separately figure out a recovery strategy, one that can survive the failure of *any* component in your system, including the disk itself. Craig --f46d044517c172a73d04c59441ef Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable
On 24/07/2012 14:= 51, Laszlo Nagy wrote:
>
> =A0 Hello,
>
> Under FreeBSD 9, what filesystem should I use for PostgreSQL? (Dell > PowerEdge 2900, 24G mem, 10x2T SATA2 disk, Intel RAID controller.)
>
> =A0* ZFS is journaled, and it is more independent of the hardware. So = if
> =A0 =A0the computer goes wrong, I can move the zfs array to a differen= t server.
> =A0* UFS is not journaled. Also I have to rely on the RAID card to bui= ld
> =A0 =A0the RAID array. If there is a hw problem with it, then I won= 9;t be
> =A0 =A0able to recover the data easily.
>
> I wonder if UFS has better performance or not. Or can you suggest
> another fs? Just of the PGDATA directory.

Re= lying on physically moving a disk isn't a good backup/recovery strategy= .=A0 Disks are the least reliable single component in a modern computer.=A0= You should figure out the best file system for your application, and separ= ately figure out a recovery strategy, one that can survive the failure of *= any* component in your system, including the disk itself.

Craig

--f46d044517c172a73d04c59441ef-- From gandalf@shopzeus.com Tue Jul 24 18:27:38 2012 Received: from makus.postgresql.org (makus.postgresql.org [98.129.198.125]) by mail.postgresql.org (Postfix) with ESMTP id C91ECF64990 for ; Tue, 24 Jul 2012 15:27:38 -0300 (ADT) Received: from fep17.mx.upcmail.net ([62.179.121.37]) by makus.postgresql.org with esmtp (Exim 4.72) (envelope-from ) id 1StjpY-0005eh-5n for pgsql-performance@postgresql.org; Tue, 24 Jul 2012 18:27:38 +0000 Received: from edge04.upcmail.net ([192.168.13.239]) by viefep17-int.chello.at (InterMail vM.8.01.05.05 201-2260-151-110-20120111) with ESMTP id <20120724182721.PWMX23101.viefep17-int.chello.at@edge04.upcmail.net>; Tue, 24 Jul 2012 20:27:21 +0200 Received: from [192.168.0.101] ([89.134.225.226]) by edge04.upcmail.net with edge id eJTM1j00J4tiMtV04JTMYr; Tue, 24 Jul 2012 20:27:21 +0200 X-SourceIP: 89.134.225.226 Message-ID: <500EE907.1040801@shopzeus.com> Date: Tue, 24 Jul 2012 20:27:19 +0200 From: Laszlo Nagy User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:14.0) Gecko/20120713 Thunderbird/14.0 MIME-Version: 1.0 To: Craig James , pgsql-performance@postgresql.org Subject: Re: ZFS vs. UFS References: <500E9A3B.3070609@shopzeus.com> In-Reply-To: Content-Type: multipart/alternative; boundary="------------080800080701060307020503" X-Pg-Spam-Score: -1.9 (-) X-Archive-Number: 201207/308 X-Sequence-Number: 47489 This is a multi-part message in MIME format. --------------080800080701060307020503 Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit > > I wonder if UFS has better performance or not. Or can you suggest > > another fs? Just of the PGDATA directory. > > > Relying on physically moving a disk isn't a good backup/recovery > strategy. Disks are the least reliable single component in a modern > computer. You should figure out the best file system for your > application, and separately figure out a recovery strategy, one that > can survive the failure of *any* component in your system, including > the disk itself. This is why I use a RAID array of 10 disks. So there is no single point of failure. What else could I do? (Yes, I can make regular backups, but that is not the same. I can still loose data...) --------------080800080701060307020503 Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit
> I wonder if UFS has better performance or not. Or can you suggest
> another fs? Just of the PGDATA directory.

Relying on physically moving a disk isn't a good backup/recovery strategy.  Disks are the least reliable single component in a modern computer.  You should figure out the best file system for your application, and separately figure out a recovery strategy, one that can survive the failure of *any* component in your system, including the disk itself.
This is why I use a RAID array of 10 disks. So there is no single point of failure. What else could I do? (Yes, I can make regular backups, but that is not the same. I can still loose data...)
--------------080800080701060307020503-- From gandalf@shopzeus.com Tue Jul 24 18:36:07 2012 Received: from magus.postgresql.org (magus.postgresql.org [87.238.57.229]) by mail.postgresql.org (Postfix) with ESMTP id 500DEF64990 for ; Tue, 24 Jul 2012 15:36:07 -0300 (ADT) Received: from fep15.mx.upcmail.net ([62.179.121.35]) by magus.postgresql.org with esmtp (Exim 4.72) (envelope-from ) id 1Stjxk-0000T0-RS for pgsql-performance@postgresql.org; Tue, 24 Jul 2012 18:36:06 +0000 Received: from edge04.upcmail.net ([192.168.13.239]) by viefep15-int.chello.at (InterMail vM.8.01.05.05 201-2260-151-110-20120111) with ESMTP id <20120724183551.QOMN18555.viefep15-int.chello.at@edge04.upcmail.net>; Tue, 24 Jul 2012 20:35:51 +0200 Received: from [192.168.0.101] ([89.134.225.226]) by edge04.upcmail.net with edge id eJbq1j02Z4tiMtV04JbqC2; Tue, 24 Jul 2012 20:35:51 +0200 X-SourceIP: 89.134.225.226 Message-ID: <500EEB05.6030005@shopzeus.com> Date: Tue, 24 Jul 2012 20:35:49 +0200 From: Laszlo Nagy User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:14.0) Gecko/20120713 Thunderbird/14.0 MIME-Version: 1.0 To: Torsten Zuehlsdorff , pgsql-performance@postgresql.org Subject: Re: ZFS vs. UFS References: <500E9A3B.3070609@shopzeus.com> In-Reply-To: Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-Pg-Spam-Score: -1.9 (-) X-Archive-Number: 201207/309 X-Sequence-Number: 47490 > On 24.07.2012 14:51, Laszlo Nagy wrote: > >> * UFS is not journaled. > > There is journal support for UFS as far as i know. Please have a look > at the gjournal manpage. Yes, but gjournal works for disk devices. I would have rely on the hw card for RAID. When the card goes wrong I won't be able to access my data. I could also buy an identical RAID card. In fact I could buy a complete backup server. But right now I don't have the money for that. So I would like to use a solution that allows me to recover from a failure even if the RAID card goes wrong. It might also be possible to combine gmirror + gjournal, but that is not good enough. Performance and stability of a simple gmirror with two disks is much worse then a raidz array with 10 disks (and hot spare), or even a raid 1+0 (and hot spare) that is supported by the hw RAID card. So I would like to stick with UFS+hw card support (and then I need to buy an identical RAID card if I can), or ZFS. From cjames@emolecules.com Tue Jul 24 19:14:50 2012 Received: from magus.postgresql.org (magus.postgresql.org [87.238.57.229]) by mail.postgresql.org (Postfix) with ESMTP id 123E8F64990 for ; Tue, 24 Jul 2012 16:14:50 -0300 (ADT) Received: from mail-ob0-f174.google.com ([209.85.214.174]) by magus.postgresql.org with esmtp (Exim 4.72) (envelope-from ) id 1StkZD-0000zp-KS for pgsql-performance@postgresql.org; Tue, 24 Jul 2012 19:14:49 +0000 Received: by obbuo13 with SMTP id uo13so11532306obb.19 for ; Tue, 24 Jul 2012 12:14:33 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type:x-gm-message-state; bh=ZzBDyQdPu9uvZkvqoY6OYOo4RnIDnxOiP7l62Gz26sg=; b=D2nB8QVntapppLZZJFgbnu1z2eQUalmWqVsZCiAAy/6UTgIHRxge1s8GKxLAylwKV4 xnXcdppUQ7Wxl1mDiSBD6Lu4s7sFeh/GGDY0RxgXvXKJ5BJP9xEj7g+gxhccjT/7wPE5 5FCVNHH3F5UmTNBl0IqEajYx0YinlUIEGgg9Ge8ukSRxoOBsNtSvukYKiHyXpmGpmLCO UVsennRxQNn08u5T7slBT+F16RtRTzhDCqWMFm4rwvcoz0ShfklH2kwpfWOB7HErop+a x0TaUg184o2E0TMYKGAa0Qt98KDSEUDvODfylL0iJW//4UbWNNs3Zn6mQ7SX5z41hRZg 4PzQ== MIME-Version: 1.0 Received: by 10.182.174.70 with SMTP id bq6mr30069589obc.78.1343157273287; Tue, 24 Jul 2012 12:14:33 -0700 (PDT) Received: by 10.182.28.106 with HTTP; Tue, 24 Jul 2012 12:14:33 -0700 (PDT) In-Reply-To: <500EE907.1040801@shopzeus.com> References: <500E9A3B.3070609@shopzeus.com> <500EE907.1040801@shopzeus.com> Date: Tue, 24 Jul 2012 12:14:33 -0700 Message-ID: Subject: Re: ZFS vs. UFS From: Craig James To: Laszlo Nagy Cc: pgsql-performance@postgresql.org Content-Type: multipart/alternative; boundary=e89a8f647bcf26dd7e04c5982cec X-Gm-Message-State: ALoCoQmjP929P4okxxeM1w4q2lo2dRpHittlfrsuRckFTJmp1+q0yQVyhvRZSo0PkNBsWpXTHLYk X-Pg-Spam-Score: -2.6 (--) X-Archive-Number: 201207/312 X-Sequence-Number: 47493 --e89a8f647bcf26dd7e04c5982cec Content-Type: text/plain; charset=ISO-8859-1 On Tue, Jul 24, 2012 at 11:27 AM, Laszlo Nagy wrote: > > > I wonder if UFS has better performance or not. Or can you suggest >> > another fs? Just of the PGDATA directory. >> > > Relying on physically moving a disk isn't a good backup/recovery > strategy. Disks are the least reliable single component in a modern > computer. You should figure out the best file system for your application, > and separately figure out a recovery strategy, one that can survive the > failure of *any* component in your system, including the disk itself. > > This is why I use a RAID array of 10 disks. So there is no single point of > failure. What else could I do? (Yes, I can make regular backups, but that > is not the same. I can still loose data...) > Only you can answer that because it depends on your application. If you're operating PayPal, you probably want 24/7 100% reliability. If you're operating a social networking site for teenagers, losing data is probably not a catastrophe. In my experience, most data loss is NOT from equipment failure. It's from software bugs and operator errors. If your recovery plan doesn't cover this, you have a problem. Craig --e89a8f647bcf26dd7e04c5982cec Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable
On Tue, Jul 24, 2012 at 11:27 AM, Laszlo Nagy <gandalf@shopzeus.com> wrote:
=20 =20 =20

> I wonder if UFS has better performance or not. Or can you suggest
> another fs? Just of the PGDATA directory.

Relying on physically moving a disk isn't a good backup/recovery strategy.=A0 Disks are the least reliable single component in a modern computer.=A0 You should figure out the best file system for your application, and separately figure out a recovery strategy, one that can survive the failure of *any* component in your system, including the disk itself.
This is why I use a RAID array of 10 disks. So there is no single point of failure. What else could I do? (Yes, I can make regular backups, but that is not the same. I can still loose data...)

Only you can answer that because it depends on your = application.=A0 If you're operating PayPal, you probably want 24/7 100%= reliability. If you're operating a social networking site for teenager= s, losing data is probably not a catastrophe.

In my experience, most data loss is NOT from equipment failure.=A0 It&#= 39;s from software bugs and operator errors.=A0 If your recovery plan doesn= 't cover this, you have a problem.

Craig

--e89a8f647bcf26dd7e04c5982cec-- From foo@meisterderspiele.de Wed Jul 25 07:27:09 2012 Received: from makus.postgresql.org (makus.postgresql.org [98.129.198.125]) by mail.postgresql.org (Postfix) with ESMTP id A5E71BEAE59 for ; Wed, 25 Jul 2012 04:27:09 -0300 (ADT) Received: from news.hub.org ([200.46.204.72]) by makus.postgresql.org with esmtp (Exim 4.72) (envelope-from ) id 1Stvzv-0001Jb-8W for pgsql-performance@postgresql.org; Wed, 25 Jul 2012 07:27:09 +0000 Received: from news.hub.org (news.hub.org [200.46.204.72]) by news.hub.org (8.14.5/8.14.5) with ESMTP id q6P7QrpS013911 for ; Wed, 25 Jul 2012 04:26:53 -0300 (ADT) (envelope-from news@news.hub.org) Received: (from news@localhost) by news.hub.org (8.14.5/8.14.5/Submit) id q6P70gPK089945 for pgsql-performance@postgresql.org; Wed, 25 Jul 2012 04:00:42 -0300 (ADT) (envelope-from news) From: Torsten Zuehlsdorff X-Newsgroups: pgsql.performance Subject: Re: ZFS vs. UFS Date: Wed, 25 Jul 2012 09:00:37 +0200 Organization: A noiseless patient Spider Lines: 22 Message-ID: <500F9995.2020100@meisterderspiele.de> References: <500E9A3B.3070609@shopzeus.com> <500EEB05.6030005@shopzeus.com> Mime-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Injection-Info: mx04.eternal-september.org; posting-host="02790f52899e1d7bee37b51d1ef224a2"; logging-data="13240"; mail-complaints-to="abuse@eternal-september.org"; posting-account="U2FsdGVkX18pbCmbRgfWJRtTrjBBW4+M" User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:13.0) Gecko/20120620 Thunderbird/13.0.1 In-Reply-To: <500EEB05.6030005@shopzeus.com> Cancel-Lock: sha1:4GRVuObf6VGvcw8nJMzTmzqJYsE= To: pgsql-performance@postgresql.org X-Pg-Spam-Score: -1.9 (-) X-Archive-Number: 201207/320 X-Sequence-Number: 47501 >> On 24.07.2012 14:51, Laszlo Nagy wrote: >> >>> * UFS is not journaled. >> >> There is journal support for UFS as far as i know. Please have a look >> at the gjournal manpage. > > Yes, but gjournal works for disk devices. That isn't completly correct! gjournal works with all GEOM-devices, which could be not only disk devices, but also (remote) disk devices, (remote) files, (remote) software-raids etc. It is very easy to mirror the *complete* disk from one *server* to another. I use this technic for customers which need cheap backups of their complete server. But a RAID card will be much faster than this. I just wanted to make this clear. Greetings, Torsten From greg@2ndQuadrant.com Fri Jul 27 05:25:01 2012 Received: from magus.postgresql.org (magus.postgresql.org [87.238.57.229]) by mail.postgresql.org (Postfix) with ESMTP id E45621A8BC81 for ; Fri, 27 Jul 2012 02:25:01 -0300 (ADT) Received: from moutng.kundenserver.de ([212.227.17.10]) by magus.postgresql.org with esmtp (Exim 4.72) (envelope-from ) id 1Sud2n-00010i-W0 for pgsql-performance@postgresql.org; Fri, 27 Jul 2012 05:25:00 +0000 Received: from [192.168.2.118] (mail.highperformancepostgresql.com [71.179.240.8]) by mrelayeu.kundenserver.de (node=mreu4) with ESMTP (Nemesis) id 0MfNr4-1T9ZQ13IHC-00OofM; Fri, 27 Jul 2012 07:24:44 +0200 Message-ID: <5012261A.8040007@2ndQuadrant.com> Date: Fri, 27 Jul 2012 01:24:42 -0400 From: Greg Smith User-Agent: Mozilla/5.0 (X11; U; Linux x86_64; en-US; rv:1.9.2.24) Gecko/20111120 Icedove/3.1.16 MIME-Version: 1.0 To: Laszlo Nagy CC: pgsql-performance@postgresql.org Subject: Re: ZFS vs. UFS References: <500E9A3B.3070609@shopzeus.com> In-Reply-To: <500E9A3B.3070609@shopzeus.com> Content-Type: multipart/alternative; boundary="------------020600070505020006010301" X-Provags-ID: V02:K0:wexq4yJ4USnt93MFaDuXKjGLXZ3o0cExkRHqYs11HCa WBWkwVfrKWwhD6V3rPyKSz/bQpvPDycTJEytCW24lMRpLe1K/G 8DfSy5WsLPJBr0SccHCm9T8B3REQ/mHL+yDrSuXVRT5OW5L9CQ oxG5POo3QC/PX3thaD1MkhMWiZs9OyQubXuZadfd52kfzrf2As M/sHjQ9kPaf1sSWjAxd6AxL7MvIzHOxQrteQlBrUotCVFP24g5 jUXAIn7cZyZD/aSBwrYG79t0j+cMAM3pLP8cOskrD5IzwqSGRD iC3Ufvh60QOk4Qoc7hBS9SAu+cjig4LvqORxBzffxelOIS6G/s J/hq7mDfCAtGFuNtV2zk= X-Pg-Spam-Score: -1.9 (-) X-Archive-Number: 201207/344 X-Sequence-Number: 47525 This is a multi-part message in MIME format. --------------020600070505020006010301 Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit On 07/24/2012 08:51 AM, Laszlo Nagy wrote: > Under FreeBSD 9, what filesystem should I use for PostgreSQL? (Dell > PowerEdge 2900, 24G mem, 10x2T SATA2 disk, Intel RAID controller.) When Intel RAID controller is that? All of the ones on the motherboard are pretty much useless if that's what you have. Those are slower than software RAID and it's going to add driver issues you could otherwise avoid. Better to connect the drives to the non-RAID ports or configure the controller in JBOD mode first. Using one of the better RAID controllers, one of Dell's good PERC models for example, is one of the biggest hardware upgrades you could make to this server. If your database is mostly read traffic, it won't matter very much. Write-heavy loads really benefit from a good RAID controller's write cache. > * ZFS is journaled, and it is more independent of the hardware. So > if the computer goes wrong, I can move the zfs array to a > different server. > * UFS is not journaled. Also I have to rely on the RAID card to > build the RAID array. If there is a hw problem with it, then I > won't be able to recover the data easily. > You should be able to get UFS working with a software mirror and journaling using gstripe/gmirror or vinum. It doesn't matter that much for PostgreSQL though. The data writes are journaled by the database, and it tries to sync data to disk after updating metadata too. There are plenty of PostgreSQL installs on FreeBSD/UFS that work fine. ZFS needs more RAM and has higher CPU overhead than UFS does. It's a heavier filesystem all around than UFS is. Your server is fast enough that you should be able to afford it though, and the feature set is nice. In addition to the RAID setup being simple to handle, having checksums on your data is a good safety feature for PostgreSQL. ZFS will heavily use server RAM for caching by default, much more so than UFS. Make sure you check into that, and leave enough RAM for the database to run too. (Doing *some* caching that way is good for Postgres; you just don't want *all* the memory to be used for that) Moving disks to another server is a very low probability fix for a broken system. The disks are a likely place for the actual failure to happen at in the first place. I like to think more in terms of "how can I create a real-time replica of this data?" to protect databases, and the standby server for that doesn't need to be an expensive system. That said, there is no reason to set things up so that they only work with that Intel RAID controller, given that it's not a very good piece of hardware anyway. -- Greg Smith 2ndQuadrant US greg@2ndQuadrant.com Baltimore, MD PostgreSQL Training, Services, and 24x7 Support www.2ndQuadrant.com --------------020600070505020006010301 Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit On 07/24/2012 08:51 AM, Laszlo Nagy wrote:
Under FreeBSD 9, what filesystem should I use for PostgreSQL? (Dell PowerEdge 2900, 24G mem, 10x2T SATA2 disk, Intel RAID controller.)

When Intel RAID controller is that?  All of the ones on the motherboard are pretty much useless if that's what you have.  Those are slower than software RAID and it's going to add driver issues you could otherwise avoid.  Better to connect the drives to the non-RAID ports or configure the controller in JBOD mode first.

Using one of the better RAID controllers, one of Dell's good PERC models for example, is one of the biggest hardware upgrades you could make to this server.  If your database is mostly read traffic, it won't matter very much.  Write-heavy loads really benefit from a good RAID controller's write cache.

  • ZFS is journaled, and it is more independent of the hardware. So if the computer goes wrong, I can move the zfs array to a different server.
  • UFS is not journaled. Also I have to rely on the RAID card to build the RAID array. If there is a hw problem with it, then I won't be able to recover the data easily.

You should be able to get UFS working with a software mirror and journaling using gstripe/gmirror or vinum.  It doesn't matter that much for PostgreSQL though.  The data writes are journaled by the database, and it tries to sync data to disk after updating metadata too.  There are plenty of PostgreSQL installs on FreeBSD/UFS that work fine.

ZFS needs more RAM and has higher CPU overhead than UFS does.  It's a heavier filesystem all around than UFS is.  Your server is fast enough that you should be able to afford it though, and the feature set is nice.  In addition to the RAID setup being simple to handle, having checksums on your data is a good safety feature for PostgreSQL. 

ZFS will heavily use server RAM for caching by default, much more so than UFS.  Make sure you check into that, and leave enough RAM for the database to run too.  (Doing *some* caching that way is good for Postgres; you just don't want *all* the memory to be used for that)

Moving disks to another server is a very low probability fix for a broken system.  The disks are a likely place for the actual failure to happen at in the first place.  I like to think more in terms of "how can I create a real-time replica of this data?" to protect databases, and the standby server for that doesn't need to be an expensive system.  That said, there is no reason to set things up so that they only work with that Intel RAID controller, given that it's not a very good piece of hardware anyway.

-- 
Greg Smith   2ndQuadrant US    greg@2ndQuadrant.com   Baltimore, MD
PostgreSQL Training, Services, and 24x7 Support www.2ndQuadrant.com
--------------020600070505020006010301-- From gandalf@shopzeus.com Tue Jul 31 08:50:33 2012 Received: from magus.postgresql.org (magus.postgresql.org [87.238.57.229]) by mail.postgresql.org (Postfix) with ESMTP id 8A7A76576E for ; Tue, 31 Jul 2012 05:50:33 -0300 (ADT) Received: from 10610.x.rootbsd.net ([204.109.60.69] helo=vps001.shopzeus.com) by magus.postgresql.org with esmtp (Exim 4.72) (envelope-from ) id 1Sw89u-0002fj-1J for pgsql-performance@postgresql.org; Tue, 31 Jul 2012 08:50:32 +0000 Received: from [192.168.1.105] (localhost [127.0.0.1]) by vps001.shopzeus.com (8.14.3/8.14.3) with ESMTP id q6V8oE6E048767; Tue, 31 Jul 2012 04:50:15 -0400 (EDT) (envelope-from gandalf@shopzeus.com) Message-ID: <50179C43.5030607@shopzeus.com> Date: Tue, 31 Jul 2012 10:50:11 +0200 From: Laszlo Nagy User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:14.0) Gecko/20120714 Thunderbird/14.0 MIME-Version: 1.0 To: Greg Smith CC: pgsql-performance@postgresql.org Subject: Re: ZFS vs. UFS References: <500E9A3B.3070609@shopzeus.com> <5012261A.8040007@2ndQuadrant.com> In-Reply-To: <5012261A.8040007@2ndQuadrant.com> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-Pg-Spam-Score: -1.9 (-) X-Archive-Number: 201207/356 X-Sequence-Number: 47537 > When Intel RAID controller is that? All of the ones on the > motherboard are pretty much useless if that's what you have. Those are > slower than software RAID and it's going to add driver issues you > could otherwise avoid. Better to connect the drives to the non-RAID > ports or configure the controller in JBOD mode first. > > Using one of the better RAID controllers, one of Dell's good PERC > models for example, is one of the biggest hardware upgrades you could > make to this server. If your database is mostly read traffic, it > won't matter very much. Write-heavy loads really benefit from a good > RAID controller's write cache. Actually, it is a PERC with write-cache and BBU. > > ZFS will heavily use server RAM for caching by default, much more so > than UFS. Make sure you check into that, and leave enough RAM for the > database to run too. (Doing *some* caching that way is good for > Postgres; you just don't want *all* the memory to be used for that) Right now, the size of the database is below 5GB. So I guess it will fit into memory. I'm concerned about data safety and availability. I have been in a situation where the RAID card went wrong and I was not able to recover the data because I could not get an identical RAID card in time. I have also been in a situation where the system was crashing two times a day, and we didn't know why. (As it turned out, it was a bug in the "stable" kernel and we could not identify this for two weeks.) However, we had to do fsck after every crash. With a 10TB disk array, it was extremely painful. ZFS is much better: short recovery time and it is RAID card independent. So I think I have answered my own question - I'm going to use ZFS to have better availability, even if it leads to poor performance. (That was the original question: how bad it it to use ZFS for PostgreSQL, instead of the native UFS.) > > Moving disks to another server is a very low probability fix for a > broken system. The disks are a likely place for the actual failure to > happen at in the first place. Yes, but we don't have to worry about that. raidz2 + hot spare is safe enough. The RAID card is the only single point of failure. > I like to think more in terms of "how can I create a real-time replica > of this data?" to protect databases, and the standby server for that > doesn't need to be an expensive system. That said, there is no reason > to set things up so that they only work with that Intel RAID > controller, given that it's not a very good piece of hardware anyway. I'm not sure how to create a real-time replica. This database is updated frequently. There is always a process that reads/writes into the database. I was thinking about using slony to create slave databases. I have no experience with that. We have a 100Mbit connection. I'm not sure how much bandwidth we need to maintain a real-time slave database. It might be a good idea. I'm sorry, I feel I'm being off-topic. From cjames@emolecules.com Tue Jul 31 14:33:45 2012 Received: from makus.postgresql.org (makus.postgresql.org [98.129.198.125]) by mail.postgresql.org (Postfix) with ESMTP id A1C906576E for ; Tue, 31 Jul 2012 11:33:45 -0300 (ADT) Received: from mail-yx0-f174.google.com ([209.85.213.174]) by makus.postgresql.org with esmtp (Exim 4.72) (envelope-from ) id 1SwDW3-00046l-4s for pgsql-performance@postgresql.org; Tue, 31 Jul 2012 14:33:44 +0000 Received: by yenl2 with SMTP id l2so6100663yen.19 for ; Tue, 31 Jul 2012 07:33:29 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type:x-gm-message-state; bh=VAP3iRXpsOWFuvlvNWbmEBwdTEI5EHiTOv0o0aD5zJo=; b=ehRxN/6fTB03dNrOcoSj04RvhX7vuWG/PRax4pBmTmXL6wPo/6cWYEUkVY7ppm327p lDwRYlQLk3cE0f38H04Drm6LfbKPG9PSKvShtp3k5z6JU4Z8pAxFo8gf8OUBjI8sF4Sv JtT8CTJg7muLt0KbFFUBahq6NfP+5br2KkjR4x9+B/x0hsFRzYNDMpbYSHptLY8Qxipm 6CsVvFFFMcXoQRxM0zT0HSoBFViq5VGkFWd44nkbhVrR/TmTRpYKUjEfQemJf5fpdGMA 9B/llehgxzKBGHvDSyVNCDuhAqbuVVD1Cq1eTy7gkvnzawqJ8VjJwCTAewqxUUzK7o1g djng== MIME-Version: 1.0 Received: by 10.182.37.41 with SMTP id v9mr23882247obj.23.1343745209421; Tue, 31 Jul 2012 07:33:29 -0700 (PDT) Received: by 10.182.214.6 with HTTP; Tue, 31 Jul 2012 07:33:29 -0700 (PDT) In-Reply-To: <50179C43.5030607@shopzeus.com> References: <500E9A3B.3070609@shopzeus.com> <5012261A.8040007@2ndQuadrant.com> <50179C43.5030607@shopzeus.com> Date: Tue, 31 Jul 2012 07:33:29 -0700 Message-ID: Subject: Re: ZFS vs. UFS From: Craig James To: Laszlo Nagy Cc: Greg Smith , pgsql-performance@postgresql.org Content-Type: multipart/alternative; boundary=14dae939969be04f7a04c6210f6e X-Gm-Message-State: ALoCoQnAFRy9fTbuTCUVOVatpFkW0A2YOJpgsQzMhUvQehZTQsb7pHugFftyFDkIqdZH9g2lNLgT X-Pg-Spam-Score: -2.6 (--) X-Archive-Number: 201207/357 X-Sequence-Number: 47538 --14dae939969be04f7a04c6210f6e Content-Type: text/plain; charset=ISO-8859-1 On Tue, Jul 31, 2012 at 1:50 AM, Laszlo Nagy wrote: > > When Intel RAID controller is that? All of the ones on the motherboard >> are pretty much useless if that's what you have. Those are slower than >> software RAID and it's going to add driver issues you could otherwise >> avoid. Better to connect the drives to the non-RAID ports or configure the >> controller in JBOD mode first. >> >> Using one of the better RAID controllers, one of Dell's good PERC models >> for example, is one of the biggest hardware upgrades you could make to this >> server. If your database is mostly read traffic, it won't matter very >> much. Write-heavy loads really benefit from a good RAID controller's write >> cache. >> > Actually, it is a PERC with write-cache and BBU. > Last time I checked, "PERC" was a meaningless name. Dell put that label on a variety of different controllers ... some were quite good, some were terrible. The latest PERC controllers are pretty good. If your machine is a few years old, the PERC controller may be a piece of junk. Craig > >> ZFS will heavily use server RAM for caching by default, much more so than >> UFS. Make sure you check into that, and leave enough RAM for the database >> to run too. (Doing *some* caching that way is good for Postgres; you just >> don't want *all* the memory to be used for that) >> > Right now, the size of the database is below 5GB. So I guess it will fit > into memory. I'm concerned about data safety and availability. I have been > in a situation where the RAID card went wrong and I was not able to recover > the data because I could not get an identical RAID card in time. I have > also been in a situation where the system was crashing two times a day, and > we didn't know why. (As it turned out, it was a bug in the "stable" kernel > and we could not identify this for two weeks.) However, we had to do fsck > after every crash. With a 10TB disk array, it was extremely painful. ZFS is > much better: short recovery time and it is RAID card independent. So I > think I have answered my own question - I'm going to use ZFS to have better > availability, even if it leads to poor performance. (That was the original > question: how bad it it to use ZFS for PostgreSQL, instead of the native > UFS.) > >> >> Moving disks to another server is a very low probability fix for a broken >> system. The disks are a likely place for the actual failure to happen at >> in the first place. >> > Yes, but we don't have to worry about that. raidz2 + hot spare is safe > enough. The RAID card is the only single point of failure. > >> I like to think more in terms of "how can I create a real-time replica of >> this data?" to protect databases, and the standby server for that doesn't >> need to be an expensive system. That said, there is no reason to set >> things up so that they only work with that Intel RAID controller, given >> that it's not a very good piece of hardware anyway. >> > I'm not sure how to create a real-time replica. This database is updated > frequently. There is always a process that reads/writes into the database. > I was thinking about using slony to create slave databases. I have no > experience with that. We have a 100Mbit connection. I'm not sure how much > bandwidth we need to maintain a real-time slave database. It might be a > good idea. > > I'm sorry, I feel I'm being off-topic. > > -- > Sent via pgsql-performance mailing list (pgsql-performance@postgresql.** > org ) > To make changes to your subscription: > http://www.postgresql.org/**mailpref/pgsql-performance > --14dae939969be04f7a04c6210f6e Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable

On Tue, Jul 31, 2012 at 1:50 AM, Laszlo = Nagy <gandalf@shopzeus.com> wrote:

When Intel RAID controller is that? =A0All of the ones on the motherboard a= re pretty much useless if that's what you have. Those are slower than s= oftware RAID and it's going to add driver issues you could otherwise av= oid. =A0Better to connect the drives to the non-RAID ports or configure the= controller in JBOD mode first.

Using one of the better RAID controllers, one of Dell's good PERC model= s for example, is one of the biggest hardware upgrades you could make to th= is server. =A0If your database is mostly read traffic, it won't matter = very much. =A0Write-heavy loads really benefit from a good RAID controller&= #39;s write cache.
Actually, it is a PERC with write-cache and BBU.

L= ast time I checked, "PERC" was a meaningless name.=A0 Dell put th= at label on a variety of different controllers ... some were quite good, so= me were terrible.=A0 The latest PERC controllers are pretty good.=A0 If you= r machine is a few years old, the PERC controller may be a piece of junk.
Craig
=A0

ZFS will heavily use server RAM for caching by default, much more so than U= FS. =A0Make sure you check into that, and leave enough RAM for the database= to run too. =A0(Doing *some* caching that way is good for Postgres; you ju= st don't want *all* the memory to be used for that)
Right now, the size of the database is below 5GB. So I guess it will fit in= to memory. I'm concerned about data safety and availability. I have bee= n in a situation where the RAID card went wrong and I was not able to recov= er the data because I could not get an identical RAID card in time. I have = also been in a situation where the system was crashing two times a day, and= we didn't know why. (As it turned out, it was a bug in the "stabl= e" kernel and we could not identify this for two weeks.) However, we h= ad to do fsck after every crash. With a 10TB disk array, it was extremely p= ainful. ZFS is much better: short recovery time and it is RAID card indepen= dent. So I think I have answered my own question - I'm going to use ZFS= to have better availability, even if it leads to poor performance. (That w= as the original question: how bad it it to use ZFS for PostgreSQL, instead = of the native UFS.)

Moving disks to another server is a very low probability fix for a broken s= ystem. =A0The disks are a likely place for the actual failure to happen at = in the first place.
Yes, but we don't have to worry about that. raidz2 + hot spare is safe = enough. The RAID card is the only single point of failure.
I like to think more in terms of "how can I create a real-time replica= of this data?" to protect databases, and the standby server for that = doesn't need to be an expensive system. =A0That said, there is no reaso= n to set things up so that they only work with that Intel RAID controller, = given that it's not a very good piece of hardware anyway.
I'm not sure how to create a real-time replica. This database is update= d frequently. There is always a process that reads/writes into the database= . I was thinking about using slony to create slave databases. I have no exp= erience with that. We have a 100Mbit connection. I'm not sure how much = bandwidth we need to maintain a real-time slave database. It might be a goo= d idea.

I'm sorry, I feel I'm being off-topic.

--
Sent via pgsql-performance mailing list (pgsql-performance@postgresql.org= )
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-performance

--14dae939969be04f7a04c6210f6e--