Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtp (Exim 4.80) (envelope-from ) id 1VZkj8-00031w-AY for pgsql-admin@arkaria.postgresql.org; Fri, 25 Oct 2013 16:59:11 +0000 Received: from localhost ([127.0.0.1] helo=postgresql.org) by malur.postgresql.org with smtp (Exim 4.80) (envelope-from ) id 1VZkj6-0005UZ-ML for pgsql-admin@arkaria.postgresql.org; Fri, 25 Oct 2013 16:59:08 +0000 Received: from magus.postgresql.org ([2a02:c0:301:0:ffff::29]) by malur.postgresql.org with esmtp (Exim 4.80) (envelope-from ) id 1VZjhy-0002Nm-Iw for pgsql-admin@postgresql.org; Fri, 25 Oct 2013 15:53:54 +0000 Received: from nm3-vm4.bullet.mail.sg3.yahoo.com ([106.10.148.115]) by magus.postgresql.org with esmtp (Exim 4.80) (envelope-from ) id 1VZjhp-0005ZN-Or for pgsql-admin@postgresql.org; Fri, 25 Oct 2013 15:53:53 +0000 Received: from [106.10.166.113] by nm3.bullet.mail.sg3.yahoo.com with NNFMP; 25 Oct 2013 15:53:43 -0000 Received: from [106.10.151.154] by tm2.bullet.mail.sg3.yahoo.com with NNFMP; 25 Oct 2013 15:53:43 -0000 Received: from [127.0.0.1] by omp1008.mail.sg3.yahoo.com with NNFMP; 25 Oct 2013 15:53:43 -0000 X-Yahoo-Newman-Property: ymail-3 X-Yahoo-Newman-Id: 205449.31148.bm@omp1008.mail.sg3.yahoo.com Received: (qmail 14394 invoked by uid 60001); 25 Oct 2013 15:53:42 -0000 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com.hk; s=s1024; t=1382716422; bh=rOunw42EwGWlsKNt/t4UuPfDgQwOxQNSdtxU6YTYDfo=; h=X-YMail-OSG:Received:X-Rocket-MIMEInfo:X-Mailer:References:Message-ID:Date:From:Reply-To:Subject:To:Cc:In-Reply-To:MIME-Version:Content-Type; b=v30trmo0cshy5r/n7Fpk/FBT/r4Eo0enyjIReA2jIrjlWJmey2a/H2jbWLvS5zrUuDbC9i0ZRlzOqjm9vlIEjJMcjDVcp+qbz0sLOSX2I6/DyWWrCWXxCEsUL0J27HX73tZtfS7GaKdZY9E/H2rAKX0lnvaHIfIjBqcS1VxcrTI= DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=s1024; d=yahoo.com.hk; h=X-YMail-OSG:Received:X-Rocket-MIMEInfo:X-Mailer:References:Message-ID:Date:From:Reply-To:Subject:To:Cc:In-Reply-To:MIME-Version:Content-Type; b=VI/e5PhO/3YJpA3EFPOtNpGEunl8J5Ej3nTBYZPOBIBhtYlACIhhnu5F8j9p1NeOkI1ufF5kDdhKD/co2qfXiY5zMmySHHU8hFeV3nK+2LtzkR0taUvIxFcPS2e6PR5bX11wHAu9FzKGJAwzQGrJumILLs648E/JCa7GJVhBMi8=; X-YMail-OSG: x7TykDAVM1lr0gHra6Mhqd7bGnqiFrsnOfXFcXMUxxothsy 5q.6Iz9dhLxQFZ8QVjeYkqTltcW_sbxpJseJbb0I5bCTf050s0tmlgUOuHgv PMxp_Nc8KhScAAdPZObHi8_hoH9ZYB4y4S8smlKbssrkx.AfD45gpaFTaMHz e0N9jFCc2S1mqlB38cSHNXjYcrfzIFHsaKcLvZQXzSuk3slB2KzzsoNiXTKf LamAzrY.joW9mhoY1lcBepvWKUIrORApq2.HwdM7Vb.U_5rC_AYrReo3QsFr rqNRwoxEZsCV0H433gaktvvRdK56lsipfNLAWz8hapu6HiqAYZZosSGbNFtQ xONk77KymhDCnkbPGLnwFDY7WGzXkD2FJpw2uM_X_QtgQ7IxaT6KA2PSSS_9 vwVNLxH2h2ZjF7ZC.ODBoxjCW76IKvnUCwuRJdYoS74eh3nzVEJj1G.Ri.KW vQyI43zHqEo7Mr4IdydLfWF0R2ytfCGm.7Ef3Fxlb21Cl.snvjVJ4arklw1h giBLUX7N0fF6E.KAr8dPTMxFzQp184NLLe8.hWTPZhCNfUbndIYNvZCDyzQF Luwhn3W91iqhaMA-- Received: from [61.15.240.133] by web193504.mail.sg3.yahoo.com via HTTP; Fri, 25 Oct 2013 23:53:42 SGT X-Rocket-MIMEInfo: 002.001, PiBJIHdvdWxkIGFsc28gcmVjb21tZW5kIHRvIHVzZSA0SyBzZWN0b3Igc2l6ZSB1c2luZwpnbm9wIGFuZCB6cG9vbCBleHBvcnQvaW1wb3J0LgoKQWdyZWUsIGluIG15IHNtYWxsIHNldHVwLCA0SyBzZWN0b3JzIGFuZCBhbGlnbmVkIHBhcnRpdGlvbiBjYW4gYmUgc2V2ZW4gb3IgZWlnaHQgdGltZXMgZmFzdGVyIHRoYW4gNTEya2Igc2VjdG9ycyB3aGVuIHRoZSBoYXJkZGlzayBpcyBpbiBhZHZhbmNlIGZvcm1hdCAoNGtiIHBlciBzZWN0b3JzKQoKQWxzbyBzdWdnZXN0IHRvIGhhdmUgdHdvIHNlcGFydGUgZmEBMAEBAQE- X-Mailer: YahooMailWebService/0.8.160.587 References: <20131023162545.GA19794@pcjas.obspm.fr> <1382548465.32073.37624113.6AA8DB42@webmail.messagingengine.com> <52683855.6060609@gmx.net> Message-ID: <1382716422.13782.YahooMailNeo@web193504.mail.sg3.yahoo.com> Date: Fri, 25 Oct 2013 23:53:42 +0800 (SGT) From: Patrick Dung Reply-To: Patrick Dung Subject: Re: ZFS-FreeBSD + postgresql performance To: "Ivailo.TANUSHEFF@raiffeisen.bg" , Michael Schmiedgen Cc: Albert Shih , Mark Felder , "freebsd-fs@freebsd.org" , "freebsd-jail@freebsd.org" , "owner-freebsd-fs@freebsd.org" , "pgsql-admin@postgresql.org" In-Reply-To: MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="-2135349674-469363827-1382716422=:13782" X-Pg-Spam-Score: -2.0 (--) List-Archive: List-Help: List-ID: List-Owner: List-Post: List-Subscribe: List-Unsubscribe: X-Mailing-List: pgsql-admin Precedence: bulk Sender: pgsql-admin-owner@postgresql.org ---2135349674-469363827-1382716422=:13782 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable > I would also recommend to use 4K sector size using=0Agnop and zpool expor= t/import.=0A=0AAgree, in my small setup, 4K sectors and aligned partition c= an be seven or eight times faster than 512kb sectors when the harddisk is i= n advance format (4kb per sectors)=0A=0AAlso suggest to have two separte fa= st SSD (in mirror mode) for the ZIL.=0AThis is to avoid ZFS file system fra= gmentation when the ZIL is stored intent with the ZFS.=0A=0APatrick=0A=0A= =0A=0A=0AOn Thursday, October 24, 2013 10:18 PM, "Ivailo.TANUSHEFF@raiffeis= en.bg" wrote:=0A =0Aowner-freebsd-fs@freeb= sd.org wrote on 23.10.2013 23:57:57:=0A=0A> From:=0A> =0A> Michael Schmiedg= en =0A> =0A> To:=0A> =0A> Mark Felder , Albert Shih , =0A> pgsql-admin@postgresql.org, fre= ebsd-fs@freebsd.org, freebsd-jail@freebsd.org, =0A> =0A> Date:=0A> =0A> 23.= 10.2013 23:58=0A> =0A> Subject:=0A> =0A> Re: ZFS-FreeBSD + postgresql perfo= rmance=0A> =0A> Sent by:=0A> =0A> owner-freebsd-fs@freebsd.org=0A> =0A> On = 10/23/13 19:14, Mark Felder wrote:=0A> > On Wed, Oct 23, 2013, at 11:25, Al= bert Shih wrote:=0A> >> My question is about the performance, I known ZFS e= at all=0Amemory he can=0A> >> have (or almost), so what append when we run = database like=0Apostgresql and=0A> >> jail ? (it's also the reason of 96 Go= ram).=0A> >>=0A> >> Sorry for cross-posting but it's about 3 differents th= ings....=0A> >>=0A> >=0A> > To my understanding the solution is to change t= he primarycache=0Ato=0A> > "metadata" for any ZFS filesystem that you do no= t want=0AZFS to heavily=0A> > cache in memory.=0A> >=0A> > Example:=0A> >= =0A> > # zfs set primarycache=3Dmetadata tank/usr/local/pgsql=0A> =0A> In a= ddition to this it is recommended to set the recordsize=0A> to the fixed va= lue of 8k on dataset creation.=0A> =0A> Michael=0A> =0A=0AI would also reco= mmend to use 4K sector size using=0Agnop and zpool export/import.=0AI agree= that using fixed recordsize is a must when=0Ayou have databases and you ha= ve DB on each jail.=0AAlso there are a bunch of sysctl parameters you may= =0Awant to play with, mostly about tuning the memory usage.=0A=0AAlso it mi= ght be an idea to use partitions on disks=0Aand:=0A1. Use first 1-2G on eac= h disk for swap (just in case).=0A2. Use the rest of the disk for 4K aligne= d and 4K=0Asector size partition, labelled in some way (I use disk ID as la= bel, for=0Aeasy identification).=0A=0ABest regards,=0AIvailo Tanusheff=0A= =0A=0A=0ADISCLAIMER: The contents of this e-mail are intended for the named= addressee only. It contains information that may be privileged and/or conf= idential. Unless you are the named addressee or an authorized designee, you= may not copy or use it, or disclose it to anyone else. If you received it = in error please notify us immediately and then destroy it. Messages transpo= rted over the public Internet are susceptible to alteration. Raiffeisenbank= (Bulgaria) EAD, Raiffeisen Asset Management (Bulgaria) EAD, Raiffeisen Ins= urance Broker EOOD, Raiffeisen Services EAD, Raiffeisen Leasing Bulgaria OO= D, Raiffeisen Auto Leasing Bulgaria EOOD and Raiffeisen Real Estate EOOD sh= all not be liable for the message if altered, changed or falsified. =0A=0A= =D0=9E=D0=93=D0=A0=D0=90=D0=9D=D0=98=D0=A7=D0=95=D0=9D=D0=98=D0=95 =D0=9D= =D0=90 =D0=9E=D0=A2=D0=93=D0=9E=D0=92=D0=9E=D0=A0=D0=9D=D0=9E=D0=A1=D0=A2= =D0=A2=D0=90: =D0=A1=D1=8A=D0=B4=D1=8A=D1=80=D0=B6=D0=B0=D0=BD=D0=B8=D0=B5= =D1=82=D0=BE =D0=BD=D0=B0 =D1=82=D0=BE=D0=B2=D0=B0 =D0=B5=D0=BB=D0=B5=D0=BA= =D1=82=D1=80=D0=BE=D0=BD=D0=BD=D0=BE =D1=81=D1=8A=D0=BE=D0=B1=D1=89=D0=B5= =D0=BD=D0=B8=D0=B5 =D0=B5 =D0=BF=D1=80=D0=B5=D0=B4=D0=BD=D0=B0=D0=B7=D0=BD= =D0=B0=D1=87=D0=B5=D0=BD=D0=BE =D0=B5=D0=B4=D0=B8=D0=BD=D1=81=D1=82=D0=B2= =D0=B5=D0=BD=D0=BE =D0=B7=D0=B0 =D0=BF=D0=BE=D1=81=D0=BE=D1=87=D0=B5=D0=BD= =D0=B8=D1=8F =D0=BF=D0=BE=D0=BB=D1=83=D1=87=D0=B0=D1=82=D0=B5=D0=BB. =D0=A1= =D1=8A=D0=BE=D0=B1=D1=89=D0=B5=D0=BD=D0=B8=D0=B5=D1=82=D0=BE =D1=81=D1=8A= =D0=B4=D1=8A=D1=80=D0=B6=D0=B0 =D0=B8=D0=BD=D1=84=D0=BE=D1=80=D0=BC=D0=B0= =D1=86=D0=B8=D1=8F, =D0=BA=D0=BE=D1=8F=D1=82=D0=BE =D0=BC=D0=BE=D0=B6=D0=B5= =D0=B4=D0=B0 =D0=B1=D1=8A=D0=B4=D0=B5 =D0=BF=D1=80=D0=B5=D0=B4=D0=BD=D0=B0= =D0=B7=D0=BD=D0=B0=D1=87=D0=B5=D0=BD=D0=B0 =D0=B7=D0=B0 =D0=BE=D0=B3=D1=80= =D0=B0=D0=BD=D0=B8=D1=87=D0=B5=D0=BD=D0=BE =D0=BF=D0=BE=D0=BB=D0=B7=D0=B2= =D0=B0=D0=BD=D0=B5 =D0=B8/=D0=B8=D0=BB=D0=B8 =D0=BF=D0=BE=D0=B2=D0=B5=D1=80= =D0=B8=D1=82=D0=B5=D0=BB=D0=BD=D0=B0. =D0=92 =D1=81=D0=BB=D1=83=D1=87=D0=B0= =D0=B9 =D1=87=D0=B5 =D0=BD=D0=B5 =D1=81=D1=82=D0=B5 =D1=83=D0=BA=D0=B0=D0= =B7=D0=B0=D0=BD=D0=B8=D1=8F =D0=BF=D0=BE=D0=BB=D1=83=D1=87=D0=B0=D1=82=D0= =B5=D0=BB =D0=BD=D0=B0 =D1=82=D0=BE=D0=B2=D0=B0 =D1=81=D1=8A=D0=BE=D0=B1=D1= =89=D0=B5=D0=BD=D0=B8=D0=B5 =D0=B8=D0=BB=D0=B8 =D0=BD=D0=B5=D0=B3=D0=BE=D0= =B2 =D0=BE=D1=82=D0=BE=D1=80=D0=B8=D0=B7=D0=B8=D1=80=D0=B0=D0=BD =D0=BF=D1= =80=D0=B5=D0=B4=D1=81=D1=82=D0=B0=D0=B2=D0=B8=D1=82=D0=B5=D0=BB, =D0=BD=D1= =8F=D0=BC=D0=B0=D1=82=D0=B5 =D0=BF=D1=80=D0=B0=D0=B2=D0=BE =D0=B4=D0=B0 =D0= =B3=D0=BE =D0=BA=D0=BE=D0=BF=D0=B8=D1=80=D0=B0=D1=82=D0=B5 =D0=B8=D0=BB=D0= =B8 =D0=B8=D0=B7=D0=BF=D0=BE=D0=BB=D0=B7=D0=B2=D0=B0=D1=82=D0=B5, =D0=BA=D0= =B0=D0=BA=D1=82=D0=BE =D0=B8 =D0=B4=D0=B0 =D1=80=D0=B0=D0=B7=D0=BA=D1=80=D0= =B8=D0=B2=D0=B0=D1=82=D0=B5 =D1=81=D1=8A=D0=B4=D1=8A=D1=80=D0=B6=D0=B0=D0= =BD=D0=B8=D0=B5=D1=82=D0=BE =D0=BC=D1=83 =D0=BF=D1=80=D0=B5=D0=B4 =D1=82=D1= =80=D0=B5=D1=82=D0=B8 =D0=BB=D0=B8=D1=86=D0=B0. =D0=90=D0=BA=D0=BE =D1=81= =D1=82=D0=B5 =D0=B3=D0=BE =D0=BF=D0=BE=D0=BB=D1=83=D1=87=D0=B8=D0=BB=D0=B8 = =D0=BF=D0=BE =D0=B3=D1=80=D0=B5=D1=88=D0=BA=D0=B0, =D0=BC=D0=BE=D0=BB=D1=8F= =D0=B4=D0=B0 =D1=83=D0=B2=D0=B5=D0=B4=D0=BE=D0=BC=D0=B8=D1=82=D0=B5 =D0=BF= =D0=BE=D0=B4=D0=B0=D1=82=D0=B5=D0=BB=D1=8F =D0=BD=D0=B5=D0=B7=D0=B0=D0=B1= =D0=B0=D0=B2=D0=BD=D0=BE =D0=B8 =D0=B4=D0=B0 =D0=B8=D0=B7=D1=82=D1=80=D0=B8= =D0=B5=D1=82=D0=B5 =D1=82=D0=BE=D0=B2=D0=B0 =D1=81=D1=8A=D0=BE=D0=B1=D1=89= =D0=B5=D0=BD=D0=B8=D0=B5 =D0=BE=D1=82 =D1=81=D0=B8=D1=81=D1=82=D0=B5=D0=BC=D0=B0=D1=82=D0=B0. =D0=95=D0=BB=D0=B5= =D0=BA=D1=82=D1=80=D0=BE=D0=BD=D0=BD=D0=B8=D1=82=D0=B5 =D1=81=D1=8A=D0=BE= =D0=B1=D1=89=D0=B5=D0=BD=D0=B8=D1=8F, =D1=80=D0=B0=D0=B7=D0=BF=D1=80=D0=BE= =D1=81=D1=82=D1=80=D0=B0=D0=BD=D1=8F=D0=B2=D0=B0=D0=BD=D0=B8 =D0=BF=D0=BE = =D0=98=D0=BD=D1=82=D0=B5=D1=80=D0=BD=D0=B5=D1=82 =D0=BC=D0=BE=D0=B3=D0=B0= =D1=82 =D0=B4=D0=B0 =D0=B1=D1=8A=D0=B4=D0=B0=D1=82 =D0=BF=D1=80=D0=BE=D0=BC= =D0=B5=D0=BD=D1=8F=D0=BD=D0=B8. =D0=A0=D0=B0=D0=B9=D1=84=D0=B0=D0=B9=D0=B7= =D0=B5=D0=BD=D0=B1=D0=B0=D0=BD=D0=BA (=D0=91=D1=8A=D0=BB=D0=B3=D0=B0=D1=80= =D0=B8=D1=8F) =D0=95=D0=90=D0=94, =D0=A0=D0=B0=D0=B9=D1=84=D0=B0=D0=B9=D0= =B7=D0=B5=D0=BD =D0=90=D1=81=D0=B5=D1=82 =D0=9C=D0=B5=D0=BD=D0=B8=D0=B4=D0= =B6=D0=BC=D1=8A=D0=BD=D1=82 (=D0=91=D1=8A=D0=BB=D0=B3=D0=B0=D1=80=D0=B8=D1= =8F) =D0=95=D0=90=D0=94, =D0=A0=D0=B0=D0=B9=D1=84=D0=B0=D0=B9=D0=B7=D0=B5= =D0=BD =D0=97=D0=B0=D1=81=D1=82=D1=80=D0=B0=D1=85=D0=BE=D0=B2=D0=B0=D1=82= =D0=B5=D0=BB=D0=B5=D0=BD =D0=91=D1=80=D0=BE=D0=BA=D0=B5=D1=80 =D0=95=D0=9E= =D0=9E=D0=94, =D0=A0=D0=B0=D0=B9=D1=84=D0=B0=D0=B9=D0=B7=D0=B5=D0=BD =D0=A1= =D1=8A=D1=80=D0=B2=D0=B8=D1=81=D0=B8=D0=B7 =D0=95=D0=90=D0=94, =D0=A0=D0=B0= =D0=B9=D1=84=D0=B0=D0=B9=D0=B7=D0=B5=D0=BD =D0=9B=D0=B8=D0=B7=D0=B8=D0=BD= =D0=B3 =D0=91=D1=8A=D0=BB=D0=B3=D0=B0=D1=80=D0=B8=D1=8F =D0=9E=D0=9E=D0=94,= =D0=A0=D0=B0=D0=B9=D1=84=D0=B0=D0=B9=D0=B7=D0=B5=D0=BD =D0=90=D1=83=D1=82= =D0=BE =D0=9B=D0=B8=D0=B7=D0=B8=D0=BD=D0=B3 =D0=91=D1=8A=D0=BB=D0=B3=D0=B0= =D1=80=D0=B8=D1=8F =D0=95=D0=9E=D0=9E=D0=94 =D0=B8 =D0=A0=D0=B0=D0=B9=D1=84= =D0=B0=D0=B9=D0=B7=D0=B5=D0=BD =D0=98=D0=BC=D0=BE=D1=82=D0=B8 =D0=95=D0=9E= =D0=9E=D0=94 =D0=BD=D0=B5 =D0=BD=D0=BE=D1=81=D1=8F=D1=82 =D0=BE=D1=82=D0=B3= =D0=BE=D0=B2=D0=BE=D1=80=D0=BD=D0=BE=D1=81=D1=82 =D0=B7=D0=B0 =D0=BC=D0=BE= =D0=B4=D0=B8=D1=84=D0=B8=D1=86=D0=B8=D1=80=D0=B0=D0=BD=D0=B8, =D0=BF=D1=80= =D0=BE=D0=BC=D0=B5=D0=BD=D0=B5=D0=BD=D0=B8 =D0=B8=D0=BB=D0=B8 =D1=84=D0=B0= =D0=BB=D1=88=D0=B8=D1=84=D0=B8=D1=86=D0=B8=D1=80=D0=B0=D0=BD=D0=B8 =D1=81= =D1=8A=D0=BE=D0=B1=D1=89=D0=B5=D0=BD=D0=B8=D1=8F. ---2135349674-469363827-1382716422=:13782 Content-Type: text/html; charset=utf-8 Content-Transfer-Encoding: quoted-printable
> I would also recommend to use 4K se= ctor size using=0Agnop and zpool export/import.

<= /span>
Agree, in my small = setup, 4K sectors and aligned partition can be seven or eight times faster = than 512kb sectors when the harddisk is in advance format (4kb per sectors)=

<= div style=3D"color: rgb(0, 0, 0); font-size: 16px; font-family: HelveticaNe= ue,Helvetica Neue,Helvetica,Arial,Lucida Grande,sans-serif; background-colo= r: transparent; font-style: normal;">Also suggest to have two separte= fast SSD (in mirror mode) for the ZIL.
This is to avoid ZFS file system fragmentation when the ZIL is st= ored intent with the ZFS.

Patrick=

On Thursday, October 24, 2013 10:18 PM, "Ivailo.TANUSHEFF@raiffeise= n.bg" <Ivailo.TANUSHEFF@raiffeisen.bg> wrote:
owner-freebsd-fs@freebsd.org wrote on 23.10.2013 23:57:57:

> From:
<= font size=3D"2">>
> Michael Schmiedgen <schmied= gen@gmx.net>
> > To:
>
> Mark Felder <feld@FreeBSD.org>, Albert = Shih <Albert.Shih@obspm.fr>,=0A
> pgsql-admin@po= stgresql.org, freebsd-fs@freebsd.org, freebsd-jail@freebsd.org,=0A
>
> Dat= e:
>
> 23.10.2013 23:58
>
> Subject:
>
> Re: ZFS-FreeBSD + postgresql pe= rformance
>
> Sent by:
= >
> owner-freebsd-fs@freebsd.org

>
> On 10/23/1= 3 19:14, Mark Felder wrote:
> > On Wed, Oct 23, 201= 3, at 11:25, Albert Shih wrote:
> >> My question= is about the performance, I known ZFS eat all=0Amemory he can
> >> have (or almost), = so what append when we run database like=0Apostgresql and
> >> jail ? (it's also the reason of 96 Go ram).
> >>
> >> Sorry for cross-posting but= it's about 3 differents things....
> >>
> >
> > To my understanding the so= lution is to change the primarycache=0Ato
> > "meta= data" for any ZFS filesystem that you do not want=0AZFS to heavily
> > cache in memory.
> >
> > Example:
> >
= > > # zfs set primarycache=3Dmetadata tank/usr/local/pgsql
>
> In addition to this it is recommende= d to set the recordsize
> to the fixed value of 8k on = dataset creation.
>
> Michael
>

I would also recommend to use 4K sector size using= =0Agnop and zpool export/import.
I agree that using fixed recordsize is a must when=0Ayou have data= bases and you have DB on each jail.
Also there are a bunch of sysctl parameters you may=0Awant to p= lay with, mostly about tuning the memory usage.

Also it might be an idea to use = partitions on disks=0Aand:
1. Use first 1-2G on each disk for swap (just in case).
2. Use the rest of the disk for 4K align= ed and 4K=0Asector size partition, labelled in some way (I use disk ID as l= abel, for=0Aeasy identification).

Best regards,
= Ivailo Tanusheff=
=0A
=0A= =0A =0A
=0A
=0ADISCLAIMER: The contents of this e-mail= are intended for the named addressee only. It contains information that ma= y be privileged and/or confidential. Unless you are the named addressee or = an authorized designee, you may not copy or use it, or disclose it to anyon= e else. If you received it in error please notify us immediately and then d= estroy it. Messages transported over the public Internet are susceptible to= alteration. Raiffeisenbank (Bulgaria) EAD, Raiffeisen Asset Management (Bu= lgaria) EAD, Raiffeisen Insurance Broker EOOD, Raiffeisen Services EAD, Rai= ffeisen Leasing Bulgaria OOD, Raiffeisen Auto Leasing Bulgaria EOOD and Rai= ffeisen Real Estate EOOD shall not be liable for the message if altered, ch= anged or falsified.
=0A
=0A
=0A=D0=9E=D0=93=D0=A0= =D0=90=D0=9D=D0=98=D0=A7=D0=95=D0=9D=D0=98=D0=95 =D0=9D=D0=90 =D0=9E=D0=A2= =D0=93=D0=9E=D0=92=D0=9E=D0=A0=D0=9D=D0=9E=D0=A1=D0=A2=D0=A2=D0=90: =D0=A1= =D1=8A=D0=B4=D1=8A=D1=80=D0=B6=D0=B0=D0=BD=D0=B8=D0=B5=D1=82=D0=BE =D0=BD= =D0=B0 =D1=82=D0=BE=D0=B2=D0=B0 =D0=B5=D0=BB=D0=B5=D0=BA=D1=82=D1=80=D0=BE= =D0=BD=D0=BD=D0=BE =D1=81=D1=8A=D0=BE=D0=B1=D1=89=D0=B5=D0=BD=D0=B8=D0=B5 = =D0=B5 =D0=BF=D1=80=D0=B5=D0=B4=D0=BD=D0=B0=D0=B7=D0=BD=D0=B0=D1=87=D0=B5= =D0=BD=D0=BE =D0=B5=D0=B4=D0=B8=D0=BD=D1=81=D1=82=D0=B2=D0=B5=D0=BD=D0=BE = =D0=B7=D0=B0 =D0=BF=D0=BE=D1=81=D0=BE=D1=87=D0=B5=D0=BD=D0=B8=D1=8F =D0=BF= =D0=BE=D0=BB=D1=83=D1=87=D0=B0=D1=82=D0=B5=D0=BB. =D0=A1=D1=8A=D0=BE=D0=B1= =D1=89=D0=B5=D0=BD=D0=B8=D0=B5=D1=82=D0=BE =D1=81=D1=8A=D0=B4=D1=8A=D1=80= =D0=B6=D0=B0 =D0=B8=D0=BD=D1=84=D0=BE=D1=80=D0=BC=D0=B0=D1=86=D0=B8=D1=8F, = =D0=BA=D0=BE=D1=8F=D1=82=D0=BE =D0=BC=D0=BE=D0=B6=D0=B5 =D0=B4=D0=B0 =D0=B1= =D1=8A=D0=B4=D0=B5 =D0=BF=D1=80=D0=B5=D0=B4=D0=BD=D0=B0=D0=B7=D0=BD=D0=B0= =D1=87=D0=B5=D0=BD=D0=B0 =D0=B7=D0=B0 =D0=BE=D0=B3=D1=80=D0=B0=D0=BD=D0=B8= =D1=87=D0=B5=D0=BD=D0=BE =D0=BF=D0=BE=D0=BB=D0=B7=D0=B2=D0=B0=D0=BD=D0=B5 = =D0=B8/=D0=B8=D0=BB=D0=B8 =D0=BF=D0=BE=D0=B2=D0=B5=D1=80=D0=B8=D1=82=D0=B5= =D0=BB=D0=BD=D0=B0. =D0=92 =D1=81=D0=BB=D1=83=D1=87=D0=B0=D0=B9 =D1=87=D0= =B5 =D0=BD=D0=B5 =D1=81=D1=82=D0=B5 =D1=83=D0=BA=D0=B0=D0=B7=D0=B0=D0=BD=D0= =B8=D1=8F =D0=BF=D0=BE=D0=BB=D1=83=D1=87=D0=B0=D1=82=D0=B5=D0=BB =D0=BD=D0= =B0 =D1=82=D0=BE=D0=B2=D0=B0 =D1=81=D1=8A=D0=BE=D0=B1=D1=89=D0=B5=D0=BD=D0= =B8=D0=B5 =D0=B8=D0=BB=D0=B8 =D0=BD=D0=B5=D0=B3=D0=BE=D0=B2 =D0=BE=D1=82=D0= =BE=D1=80=D0=B8=D0=B7=D0=B8=D1=80=D0=B0=D0=BD =D0=BF=D1=80=D0=B5=D0=B4=D1= =81=D1=82=D0=B0=D0=B2=D0=B8=D1=82=D0=B5=D0=BB, =D0=BD=D1=8F=D0=BC=D0=B0=D1= =82=D0=B5 =D0=BF=D1=80=D0=B0=D0=B2=D0=BE =D0=B4=D0=B0 =D0=B3=D0=BE =D0=BA= =D0=BE=D0=BF=D0=B8=D1=80=D0=B0=D1=82=D0=B5 =D0=B8=D0=BB=D0=B8 =D0=B8=D0=B7= =D0=BF=D0=BE=D0=BB=D0=B7=D0=B2=D0=B0=D1=82=D0=B5, =D0=BA=D0=B0=D0=BA=D1=82= =D0=BE =D0=B8 =D0=B4=D0=B0 =D1=80=D0=B0=D0=B7=D0=BA=D1=80=D0=B8=D0=B2=D0=B0= =D1=82=D0=B5 =D1=81=D1=8A=D0=B4=D1=8A=D1=80=D0=B6=D0=B0=D0=BD=D0=B8=D0=B5= =D1=82=D0=BE =D0=BC=D1=83 =D0=BF=D1=80=D0=B5=D0=B4 =D1=82=D1=80=D0=B5=D1=82= =D0=B8 =D0=BB=D0=B8=D1=86=D0=B0. =D0=90=D0=BA=D0=BE =D1=81=D1=82=D0=B5 =D0= =B3=D0=BE =D0=BF=D0=BE=D0=BB=D1=83=D1=87=D0=B8=D0=BB=D0=B8 =D0=BF=D0=BE =D0= =B3=D1=80=D0=B5=D1=88=D0=BA=D0=B0, =D0=BC=D0=BE=D0=BB=D1=8F =D0=B4=D0=B0 = =D1=83=D0=B2=D0=B5=D0=B4=D0=BE=D0=BC=D0=B8=D1=82=D0=B5 =D0=BF=D0=BE=D0=B4= =D0=B0=D1=82=D0=B5=D0=BB=D1=8F =D0=BD=D0=B5=D0=B7=D0=B0=D0=B1=D0=B0=D0=B2= =D0=BD=D0=BE =D0=B8 =D0=B4=D0=B0 =D0=B8=D0=B7=D1=82=D1=80=D0=B8=D0=B5=D1=82= =D0=B5 =D1=82=D0=BE=D0=B2=D0=B0 =D1=81=D1=8A=D0=BE=D0=B1=D1=89=D0=B5=D0=BD= =D0=B8=D0=B5 =D0=BE=D1=82 =D1=81=D0=B8=D1=81=D1=82=D0=B5=D0=BC=D0=B0=D1=82=D0=B0. =D0=95=D0=BB=D0=B5= =D0=BA=D1=82=D1=80=D0=BE=D0=BD=D0=BD=D0=B8=D1=82=D0=B5 =D1=81=D1=8A=D0=BE= =D0=B1=D1=89=D0=B5=D0=BD=D0=B8=D1=8F, =D1=80=D0=B0=D0=B7=D0=BF=D1=80=D0=BE= =D1=81=D1=82=D1=80=D0=B0=D0=BD=D1=8F=D0=B2=D0=B0=D0=BD=D0=B8 =D0=BF=D0=BE = =D0=98=D0=BD=D1=82=D0=B5=D1=80=D0=BD=D0=B5=D1=82 =D0=BC=D0=BE=D0=B3=D0=B0= =D1=82 =D0=B4=D0=B0 =D0=B1=D1=8A=D0=B4=D0=B0=D1=82 =D0=BF=D1=80=D0=BE=D0=BC= =D0=B5=D0=BD=D1=8F=D0=BD=D0=B8. =D0=A0=D0=B0=D0=B9=D1=84=D0=B0=D0=B9=D0=B7= =D0=B5=D0=BD=D0=B1=D0=B0=D0=BD=D0=BA (=D0=91=D1=8A=D0=BB=D0=B3=D0=B0=D1=80= =D0=B8=D1=8F) =D0=95=D0=90=D0=94, =D0=A0=D0=B0=D0=B9=D1=84=D0=B0=D0=B9=D0= =B7=D0=B5=D0=BD =D0=90=D1=81=D0=B5=D1=82 =D0=9C=D0=B5=D0=BD=D0=B8=D0=B4=D0= =B6=D0=BC=D1=8A=D0=BD=D1=82 (=D0=91=D1=8A=D0=BB=D0=B3=D0=B0=D1=80=D0=B8=D1= =8F) =D0=95=D0=90=D0=94, =D0=A0=D0=B0=D0=B9=D1=84=D0=B0=D0=B9=D0=B7=D0=B5= =D0=BD =D0=97=D0=B0=D1=81=D1=82=D1=80=D0=B0=D1=85=D0=BE=D0=B2=D0=B0=D1=82= =D0=B5=D0=BB=D0=B5=D0=BD =D0=91=D1=80=D0=BE=D0=BA=D0=B5=D1=80 =D0=95=D0=9E= =D0=9E=D0=94, =D0=A0=D0=B0=D0=B9=D1=84=D0=B0=D0=B9=D0=B7=D0=B5=D0=BD =D0=A1= =D1=8A=D1=80=D0=B2=D0=B8=D1=81=D0=B8=D0=B7 =D0=95=D0=90=D0=94, =D0=A0=D0=B0= =D0=B9=D1=84=D0=B0=D0=B9=D0=B7=D0=B5=D0=BD =D0=9B=D0=B8=D0=B7=D0=B8=D0=BD= =D0=B3 =D0=91=D1=8A=D0=BB=D0=B3=D0=B0=D1=80=D0=B8=D1=8F =D0=9E=D0=9E=D0=94,= =D0=A0=D0=B0=D0=B9=D1=84=D0=B0=D0=B9=D0=B7=D0=B5=D0=BD =D0=90=D1=83=D1=82= =D0=BE =D0=9B=D0=B8=D0=B7=D0=B8=D0=BD=D0=B3 =D0=91=D1=8A=D0=BB=D0=B3=D0=B0= =D1=80=D0=B8=D1=8F =D0=95=D0=9E=D0=9E=D0=94 =D0=B8 =D0=A0=D0=B0=D0=B9=D1=84= =D0=B0=D0=B9=D0=B7=D0=B5=D0=BD =D0=98=D0=BC=D0=BE=D1=82=D0=B8 =D0=95=D0=9E= =D0=9E=D0=94 =D0=BD=D0=B5 =D0=BD=D0=BE=D1=81=D1=8F=D1=82 =D0=BE=D1=82=D0=B3= =D0=BE=D0=B2=D0=BE=D1=80=D0=BD=D0=BE=D1=81=D1=82 =D0=B7=D0=B0 =D0=BC=D0=BE= =D0=B4=D0=B8=D1=84=D0=B8=D1=86=D0=B8=D1=80=D0=B0=D0=BD=D0=B8, =D0=BF=D1=80= =D0=BE=D0=BC=D0=B5=D0=BD=D0=B5=D0=BD=D0=B8 =D0=B8=D0=BB=D0=B8 =D1=84=D0=B0= =D0=BB=D1=88=D0=B8=D1=84=D0=B8=D1=86=D0=B8=D1=80=D0=B0=D0=BD=D0=B8 =D1=81= =D1=8A=D0=BE=D0=B1=D1=89=D0=B5=D0=BD=D0=B8=D1=8F.

=0A
=0A=0A


---2135349674-469363827-1382716422=:13782--