X-Original-To: pgsql-performance-postgresql.org@localhost.postgresql.org Received: from localhost (unknown [200.46.204.144]) by svr1.postgresql.org (Postfix) with ESMTP id 67E0453485 for ; Thu, 31 Mar 2005 03:34:48 +0100 (BST) Received: from svr1.postgresql.org ([200.46.204.71]) by localhost (av.hub.org [200.46.204.144]) (amavisd-new, port 10024) with ESMTP id 40666-07 for ; Thu, 31 Mar 2005 02:34:39 +0000 (GMT) Received: from server07.icaen.uiowa.edu (server07.icaen.uiowa.edu [128.255.17.47]) by svr1.postgresql.org (Postfix) with ESMTP id 9E51952956 for ; Thu, 31 Mar 2005 03:34:37 +0100 (BST) Received: from server11.icaen.uiowa.edu (server11.icaen.uiowa.edu [128.255.17.51]) by server07.icaen.uiowa.edu (8.13.3/8.12.9) with ESMTP id j2V2YgCo016279 for ; (envelope-from ) Wed, 30 Mar 2005 20:34:42 -0600 (CST) Received: from [192.168.1.13] (12-215-118-172.client.mchsi.com [12.215.118.172]) (authenticated user=jfmeinel) by server11.icaen.uiowa.edu (8.13.2/smtp-serv-1.7) with ESMTP id j2V2YdPc018345 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256) for ; (envelope-from ) Wed, 30 Mar 2005 20:34:41 -0600 (CST) Message-ID: <424B61BF.3010906@arbash-meinel.com> Date: Wed, 30 Mar 2005 20:34:39 -0600 From: John Arbash Meinel User-Agent: Mozilla Thunderbird 1.0 (Macintosh/20041206) X-Accept-Language: en-us, en MIME-Version: 1.0 To: pgsql-performance@postgresql.org Subject: Re: fine tuning for logging server References: <1112233809.10313.31.camel@stantz.corp.sgi.com> <424B5982.3090809@arbash-meinel.com> <1112235878.12159.22.camel@stantz.corp.sgi.com> In-Reply-To: <1112235878.12159.22.camel@stantz.corp.sgi.com> X-Enigmail-Version: 0.89.6.0 X-Enigmail-Supports: pgp-inline, pgp-mime Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="------------enigBEF88ABCBD05BB31A8B065F0" X-Virus-Scanned: ClamAV version 0.83, clamav-milter version 0.83 on clamav.icaen.uiowa.edu X-Virus-Scanned: ClamAV version 0.83, clamav-milter version 0.83 on clamav.icaen.uiowa.edu X-Virus-Status: Clean X-Virus-Scanned: by amavisd-new at hub.org X-Spam-Status: No, hits=0 tagged_above=0 required=5 tests= X-Spam-Level: X-Archive-Number: 200503/672 X-Sequence-Number: 11377 This is an OpenPGP/MIME signed message (RFC 2440 and 3156) --------------enigBEF88ABCBD05BB31A8B065F0 Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Florin Andrei wrote: >On Wed, 2005-03-30 at 19:59 -0600, John Arbash Meinel wrote: > > > >>Put pg_xlog onto the same drive as the OS, not the drive with the database. >> >> > >I forgot to mention: the OS drive is purposefully made very slow - the >write cache is turned off and the FS is Ext3 with data=journal. Is then >still ok to put pg_xlog on it? > >The reason: if the power cord is yanked, the OS _must_ boot back up in >good condition. If the DB is corrupted, whatever, nuke it then re- >initialize it. But the OS must survive act-of-god events. > >No, there is no uninterruptible power supply. It sucks, but that's how >it is. I cannot change that. > > > You don't want write cache for pg_xlog either. And you could always create a second partition that used reiserfs, or something like that. If you have to survine "act-of-god" you probably should consider making the system into a RAID1 instead of 2 separate drives (software RAID should be fine). 'Cause a much worse act-of-god is having a drive crash. No matter what you do in software, a failed platter will prevent you from booting. RAID 1 at least means 2 drives have to die. If you need insert speed, and can't do custom transactions at the application side, you could try creating a RAM disk for the insert table, and then create a cron job that bulk pulls it out of that table and inserts it into the rest of the system. That should let you get a super-fast insert speed, and the bulk copies should stay reasonably fast. Just realize that if your cron job stops running, your machine will slowly eat up all of it's ram, and really not play nice. I think adding an extra hard-drive is probably the best way to boost performance and reliability, but if you have a $0 budget, this is a possibility. John =:-> --------------enigBEF88ABCBD05BB31A8B065F0 Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.0 (Darwin) Comment: Using GnuPG with Thunderbird - http://enigmail.mozdev.org iD8DBQFCS2G/JdeBCYSNAAMRAiJbAJ0ZMPOexFgZSC8vuw7j/NdH5oEjLQCfVrGy 3HdPR9BKUB0NuM/wTbkF3kk= =vQ/f -----END PGP SIGNATURE----- --------------enigBEF88ABCBD05BB31A8B065F0--