Received: from maia.hub.org (maia-5.hub.org [200.46.204.29]) by mail.postgresql.org (Postfix) with ESMTP id CFD8B632380 for ; Sat, 24 Jul 2010 16:48:32 -0300 (ADT) Received: from mail.postgresql.org ([200.46.204.86]) by maia.hub.org (mx1.hub.org [200.46.204.29]) (amavisd-maia, port 10024) with ESMTP id 20869-09 for ; Sat, 24 Jul 2010 19:48:21 +0000 (UTC) X-Greylist: domain auto-whitelisted by SQLgrey-1.7.6 Received: from mail-ey0-f174.google.com (mail-ey0-f174.google.com [209.85.215.174]) by mail.postgresql.org (Postfix) with ESMTP id 111E062DBEC for ; Sat, 24 Jul 2010 16:48:20 -0300 (ADT) Received: by eya25 with SMTP id 25so263883eya.19 for ; Sat, 24 Jul 2010 12:48:19 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:message-id:date:from :user-agent:mime-version:to:cc:subject:references:in-reply-to :content-type:content-transfer-encoding; bh=w7HAFLLc2HdGKvnRsXyK3ur8MBcwZAde7nLe5vKtlA4=; b=GKtOBykHj7oms8NgklcesoLUw9CkOFwiiI5QSel3Jk6NFH/TU4TxsLiOAix2MG2/tb OhxV4jcevrpxz/2x5eJDy4oQWRT5rNfIZAASdnFE5SsJFY1WyaSWjcQQakHyVwUfVeZH ebbV6+lVplsWpMWFnP4K8dRsAakcFEqQZpPpk= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=message-id:date:from:user-agent:mime-version:to:cc:subject :references:in-reply-to:content-type:content-transfer-encoding; b=Evep18ZsJD8kS3LJ0OP9NrQw/aKpLMLoGM72tNa8IGzfNCeooFrw1Y66NL5XPZGqpy qR2Ubusv4cUvVCLcsJUB293Do4bLbCKlAQ27vbB3yiPuMbvN1k7A4zHbrc6/Fd7vqoEx OBjG4uwZosKugF4N9xLW6z+8nFpvcW2d9gH4g= Received: by 10.213.7.2 with SMTP id b2mr4670680ebb.22.1280000899121; Sat, 24 Jul 2010 12:48:19 -0700 (PDT) Received: from [0.0.0.0] (5357DA75.cable.casema.nl [83.87.218.117]) by mx.google.com with ESMTPS id a48sm2618106eei.19.2010.07.24.12.48.17 (version=TLSv1/SSLv3 cipher=RC4-MD5); Sat, 24 Jul 2010 12:48:18 -0700 (PDT) Message-ID: <4C4B43DA.90201@gmail.com> Date: Sat, 24 Jul 2010 21:49:46 +0200 From: Yeb Havinga User-Agent: Thunderbird 2.0.0.24 (Windows/20100228) MIME-Version: 1.0 To: Greg Smith CC: pgsql-performance@postgresql.org Subject: Re: Testing Sandforce SSD References: <4C4A9452.9070100@gmail.com> <4C4B1F84.5030306@2ndquadrant.com> In-Reply-To: <4C4B1F84.5030306@2ndquadrant.com> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-Virus-Scanned: Maia Mailguard 1.0.1 X-Spam-Status: No, hits=-1.9 tagged_above=-10 required=5 tests=BAYES_00=-1.9 X-Spam-Level: X-Archive-Number: 201007/358 X-Sequence-Number: 39747 Greg Smith wrote: > Note that not all of the Sandforce drives include a capacitor; I hope > you got one that does! I wasn't aware any of the SF drives with a > capacitor on them were even shipping yet, all of the ones I'd seen > were the chipset that doesn't include one still. Haven't checked in a > few weeks though. I think I did, it was expensive enough, though while ordering its very easy to order the wrong one, all names on the product category page look the same. (OCZ Vertex 2 Pro) >> * How to test for power failure? > > I've had good results using one of the early programs used to > investigate this class of problems: > http://brad.livejournal.com/2116715.html?page=2 A great tool, thanks for the link! diskchecker: running 34 sec, 4.10% coverage of 500 MB (1342 writes; 39/s) diskchecker: running 35 sec, 4.24% coverage of 500 MB (1390 writes; 39/s) diskchecker: running 36 sec, 4.35% coverage of 500 MB (1427 writes; 39/s) diskchecker: running 37 sec, 4.47% coverage of 500 MB (1468 writes; 39/s) didn't get 'ok' from server (11387 316950), msg=[] = Connection reset by peer at ./diskchecker.pl line 132. here's where I removed the power and left it off for about a minute. Then started again then did the verify yeb@a:~$ ./diskchecker.pl -s client45.eemnes verify test_file verifying: 0.00% Total errors: 0 :-) this was on ext2 >> * What filesystem to use on the SSD? To minimize writes and maximize >> chance for seeing errors I'd choose ext2 here. > > I don't consider there to be any reason to deploy any part of a > PostgreSQL database on ext2. The potential for downtime if the fsck > doesn't happen automatically far outweighs the minimal performance > advantage you'll actually see in real applications. Hmm.. wouldn't that apply for other filesystems as well? I know that JFS also won't mount if booted unclean, it somehow needs a marker from the fsck. Don't know for ext3, xfs etc. > All of the benchmarks showing large gains for ext2 over ext3 I have > seen been synthetic, not real database performance; the internal ones > I've run using things like pgbench do not show a significant > improvement. (Yes, I'm already working on finding time to publicly > release those findings) The reason I'd choose ext2 on the SSD was mainly to decrease the number of writes, not for performance. Maybe I should ultimately do tests for both journalled and ext2 filesystems and compare the amount of data per x pgbench transactions. > Put it on ext3, toggle on noatime, and move on to testing. The > overhead of the metadata writes is the least of the problems when > doing write-heavy stuff on Linux. Will surely do and post the results. thanks, Yeb Havinga