Received: from maia.hub.org (maia-3.hub.org [200.46.204.243]) by mail.postgresql.org (Postfix) with ESMTP id A0C531337B47 for ; Tue, 29 Mar 2011 13:12:38 -0300 (ADT) Received: from mail.postgresql.org ([200.46.204.86]) by maia.hub.org (mx1.hub.org [200.46.204.243]) (amavisd-maia, port 10024) with ESMTP id 65444-02 for ; Tue, 29 Mar 2011 16:12:31 +0000 (UTC) X-Greylist: from auto-whitelisted by SQLgrey-1.7.6 Received: from shrek.krogh.cc (2605ds1-ynoe.0.fullrate.dk [90.184.12.24]) by mail.postgresql.org (Postfix) with ESMTP id D7FE1133655C for ; Tue, 29 Mar 2011 13:12:30 -0300 (ADT) Received: from localhost (localhost [127.0.0.1]) by shrek.krogh.cc (Postfix) with ESMTP id 1E08432262F for ; Tue, 29 Mar 2011 18:12:29 +0200 (CEST) X-Virus-Scanned: Debian amavisd-new at shrek.krogh.cc Received: from shrek.krogh.cc ([127.0.0.1]) by localhost (shrek.krogh.cc [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 2+j-KKenjKzd for ; Tue, 29 Mar 2011 18:12:25 +0200 (CEST) Received: from [90.184.13.151] (2605ds1-ynoe.2.fullrate.dk [90.184.13.151]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) (Authenticated sender: jesper@krogh.cc) by shrek.krogh.cc (Postfix) with ESMTPSA id 669D53211E4 for ; Tue, 29 Mar 2011 18:12:25 +0200 (CEST) Message-ID: <4D9204E9.1060403@krogh.cc> Date: Tue, 29 Mar 2011 18:12:25 +0200 From: Jesper Krogh User-Agent: Mozilla/5.0 (X11; U; Linux x86_64; en-US; rv:1.9.2.13) Gecko/20101208 Thunderbird/3.1.7 MIME-Version: 1.0 To: pgsql-performance@postgresql.org Subject: Re: Intel SSDs that may not suck References: <4D90EDB6.2080609@2ndQuadrant.com> <535760.62572.qm@web111307.mail.gq1.yahoo.com> <8BE8F356-319F-4BE7-BE66-F45D50235985@torgo.978.org> In-Reply-To: <8BE8F356-319F-4BE7-BE66-F45D50235985@torgo.978.org> Content-Type: multipart/alternative; boundary="------------060408060207000504020201" X-Virus-Scanned: Maia Mailguard 1.0.1 X-Spam-Status: No, hits=-1.899 tagged_above=-10 required=5 tests=BAYES_00=-1.9, HTML_MESSAGE=0.001 X-Spam-Level: X-Archive-Number: 201103/357 X-Sequence-Number: 43036 This is a multi-part message in MIME format. --------------060408060207000504020201 Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit On 2011-03-29 16:16, Jeff wrote: > halt for 0.5-2 seconds, then resume. The fix we're going to do is > replace each drive in order with the rebuild occuring between each. > Then we do a security erase to reset the drive back to completely > empty (including the "spare" blocks kept around for writes). Are you replacing the drives with new once, or just secure-erase and back in? What kind of numbers are you drawing out of smartmontools in usage figures? (Also seeing some write-stalls here, on 24 Raid50 volumes of x25m's, and have been planning to cycle drives for quite some time, without actually getting to it. > Now that all sounds awful and horrible until you get to overall > performance, especially with reads - you are looking at 20k random > reads per second with a few disks. Adding in writes does kick it > down a noch, but you're still looking at 10k+ iops. That is the > current trade off. Thats also my experience. -- Jesper --------------060408060207000504020201 Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit On 2011-03-29 16:16, Jeff wrote:
> halt for 0.5-2 seconds, then resume. The fix we're going to do is
> replace each drive in order with the rebuild occuring between each.
> Then we do a security erase to reset the drive back to completely
> empty (including the "spare" blocks kept around for writes).

Are you replacing the drives with new once, or just secure-erase and back in?
What kind of numbers are you drawing out of smartmontools in usage figures?
(Also seeing some write-stalls here, on 24 Raid50 volumes of x25m's, and
have been planning to cycle drives for quite some time, without actually
getting to it.

> Now that all sounds awful and horrible until you get to overall
> performance, especially with reads - you are looking at 20k random
> reads per second with a few disks. Adding in writes does kick it
> down a noch, but you're still looking at 10k+ iops. That is the
> current trade off.

Thats also my experience.
--
Jesper
--------------060408060207000504020201--