From: John A Meinel <john@arbash-meinel.com>
To: Jeremiah Jahn <jeremiah@cs.earlham.edu>
Cc: Ron <rjpeace@earthlink.net>
Cc: postgres performance <pgsql-performance@postgresql.org>
Subject: Re: extremly low memory usage
Date: Tue, 23 Aug 2005 04:48:20 -0500
Message-ID: <430AF0E4.3050205@arbash-meinel.com> (raw)
In-Reply-To: <1124721763.27881.250.camel@bluejay.goodinassociates.com>
References: <1124331108.27881.96.camel@bluejay.goodinassociates.com>
<EA4219B9-E2B0-4756-ABF2-D84F245FDFB5@torgo.978.org>
<1124386761.27881.119.camel@bluejay.goodinassociates.com>
<4304CB77.4070403@arbash-meinel.com>
<1124470109.27881.152.camel@bluejay.goodinassociates.com>
<43061472.2080201@arbash-meinel.com>
<1124481386.27881.167.camel@bluejay.goodinassociates.com>
<43064908.7010505@arbash-meinel.com>
<1124564003.27881.229.camel@bluejay.goodinassociates.com>
<6.2.3.4.0.20050820154422.06021150@pop.earthlink.net>
<4307E7A4.7090300@arbash-meinel.com>
<1124636066.27881.238.camel@bluejay.goodinassociates.com>
<6.2.3.4.0.20050821112849.01f79860@pop.earthlink.net>
<1124721763.27881.250.camel@bluejay.goodinassociates.com>
Jeremiah Jahn wrote:
> On Sun, 2005-08-21 at 16:13 -0400, Ron wrote:
>
>>At 10:54 AM 8/21/2005, Jeremiah Jahn wrote:
>>
...
>>So you have 2 controllers each with 2 external slots? But you are
>>currently only using 1 controller and only one external slot on that
>>controller?
>
>
> Sorry, no. I have one dual channel card in the system and two
> controllers on the array. Dell PowerVault 220S w/ PERC4eDC-PCI Express
>
>
...
>>Regardless of the above, each of these controllers should still be
>>good for about 80-85% of 640MB/s, or ~510-540 MB/s apiece when doing
>>raw sequential IO if you plug 3-4 fast enough HD's into each SCSI
>>channel. Cheetah 15K.4's certainly are fast enough. Optimal setup
>>is probably to split each RAID 1 pair so that one HD is on each of
>>the SCSI channels, and then RAID 0 those pairs. That will also
>>protect you from losing the entire disk subsystem if one of the SCSI
>>channels dies.
>
> I like this idea, but how exactly does one bond the two channels
> together? Won't this cause me to have both an /dev/sdb and an /dev/sdc?
>
Well, even if you did, you could always either use software raid, or lvm
to turn it into a single volume.
It also depends what the controller card bios would let you get away
with. Some cards would let you setup 4 RAID1's (one drive from each
channel), and then create a RAID0 of those pairs. Software raid should
do this without any problem. And can even be done such that it can be
grown in the future, as well as work across multiple cards (though the
latter is supported by some cards as well).
>
>
>>That 128MB of buffer cache may very well be too small to keep the IO
>>rate up, and/or there may be a more subtle problem with the LSI card,
>>and/or you may have a configuration problem, but _something(s)_ need
>>fixing since you are only getting raw sequential IO of ~100-150MB/s
>>when it should be above 500MB/s.
>
>
> It looks like there's a way to add more memory to it.
This memory probably helps more in writing than reading. If you are
reading the same area over and over, it might end up being a little bit
of extra cache for that (but it should already be cached in system RAM,
so you don't really get anything).
...
>>Initial reads are only going to be as fast as your HD subsystem, so
>>there's a reason for making the HD subsystem faster even if all you
>>care about is reads. In addition, I'll repeat my previous advice
>>that upgrading to 16GB of RAM would be well worth it for you.
>
>
> 12GB is my max. I may run with it for a while and see.
If your working set truly is 10GB, then you can get a massive
performance increase even at 12GB. If your working set is 10GB and you
have 6GB of RAM, it probably is always swapping out what it just read
for the new stuff, even though you will read that same thing again in a
few seconds. So rather than just paying for the 4GB that can't be
cached, you pay for the whole 10.
John
=:->
>
>
>>Hope this helps,
>>Ron Peacetree
>>
>>
>>
>>---------------------------(end of broadcast)---------------------------
>>TIP 9: In versions below 8.0, the planner will ignore your desire to
>> choose an index scan if your joining column's datatypes do not
>> match
Attachments:
signature.asc (application/pgp-signature, 252B) download
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Reply to all the recipients using the --to and --cc options:
reply via email
To: pgsql-performance@postgresql.org
Cc: john@arbash-meinel.com, jeremiah@cs.earlham.edu, rjpeace@earthlink.net
Subject: Re: extremly low memory usage
In-Reply-To: <430AF0E4.3050205@arbash-meinel.com>
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox