Received: from localhost (unknown [200.46.204.183]) by postgresql.org (Postfix) with ESMTP id 64F6B2E2F05 for ; Fri, 18 Jan 2008 09:03:49 -0400 (AST) Received: from postgresql.org ([200.46.204.71]) by localhost (mx1.hub.org [200.46.204.183]) (amavisd-maia, port 10024) with ESMTP id 85153-09 for ; Fri, 18 Jan 2008 09:03:44 -0400 (AST) Received: from nz-out-0506.google.com (nz-out-0506.google.com [64.233.162.225]) by postgresql.org (Postfix) with ESMTP id BB1FC2E2FD8 for ; Fri, 18 Jan 2008 09:03:44 -0400 (AST) Received: by nz-out-0506.google.com with SMTP id l8so741706nzf.28 for ; Fri, 18 Jan 2008 05:03:43 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:message-id:date:from:sender:to:subject:cc:in-reply-to:mime-version:content-type:references:x-google-sender-auth; bh=rdxUJXTeX5EHwOdSL/xy1PHuVQeOKMGYtTEYkUvxivQ=; b=XpnPTdpiYzziUKVlWm7L1z0MOGwFIieMc/loPEIL1x/ApZIFHpWpVmVQ5DmOhZyvIVmPYvoDO5JT1Ewamg5hDSNNAScujK3z6KMeSLxHieS8N/a7adbd6yhDyZ5W09hUncQvnoqoZw1TsCNac59EXt+0CYphdQzMeo5/nWMffxY= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=message-id:date:from:sender:to:subject:cc:in-reply-to:mime-version:content-type:references:x-google-sender-auth; b=F9i6e8Iy74JqLlCpDzmMB3ymwRjOEl/DQOJ2E9kB7dMRSMibpwd5xIzYkR298BvobAkxqGG3TqJcN0m0Hqq2e+MTLYmIalOo8w9cGSS+/7dkBiVwno6D8KN1Rs3IHahCvh0fZKbXt2Yji0AOstFDZZk3ek9FG76mcdqcN2q2u0k= Received: by 10.114.149.2 with SMTP id w2mr3899045wad.5.1200661422299; Fri, 18 Jan 2008 05:03:42 -0800 (PST) Received: by 10.114.174.2 with HTTP; Fri, 18 Jan 2008 05:03:42 -0800 (PST) Message-ID: <264855a00801180503k14910362p3165b46e8450d045@mail.gmail.com> Date: Fri, 18 Jan 2008 08:03:42 -0500 From: "Sean Davis" To: "Greg Smith" Subject: Re: [OT] RAID controllers blocking one another? Cc: pgsql-performance@postgresql.org In-Reply-To: MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="----=_Part_5306_9532304.1200661422109" References: <264855a00801171217m4e6211e6y5f4d0e12ce86db5c@mail.gmail.com> X-Google-Sender-Auth: 8609b5f30ff8e80f X-Virus-Scanned: Maia Mailguard 1.0.1 X-Archive-Number: 200801/146 X-Sequence-Number: 28385 ------=_Part_5306_9532304.1200661422109 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit Content-Disposition: inline On Jan 17, 2008 6:23 PM, Greg Smith wrote: > On Thu, 17 Jan 2008, Scott Marlowe wrote: > > > On Jan 17, 2008 2:17 PM, Sean Davis wrote: > >> two3-ware cards, one 9640SE-24 and one 9640SE-16 > > Sounds like they're sharing something they shouldn't be. I'm not real > > familiar with PCI-express. Aren't those the ones that use up to 16 > > channels for I/O? Can you divide it to 8 and 8 for each PCI-express > > slot in the BIOS maybe, or something like that? > > I can't find the 9640SE-24/16 anywhere, but presuming these are similar to > (or are actually) the 9650SE cards then each of them is using 8 lanes of > the 16 available. I'd need to know the exact motherboard or system to > even have a clue what the options are for adjusting the BIOS and whether > they are shared or independant. > > But I haven't seen one where there's any real ability to adjust how the > I/O is partitioned beyond adjusting what slot you plug things into so > that's probably a dead end anyway. Given the original symptoms, one thing > I would be suspicious of though is whether there's some sort of IRQ > conflict going on. Sadly we still haven't left that kind of junk behind > even on current PC motherboards. Thanks, Greg. After a little digging, 3-ware suggested moving one of the cards, also. We will probably give that a try. I'll also look into the bios, but since the machine is running as a fileserver, there is precious little time for downtime tinkering. FYI, here are the specs on the server. http://www.thinkmate.com/System/8U_Dual_Xeon_i2SS40-8U_Storage_Server Sean ------=_Part_5306_9532304.1200661422109 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: 7bit Content-Disposition: inline

On Jan 17, 2008 6:23 PM, Greg Smith <gsmith@gregsmith.com> wrote:
On Thu, 17 Jan 2008, Scott Marlowe wrote:

> On Jan 17, 2008 2:17 PM, Sean Davis <sdavis2@mail.nih.gov> wrote:
>> two3-ware cards, one 9640SE-24 and one 9640SE-16
> Sounds like they're sharing something they shouldn't be.  I'm not real
> familiar with PCI-express.  Aren't those the ones that use up to 16
> channels for I/O?  Can you divide it to 8 and 8 for each PCI-express
> slot in the BIOS maybe, or something like that?

I can't find the 9640SE-24/16 anywhere, but presuming these are similar to
(or are actually) the 9650SE cards then each of them is using 8 lanes of
the 16 available.  I'd need to know the exact motherboard or system to
even have a clue what the options are for adjusting the BIOS and whether
they are shared or independant.

But I haven't seen one where there's any real ability to adjust how the
I/O is partitioned beyond adjusting what slot you plug things into so
that's probably a dead end anyway.  Given the original symptoms, one thing
I would be suspicious of though is whether there's some sort of IRQ
conflict going on.  Sadly we still haven't left that kind of junk behind
even on current PC motherboards.

Thanks, Greg.  After a little digging, 3-ware suggested moving one of the cards, also.  We will probably give that a try.  I'll also look into the bios, but since the machine is running as a fileserver, there is precious little time for downtime tinkering.  FYI, here are the specs on the server.

http://www.thinkmate.com/System/8U_Dual_Xeon_i2SS40-8U_Storage_Server

Sean


------=_Part_5306_9532304.1200661422109--