pg.ddx.io  pgsql-performance@postgresql.org mailing list archive  
help / color / mirror / Atom feed
SAN performance
4+ messages / 3 participants
[nested] [flat]

* SAN performance
@ 2004-09-22 21:49  Anjan Dave <adave@vantage.com>
  0 siblings, 1 reply; 4+ messages in thread

From: Anjan Dave @ 2004-09-22 21:49 UTC (permalink / raw)
  To: pgsql-performance

Hello,

 

I'll be moving a DB from internal RAID-10 SCSI storage to an EMC CX300
FC RAID-10 LUN, bound to the host. I've setup a test host machine and a
test LUN. The /var/lib/pgsql/data folder is sym-linked to a partition on
the LUN. 

 

Other than the shared_buffers, effective cache size, and sort memory, I
am not sure if I need to change any other parameters in the
postgresql.conf file for getting maximum performance from the EMC box.

 

Is there a general guideline for setting up postgres database and the
tunable parameters on a SAN, especially for EMC?

 

Appreciate any help,

 

Thanks,
Anjan

^ permalink  raw  reply  [nested|flat] 4+ messages in thread

* Re: SAN performance
@ 2004-09-23 15:39  Mr Pink <mr_pink_is_the_only_pro@yahoo.com>
  parent: Anjan Dave <adave@vantage.com>
  0 siblings, 0 replies; 4+ messages in thread

From: Mr Pink @ 2004-09-23 15:39 UTC (permalink / raw)
  To: Anjan Dave <adave@vantage.com>; pgsql-performance

Hi,

I expect you mean RAID 1/0 or 1+0 since the CX300 didn't support RAID 10 last time I looked.

Whether you are using a SAN or not, you should consider putting the WAL files (pg_xlog folder) on
seperate diskes from the DB. Since the log files are mostly written to, not read from you could
just use RAID 1. 

It's a pity pg doesn't have a way to use a cluster of servers to get the most out of your
expensive SAN.

I read a comment earlier about setting block sizes to 8k to math pg's block size. Seems to make
sense, you should check it out.

Have fun,
Mr Pink

--- Anjan Dave <adave@vantage.com> wrote:

> Hello,
> 
>  
> 
> I'll be moving a DB from internal RAID-10 SCSI storage to an EMC CX300
> FC RAID-10 LUN, bound to the host. I've setup a test host machine and a
> test LUN. The /var/lib/pgsql/data folder is sym-linked to a partition on
> the LUN. 
> 
>  
> 
> Other than the shared_buffers, effective cache size, and sort memory, I
> am not sure if I need to change any other parameters in the
> postgresql.conf file for getting maximum performance from the EMC box.
> 
>  
> 
> Is there a general guideline for setting up postgres database and the
> tunable parameters on a SAN, especially for EMC?
> 
>  
> 
> Appreciate any help,
> 
>  
> 
> Thanks,
> Anjan
> 
> 



	
		
__________________________________
Do you Yahoo!?
New and Improved Yahoo! Mail - 100MB free storage!
http://promotions.yahoo.com/new_mail 



^ permalink  raw  reply  [nested|flat] 4+ messages in thread

* Re: SAN performance
@ 2004-09-23 18:05  Anjan Dave <adave@vantage.com>
  0 siblings, 1 reply; 4+ messages in thread

From: Anjan Dave @ 2004-09-23 18:05 UTC (permalink / raw)
  To: Mr Pink <mr_pink_is_the_only_pro@yahoo.com>; pgsql-performance

I believe 1/0 or 1+0 is aka RAID-10. CX300 doesn't support 0+1.
 
So far i am aware of two things, the cache page size is 8KB (can be increased or decreased), and the stripe element size of 128 sectors default.
 
Thanks,
Anjan

	-----Original Message----- 
	From: Mr Pink [mailto:mr_pink_is_the_only_pro@yahoo.com] 
	Sent: Thu 9/23/2004 11:39 AM 
	To: Anjan Dave; pgsql-performance@postgresql.org 
	Cc: 
	Subject: Re: [PERFORM] SAN performance
	
	

	Hi, 

	I expect you mean RAID 1/0 or 1+0 since the CX300 didn't support RAID 10 last time I looked. 

	Whether you are using a SAN or not, you should consider putting the WAL files (pg_xlog folder) on 
	seperate diskes from the DB. Since the log files are mostly written to, not read from you could 
	just use RAID 1. 

	It's a pity pg doesn't have a way to use a cluster of servers to get the most out of your 
	expensive SAN. 

	I read a comment earlier about setting block sizes to 8k to math pg's block size. Seems to make 
	sense, you should check it out. 

	Have fun, 
	Mr Pink 

	--- Anjan Dave <adave@vantage.com> wrote: 

	> Hello, 
	> 
	>  
	> 
	> I'll be moving a DB from internal RAID-10 SCSI storage to an EMC CX300 
	> FC RAID-10 LUN, bound to the host. I've setup a test host machine and a 
	> test LUN. The /var/lib/pgsql/data folder is sym-linked to a partition on 
	> the LUN. 
	> 
	>  
	> 
	> Other than the shared_buffers, effective cache size, and sort memory, I 
	> am not sure if I need to change any other parameters in the 
	> postgresql.conf file for getting maximum performance from the EMC box. 
	> 
	>  
	> 
	> Is there a general guideline for setting up postgres database and the 
	> tunable parameters on a SAN, especially for EMC? 
	> 
	>  
	> 
	> Appreciate any help, 
	> 
	>  
	> 
	> Thanks, 
	> Anjan 
	> 
	> 



	        
	                
	__________________________________ 
	Do you Yahoo!? 
	New and Improved Yahoo! Mail - 100MB free storage! 
	http://promotions.yahoo.com/new_mail 



^ permalink  raw  reply  [nested|flat] 4+ messages in thread

* Re: SAN performance
@ 2004-09-26 20:37  Andrew Hammond <ahammond@ca.afilias.info>
  parent: Anjan Dave <adave@vantage.com>
  0 siblings, 0 replies; 4+ messages in thread

From: Andrew Hammond @ 2004-09-26 20:37 UTC (permalink / raw)
  To: Anjan Dave <adave@vantage.com>; +Cc: Mr Pink <mr_pink_is_the_only_pro@yahoo.com>; pgsql-performance

I'm about to do a whole bunch of testing here on various DA element 
sizes, and datablock sizes and how the affect pg performance. It doesn't 
appear possible to get > 4kb filesystem blocks under linux due to the 
limitation of the pagesize. We're running AMD64 for these tests, but the 
DA configuration should be pretty much identical for IA32.

My best guess right now is that recompiling pg with a 4kb datablock 
size, and using 4kb filesystem blocks with an 8 sector (4kb) element 
size is probably the way to go for an active database.

Contact me off-list if you want a copy of the EMC CLARiiON "Best 
Practices for Fiber Channel Storage" white paper. Haven't read it since 
I only got my copy this morning, but... looks promising.

Drew


Anjan Dave wrote:

> I believe 1/0 or 1+0 is aka RAID-10. CX300 doesn't support 0+1.
>  
> So far i am aware of two things, the cache page size is 8KB (can be increased or decreased), and the stripe element size of 128 sectors default.
>  
> Thanks,
> Anjan
> 
> 	-----Original Message----- 
> 	From: Mr Pink [mailto:mr_pink_is_the_only_pro@yahoo.com] 
> 	Sent: Thu 9/23/2004 11:39 AM 
> 	To: Anjan Dave; pgsql-performance@postgresql.org 
> 	Cc: 
> 	Subject: Re: [PERFORM] SAN performance
> 	
> 	
> 
> 	Hi, 
> 
> 	I expect you mean RAID 1/0 or 1+0 since the CX300 didn't support RAID 10 last time I looked. 
> 
> 	Whether you are using a SAN or not, you should consider putting the WAL files (pg_xlog folder) on 
> 	seperate diskes from the DB. Since the log files are mostly written to, not read from you could 
> 	just use RAID 1. 
> 
> 	It's a pity pg doesn't have a way to use a cluster of servers to get the most out of your 
> 	expensive SAN. 
> 
> 	I read a comment earlier about setting block sizes to 8k to math pg's block size. Seems to make 
> 	sense, you should check it out. 
> 
> 	Have fun, 
> 	Mr Pink 
> 
> 	--- Anjan Dave <adave@vantage.com> wrote: 
> 
> 	> Hello, 
> 	> 
> 	>  
> 	> 
> 	> I'll be moving a DB from internal RAID-10 SCSI storage to an EMC CX300 
> 	> FC RAID-10 LUN, bound to the host. I've setup a test host machine and a 
> 	> test LUN. The /var/lib/pgsql/data folder is sym-linked to a partition on 
> 	> the LUN. 
> 	> 
> 	>  
> 	> 
> 	> Other than the shared_buffers, effective cache size, and sort memory, I 
> 	> am not sure if I need to change any other parameters in the 
> 	> postgresql.conf file for getting maximum performance from the EMC box. 
> 	> 
> 	>  
> 	> 
> 	> Is there a general guideline for setting up postgres database and the 
> 	> tunable parameters on a SAN, especially for EMC? 
> 	> 
> 	>  
> 	> 
> 	> Appreciate any help, 
> 	> 
> 	>  
> 	> 
> 	> Thanks, 
> 	> Anjan 
> 	> 
> 	> 
> 
> 
> 
> 	        
> 	                
> 	__________________________________ 
> 	Do you Yahoo!? 
> 	New and Improved Yahoo! Mail - 100MB free storage! 
> 	http://promotions.yahoo.com/new_mail 
> 
> 
> ---------------------------(end of broadcast)---------------------------
> TIP 8: explain analyze is your friend




^ permalink  raw  reply  [nested|flat] 4+ messages in thread


end of thread, other threads:[~2004-09-26 20:37 UTC | newest]

Thread overview: 4+ messages (download: mbox mbox.gz follow: Atom feed)
-- links below jump to the message on this page --
2004-09-22 21:49 SAN performance Anjan Dave <adave@vantage.com>
2004-09-23 15:39 ` Mr Pink <mr_pink_is_the_only_pro@yahoo.com>
2004-09-23 18:05 Re: SAN performance Anjan Dave <adave@vantage.com>
2004-09-26 20:37 ` Andrew Hammond <ahammond@ca.afilias.info>

This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox