pg.ddx.io pgsql-performance@postgresql.org mailing list archive
help / color / mirror / Atom feedPage Size in Future Releases
6+ messages / 6 participants
[nested] [flat]
* Page Size in Future Releases
@ 2003-03-20 20:45 Kendrick C. Wilson <kendrick_wilson@hotmail.com>
2003-03-21 03:39 ` Re: Page Size in Future Releases Shridhar Daithankar<shridhar_daithankar@persistent.co.in> <shridhar_daithankar@persistent.co.in>
2003-03-22 00:15 ` Re: Page Size in Future Releases Tom Lane <tgl@sss.pgh.pa.us>
0 siblings, 2 replies; 6+ messages in thread
From: Kendrick C. Wilson @ 2003-03-20 20:45 UTC (permalink / raw)
To: pgsql-performance
Will a increase in the size of a data page increase performance of a
database with large records?
I have records about 881 byte + 40 byte (header) = 921.
8k page size / 921 bytes per record is ONLY 8 records...........
Comments are welcome.........
k=n^r/ck, SCJP
_________________________________________________________________
MSN 8 with e-mail virus protection service: 2 months FREE*
http://join.msn.com/?page=features/virus
^ permalink raw reply [nested|flat] 6+ messages in thread
* Re: Page Size in Future Releases
2003-03-20 20:45 Page Size in Future Releases Kendrick C. Wilson <kendrick_wilson@hotmail.com>
@ 2003-03-21 03:39 ` Shridhar Daithankar<shridhar_daithankar@persistent.co.in> <shridhar_daithankar@persistent.co.in>
2003-03-21 03:51 ` Re: Page Size in Future Releases Christopher Kings-Lynne <chriskl@familyhealth.com.au>
2003-03-21 04:03 ` Re: Page Size in Future Releases Josh Berkus <josh@agliodbs.com>
1 sibling, 2 replies; 6+ messages in thread
From: "Shridhar Daithankar @ 2003-03-21 03:39 UTC (permalink / raw)
To: pgsql-performance
On Friday 21 Mar 2003 2:15 am, Kendrick C. Wilson wrote:
> Will a increase in the size of a data page increase performance of a
> database with large records?
>
> I have records about 881 byte + 40 byte (header) = 921.
>
> 8k page size / 921 bytes per record is ONLY 8 records...........
You can tweak it yourself at compile time in some header file and that should
work but that is a point of diminising results as far as hackers are
concerned.
One reason I know where it would help is getting postgresql to use tons of
shaerd memory. Right now postgresql can not use much beyond 250MB(??) because
number of shared buffer are int or something. So if you know your reconrds
are large, are often manipulated and your OS is not so good at file caching,
then increasing page size might help.
Given how good unices are in general in terms of file and memory handling, I
woudl say you should not do it unless your average record size is greater
than 8K, something like a large genome sequence or so.
YMMV..
Shridhar
^ permalink raw reply [nested|flat] 6+ messages in thread
* Re: Page Size in Future Releases
2003-03-20 20:45 Page Size in Future Releases Kendrick C. Wilson <kendrick_wilson@hotmail.com>
2003-03-21 03:39 ` Re: Page Size in Future Releases Shridhar Daithankar<shridhar_daithankar@persistent.co.in> <shridhar_daithankar@persistent.co.in>
@ 2003-03-21 03:51 ` Christopher Kings-Lynne <chriskl@familyhealth.com.au>
1 sibling, 0 replies; 6+ messages in thread
From: Christopher Kings-Lynne @ 2003-03-21 03:51 UTC (permalink / raw)
To: shridhar_daithankar@persistent.co.in; pgsql-performance
> > I have records about 881 byte + 40 byte (header) = 921.
> >
> > 8k page size / 921 bytes per record is ONLY 8 records...........
>
> You can tweak it yourself at compile time in some header file and that
should
> work but that is a point of diminising results as far as hackers are
> concerned.
As far as I'm aware the 8k page size has nothing to do with speed and
everything to do with atomic writes. You can't be guaranteed that the O/S
and hard drive controller will write anything more than 8K in an atomic
block...
Chris
^ permalink raw reply [nested|flat] 6+ messages in thread
* Re: Page Size in Future Releases
2003-03-20 20:45 Page Size in Future Releases Kendrick C. Wilson <kendrick_wilson@hotmail.com>
2003-03-21 03:39 ` Re: Page Size in Future Releases Shridhar Daithankar<shridhar_daithankar@persistent.co.in> <shridhar_daithankar@persistent.co.in>
@ 2003-03-21 04:03 ` Josh Berkus <josh@agliodbs.com>
1 sibling, 0 replies; 6+ messages in thread
From: Josh Berkus @ 2003-03-21 04:03 UTC (permalink / raw)
To: "Shridhar Daithankar <shridhar_daithankar@persistent.co.in>; " <shridhar_daithankar@persistent.co.in>; pgsql-performance
Shridar,
> One reason I know where it would help is getting postgresql to use tons of
> shaerd memory. Right now postgresql can not use much beyond 250MB(??)
> because number of shared buffer are int or something. So if you know your
> reconrds are large, are often manipulated and your OS is not so good at
> file caching, then increasing page size might help.
Um, two fallacies:
1) You can allocate as much shared buffer ram as you want. The maxium I've
tested is 300mb, personally, but I know of no hard limit.
2) However, allocating more shared buffer ram ... in fact anything beyond
about 40mb ... has never been shown by anyone on this list to be helpful for
any size database, and sometimes the contrary.
--
Josh Berkus
Aglio Database Solutions
San Francisco
^ permalink raw reply [nested|flat] 6+ messages in thread
* Re: Page Size in Future Releases
2003-03-20 20:45 Page Size in Future Releases Kendrick C. Wilson <kendrick_wilson@hotmail.com>
@ 2003-03-22 00:15 ` Tom Lane <tgl@sss.pgh.pa.us>
2003-03-23 08:46 ` Re: Page Size in Future Releases Mario Weilguni <mweilguni@sime.com>
1 sibling, 1 reply; 6+ messages in thread
From: Tom Lane @ 2003-03-22 00:15 UTC (permalink / raw)
To: Kendrick C. Wilson <kendrick_wilson@hotmail.com>; +Cc: pgsql-performance
"Kendrick C. Wilson" <kendrick_wilson@hotmail.com> writes:
> Will a increase in the size of a data page increase performance of a
> database with large records?
Probably not; in fact the increased WAL overhead could make it a net
loss. But feel free to try changing BLCKSZ to see how it works for you.
regards, tom lane
^ permalink raw reply [nested|flat] 6+ messages in thread
* Re: Page Size in Future Releases
2003-03-20 20:45 Page Size in Future Releases Kendrick C. Wilson <kendrick_wilson@hotmail.com>
2003-03-22 00:15 ` Re: Page Size in Future Releases Tom Lane <tgl@sss.pgh.pa.us>
@ 2003-03-23 08:46 ` Mario Weilguni <mweilguni@sime.com>
0 siblings, 0 replies; 6+ messages in thread
From: Mario Weilguni @ 2003-03-23 08:46 UTC (permalink / raw)
To: pgsql-performance
Am Samstag, 22. März 2003 01:15 schrieb Tom Lane:
> "Kendrick C. Wilson" <kendrick_wilson@hotmail.com> writes:
> > Will a increase in the size of a data page increase performance of a
> > database with large records?
>
> Probably not; in fact the increased WAL overhead could make it a net
> loss. But feel free to try changing BLCKSZ to see how it works for you.
I've several database with 32KB and 8KB, and though the results are not really comparable due to slight different hardware, I've the feeling that 8KB buffers work best in most cases. The only difference I noticed are large objects which seem to work slightly better with larger sizes.
Regards,
Mario Weilguni
^ permalink raw reply [nested|flat] 6+ messages in thread
end of thread, other threads:[~2003-03-23 08:46 UTC | newest]
Thread overview: 6+ messages (download: mbox mbox.gz follow: Atom feed)
-- links below jump to the message on this page --
2003-03-20 20:45 Page Size in Future Releases Kendrick C. Wilson <kendrick_wilson@hotmail.com>
2003-03-21 03:39 ` Shridhar Daithankar<shridhar_daithankar@persistent.co.in> <shridhar_daithankar@persistent.co.in>
2003-03-21 03:51 ` Christopher Kings-Lynne <chriskl@familyhealth.com.au>
2003-03-21 04:03 ` Josh Berkus <josh@agliodbs.com>
2003-03-22 00:15 ` Tom Lane <tgl@sss.pgh.pa.us>
2003-03-23 08:46 ` Mario Weilguni <mweilguni@sime.com>
This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox