pg.ddx.io pgsql-admin@postgresql.org mailing list archive
help / color / mirror / Atom feedPerformance Tuning
6+ messages / 6 participants
[nested] [flat]
* Performance Tuning
@ 2002-01-09 21:19 Trevor Astrope <astrope@e-corp.net>
0 siblings, 0 replies; 6+ messages in thread
From: Trevor Astrope @ 2002-01-09 21:19 UTC (permalink / raw)
To: pgsql-admin
Hello,
Can anyone help me with some performance tuning questions...
I have a new dedicated postgresql machine running red hat 7.2 with
postgresql 7.1.3.
The machine is a compaq with dual 1 ghz cpu's, 2gb ram 3 10k ultra3 sci
disks with a compaq raid5 controler. The filesystem is ext3.
There is one database about 6gb in size on the filesystem, with a total of
247 tables, ranging in size from small to approx 10 million rows.
What are some suggested values for the postgresql.conf file to take full
advantage of the system resources?
Here is what I'm using so far:
# Performance
#
#sort_mem = 512
sort_mem = 131072
#shared_buffers = 2*max_connections # min 16
shared_buffers = 65536
#fsync = true
Everything else is at defaults, since I really don't know what are
reasonable values for the optimizing stuff...
What about the wal_buffers...Should they be increased from 8? If so to
what?
The reason I ask is because this server is significantly more powerful
than the previous one and I'm not really seeing much performance gain and
actually experiencing some performance loss compared with the postgresql
7.0.2 installation on a shared web, app, database, mail, dns server... I
suspect some of it is due to enabling logging and tcp connections between
the DMZ and MZ, rather than the local domain socket, but I think this new
server could do better...
Any help is appreciated.
Regards,
Trevor Astrope
astrope@e-corp.net
^ permalink raw reply [nested|flat] 6+ messages in thread
* Performance tuning...
@ 2008-01-02 15:34 Carol Walter <walterc@indiana.edu>
0 siblings, 3 replies; 6+ messages in thread
From: Carol Walter @ 2008-01-02 15:34 UTC (permalink / raw)
To: pgsql-admin
Greetings and Salutations...
This has probably been discussed a number of times, but I really need
your help. I am upgrading from 8.1 to 8.2. Right now I have the
restore of the database to the new version running. It has been
running since December 21, at 4:30 PM. I'm in a University
environment and we're in the midst of winter break, so there is very
little processing going on on my systems. This is actually a test
run of the upgrade. I thought I would be able to do the test and
live during the break but as slow as this thing is going, I may be
lucky just to finish the test. This brings me to my question. Is
there any performance tuning I can do to make this think run faster?
This is a Sun box running Solaris 10.
Carol
^ permalink raw reply [nested|flat] 6+ messages in thread
* Re: Performance tuning...
@ 2008-01-02 15:57 Sattler, Thomas (IT) <Thomas.Sattler@morganstanley.com>
parent: Carol Walter <walterc@indiana.edu>
2 siblings, 1 reply; 6+ messages in thread
From: Sattler, Thomas \(IT\) @ 2008-01-02 15:57 UTC (permalink / raw)
To: Carol Walter <walterc@indiana.edu>; pgsql-admin
Cache, cache, cache, cache.
Thomas Sattler
Morgan Stanley | Technology
750 Seventh Avenue, 14th Floor | New York, NY 10019
Phone: +1 212 762-1212
Thomas.Sattler@morganstanley.com
> -----Original Message-----
> From: pgsql-admin-owner@postgresql.org
> [mailto:pgsql-admin-owner@postgresql.org] On Behalf Of Carol Walter
> Sent: Wednesday, January 02, 2008 10:35 AM
> To: pgsql-admin@postgresql.org
> Subject: [ADMIN] Performance tuning...
>
> Greetings and Salutations...
>
> This has probably been discussed a number of times, but I
> really need your help. I am upgrading from 8.1 to 8.2.
> Right now I have the restore of the database to the new
> version running. It has been running since December 21, at
> 4:30 PM. I'm in a University environment and we're in the
> midst of winter break, so there is very little processing
> going on on my systems. This is actually a test run of the
> upgrade. I thought I would be able to do the test and live
> during the break but as slow as this thing is going, I may be
> lucky just to finish the test. This brings me to my question. Is
> there any performance tuning I can do to make this think run
> faster?
> This is a Sun box running Solaris 10.
>
> Carol
>
> ---------------------------(end of
> broadcast)---------------------------
> TIP 1: if posting/reading through Usenet, please send an appropriate
> subscribe-nomail command to majordomo@postgresql.org
> so that your
> message can get through to the mailing list cleanly
>
--------------------------------------------------------
NOTICE: If received in error, please destroy and notify sender. Sender does not intend to waive confidentiality or privilege. Use of this email is prohibited when received in error.
^ permalink raw reply [nested|flat] 6+ messages in thread
* Re: Performance tuning...
@ 2008-01-02 16:02 Scott Marlowe <scott.marlowe@gmail.com>
parent: Carol Walter <walterc@indiana.edu>
2 siblings, 0 replies; 6+ messages in thread
From: Scott Marlowe @ 2008-01-02 16:02 UTC (permalink / raw)
To: Carol Walter <walterc@indiana.edu>; +Cc: pgsql-admin
On Jan 2, 2008 9:34 AM, Carol Walter <walterc@indiana.edu> wrote:
> Greetings and Salutations...
>
> This has probably been discussed a number of times, but I really need
> your help. I am upgrading from 8.1 to 8.2. Right now I have the
> restore of the database to the new version running. It has been
> running since December 21, at 4:30 PM. I'm in a University
> environment and we're in the midst of winter break, so there is very
> little processing going on on my systems. This is actually a test
> run of the upgrade. I thought I would be able to do the test and
> live during the break but as slow as this thing is going, I may be
> lucky just to finish the test. This brings me to my question. Is
> there any performance tuning I can do to make this think run faster?
> This is a Sun box running Solaris 10.
That's a VERY long time for a restore to be running. You might want
to look at using pgbulkloader on your data if that helps.
Hard to say what's going wrong with this overview of info.
How big is the database on disk?
How big is the backup?
Where is the backup spending most of its time? restoring tables or
creating indexes or what?
What are you running out of? CPU, I/O, etc... vmstat iostat and top
can help figure that out.
What kind of disk subsystem do you have?
How many CPUs and how much memory does this machine have?
You can turn off fsync during the restore (good idea to turn it back
on when you're done though)
Turn up maintenance_work_mem to something in the 512M to 1G range
(depending on how much memory your machine has)
^ permalink raw reply [nested|flat] 6+ messages in thread
* Re: Performance tuning...
@ 2008-01-02 16:02 Tino Schwarze <postgresql@tisc.de>
parent: Carol Walter <walterc@indiana.edu>
2 siblings, 0 replies; 6+ messages in thread
From: Tino Schwarze @ 2008-01-02 16:02 UTC (permalink / raw)
To: pgsql-admin
Hi Carol,
On Wed, Jan 02, 2008 at 10:34:47AM -0500, Carol Walter wrote:
> This has probably been discussed a number of times, but I really need
> your help. I am upgrading from 8.1 to 8.2. Right now I have the
> restore of the database to the new version running. It has been
> running since December 21, at 4:30 PM. I'm in a University
> environment and we're in the midst of winter break, so there is very
> little processing going on on my systems. This is actually a test
> run of the upgrade. I thought I would be able to do the test and
> live during the break but as slow as this thing is going, I may be
> lucky just to finish the test. This brings me to my question. Is
> there any performance tuning I can do to make this think run faster?
> This is a Sun box running Solaris 10.
The restore has been running for over 12 days now? How large is the
database? Did you adjust any settings in postgresql.conf (probably based
on the 8.1 ones)? Do you see anything in PostgreSQL's log file? What
kind of machine are you using (there are a lot of different Sun
boxes...)
Bye,
Tino.
--
www.craniosacralzentrum.de
www.spiritualdesign-chemnitz.de
Tino Schwarze * Parkstraße 17h * 09120 Chemnitz
^ permalink raw reply [nested|flat] 6+ messages in thread
* Re: Performance tuning...
@ 2008-01-02 18:48 Naomi Walker <nwalker@mhs.mphasis.com>
parent: Sattler, Thomas (IT) <Thomas.Sattler@morganstanley.com>
0 siblings, 0 replies; 6+ messages in thread
From: Naomi Walker @ 2008-01-02 18:48 UTC (permalink / raw)
To: Sattler, Thomas (IT) <Thomas.Sattler@morganstanley.com>; +Cc: Carol Walter <walterc@indiana.edu>; pgsql-admin
Sattler, Thomas (IT) wrote:
> Cache, cache, cache, cache.
>
and consider dropping all indices until after the load is completed..
>
> Thomas Sattler
> Morgan Stanley | Technology
> 750 Seventh Avenue, 14th Floor | New York, NY 10019
> Phone: +1 212 762-1212
> Thomas.Sattler@morganstanley.com
>
>
>
>> -----Original Message-----
>> From: pgsql-admin-owner@postgresql.org
>> [mailto:pgsql-admin-owner@postgresql.org] On Behalf Of Carol Walter
>> Sent: Wednesday, January 02, 2008 10:35 AM
>> To: pgsql-admin@postgresql.org
>> Subject: [ADMIN] Performance tuning...
>>
>> Greetings and Salutations...
>>
>> This has probably been discussed a number of times, but I
>> really need your help. I am upgrading from 8.1 to 8.2.
>> Right now I have the restore of the database to the new
>> version running. It has been running since December 21, at
>> 4:30 PM. I'm in a University environment and we're in the
>> midst of winter break, so there is very little processing
>> going on on my systems. This is actually a test run of the
>> upgrade. I thought I would be able to do the test and live
>> during the break but as slow as this thing is going, I may be
>> lucky just to finish the test. This brings me to my question. Is
>> there any performance tuning I can do to make this think run
>> faster?
>> This is a Sun box running Solaris 10.
>>
>> Carol
>>
>> ---------------------------(end of
>> broadcast)---------------------------
>> TIP 1: if posting/reading through Usenet, please send an appropriate
>> subscribe-nomail command to majordomo@postgresql.org
>> so that your
>> message can get through to the mailing list cleanly
>>
>>
> --------------------------------------------------------
>
> NOTICE: If received in error, please destroy and notify sender. Sender does not intend to waive confidentiality or privilege. Use of this email is prohibited when received in error.
>
> ---------------------------(end of broadcast)---------------------------
> TIP 4: Have you searched our list archives?
>
> http://archives.postgresql.org
>
--
------------------------------------------------------------------------
Naomi Walker Chief Information Officer
Mphasis Healthcare Solutions nwalker@mhs.mphasis.com
---An EDS Company 602-604-3100
------------------------------------------------------------------------
Excellence is not a skill. It is an attitude. --Ralph Marston
------------------------------------------------------------------------
-- CONFIDENTIALITY NOTICE --
Information transmitted by this e-mail is proprietary to MphasiS and/or its Customers and is intended for use only by the individual or entity to which it is addressed, and may contain information that is privileged, confidential or exempt from disclosure under applicable law. If you are not the intended recipient or it appears that this e-mail has been forwarded to you without proper authority, you are notified that any use or dissemination of this information in any manner is strictly prohibited. In such cases, please notify us immediately at mailmaster@mphasis.com and delete this mail from your records.
^ permalink raw reply [nested|flat] 6+ messages in thread
end of thread, other threads:[~2008-01-02 18:48 UTC | newest]
Thread overview: 6+ messages (download: mbox mbox.gz follow: Atom feed)
-- links below jump to the message on this page --
2002-01-09 21:19 Performance Tuning Trevor Astrope <astrope@e-corp.net>
2008-01-02 15:34 Performance tuning... Carol Walter <walterc@indiana.edu>
2008-01-02 15:57 ` Re: Performance tuning... Sattler, Thomas (IT) <Thomas.Sattler@morganstanley.com>
2008-01-02 18:48 ` Re: Performance tuning... Naomi Walker <nwalker@mhs.mphasis.com>
2008-01-02 16:02 ` Re: Performance tuning... Scott Marlowe <scott.marlowe@gmail.com>
2008-01-02 16:02 ` Re: Performance tuning... Tino Schwarze <postgresql@tisc.de>
This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox