From: Andy Colson <andy@squeakycode.net>
To: maplabs@light42.com
Cc: pgsql-performance@postgresql.org, Garlynn Woodsong <Garlynn@calthorpe.com>
Cc: nick@calthorpe.com
Cc: rush@winkey.org
Subject: Re: Shared memory for large PostGIS operations
Date: Fri, 16 Mar 2012 08:55:39 -0500
Message-ID: <4F63465B.1020508@squeakycode.net> (raw)
In-Reply-To: <20120314212924.h7sjvzeoococwso0@webmail.light42.com>
References: <20120314212924.h7sjvzeoococwso0@webmail.light42.com>
So let me clean that up for you:
> On 3/14/2012 11:29 PM, maplabs@light42.com wrote:
Hello list, my name is Brian Hamlin, but I prefer to go by darkblue, its
mysterious and dangerous!
I run PG 9.1, PostGIS 1.5.3, Linux 64 on Dual Xeons, OS on a single
drive, and db is on 3-disk raid 5. I'm the only user.
work_mem = 640M
I do these huge monolithic postGIS queries on an otherwise idle linux
machine. python driven analysis.. 15 steps.. some, unusual for me, are
multiple queries running at once on the same data ... and others are
just one labor intensive thing then the next (one result table is 1.8M
rows for 745M on disk, others are smaller)
I tried shared_buffers at both 2400M and 18000M, and it took 4.5 hours
both times. I dont know if I am CPU bound or IO bound, but since giving
PG more ram didnt help much, I'll assume I'm CPU bound. I heard of this
program called vmstat that I'll read up on and post some results for.
I don't know how much memory my box has, and I've never run explain
analyze, but I'll try it out and post some. I just learned about
http://explain.depesz.com/ and figure it might help me.
This is the best list ever! Thanks all! (especially that poetic Dave
Fetter, and that somewhat mean, but helpful, Andy Colson)
Shout outs to my friends Garlynn, Nick and Rush (best band ever!).
Party, my house, next week!
> ==
> (Virtually) Brian Hamlin
> GeoCal
> OSGeo California Chapter
> 415-717-4462 cell
-Andy
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Reply to all the recipients using the --to and --cc options:
reply via email
To: pgsql-performance@postgresql.org
Cc: andy@squeakycode.net, maplabs@light42.com, Garlynn@calthorpe.com, nick@calthorpe.com, rush@winkey.org
Subject: Re: Shared memory for large PostGIS operations
In-Reply-To: <4F63465B.1020508@squeakycode.net>
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox