pg.ddx.io  pgsql-sql@postgresql.org mailing list archive  
help / color / mirror / Atom feed
From: Frank Morton <fmorton@base2inc.com>
To: Tom Lane <tgl@sss.pgh.pa.us>
Cc: Vadim Mikheev <vadim@krs.ru>
Cc: pgsql-sql@hub.org
Subject: Re: [SQL] Slow Inserts Again
Date: Mon, 3 May 1999 10:33:53 -0500
Message-ID: <070701be957a$59f46450$8355e5ce@base2inc.com> (raw)

>But the transaction boundaries wouldn't have anything to do with
>Frank's real problem, which is that the insertions are getting
>slower and slower.  There's no good reason for that; and other
>people are not reporting any comparable problems.  (Considering
>that we *have* been getting trouble reports for more-than-2-gig
>tables, it's clear that people are putting large amounts of data
>into 6.5; so it's not like Frank is stressing the system more
>than it has been before.)

I should have made it more clear. I am using 6.4.2 with the "limit"
addition.

>Frank, what does the memory usage of the backend that's processing
>this insertion look like; has it been growing steadily?  I'm wondering
>whether you could have a problem with poor malloc behavior, or some
>such.

Using "ps" there is only on process accumlating lots of time. One backend
process has accumulated 2036 minutes of cpu time. Using vmstat, it
looks like things are ok memory wise. Almost nothing swapped and
a few megabytes marked as free. The CPU is 0% idle. The whole system
is now starting to melt down, though. Even moving the mouse takes
a few seconds for it to move. But, looking around, I don't see any other
process doing anything really.

I'm up to 13 seconds now per insert.

I'm about to punt again and go back to figuring out how to make copy
work. At this point, I'd have to convert the insert statements to copy.

Thanks all for helping figure this out...

Frank







view thread (16+ messages)  latest in thread

Message-ID: <070701be957a$59f46450$8355e5ce@base2inc.com>
Permalink:  ../070701be957a$59f46450$8355e5ce@base2inc.com/
Also on:    postgresql.org/message-id/070701be957a$59f46450$8355e5ce@base2inc.com

 · 

reply

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Reply to all the recipients from your mail client; the link fills in
  the headers below: reply via email
  Some clients, webmail especially, drop In-Reply-To and References from
  a link, and the reply then starts a new thread: use the mbox below.

  To: pgsql-sql@postgresql.org
  Cc: fmorton@base2inc.com, tgl@sss.pgh.pa.us, vadim@krs.ru, pgsql-sql@hub.org
  Subject: Re: [SQL] Slow Inserts Again
  In-Reply-To: <070701be957a$59f46450$8355e5ce@base2inc.com>
  References: <070701be957a$59f46450$8355e5ce@base2inc.com>

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox