From: Karim Nassar <karim.nassar@acm.org>
To: Matthew Schumacher <matt.s@aptalaska.net>
Cc: pgsql-performance@postgresql.org
Subject: Re: Performance problems testing with Spamassassin
Date: Sat, 30 Jul 2005 03:34:00 -0700
Message-ID: <1122719640.7426.173.camel@localhost.localdomain> (raw)
In-Reply-To: <42EB3E63.6040300@aptalaska.net>
References: <3E37B936B592014B978C4415F90D662D0C4221@MI8NYCMAIL06.Mi8.com>
<200507290947.03700.josh@agliodbs.com>
<1122683983.11869.150.camel@localhost.localdomain>
<42EB3E63.6040300@aptalaska.net>
On Sat, 2005-07-30 at 00:46 -0800, Matthew Schumacher wrote:
> I'll do some more testing on Monday, perhaps grouping even 200 tokens at
> a time using your method will yield significant gains, but probably not
> as dramatic as it does using my loading benchmark.
In that case, some of the clauses could be simplified further since we
know that we are dealing with only one user. I don't know what that will
get us, since postgres is so damn clever.
I suspect that the aggregate functions will be more efficient when you
do this, since the temp table will be much smaller, but I am only
guessing at this point.
If you need to support a massive initial data load, further time savings
are to be had by doing COPY instead of 126,000 inserts.
Please do keep us updated.
Thanking all the gods and/or developers for spamassassin,
--
Karim Nassar <karim.nassar@acm.org>
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Reply to all the recipients using the --to and --cc options:
reply via email
To: pgsql-performance@postgresql.org
Cc: karim.nassar@acm.org, matt.s@aptalaska.net
Subject: Re: Performance problems testing with Spamassassin
In-Reply-To: <1122719640.7426.173.camel@localhost.localdomain>
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox