X-Original-To: pgsql-performance-postgresql.org@localhost.postgresql.org Received: from localhost (unknown [200.46.204.144]) by svr1.postgresql.org (Postfix) with ESMTP id 3D1955298B for ; Thu, 28 Jul 2005 21:13:32 -0300 (ADT) Received: from svr1.postgresql.org ([200.46.204.71]) by localhost (av.hub.org [200.46.204.144]) (amavisd-new, port 10024) with ESMTP id 53994-07 for ; Fri, 29 Jul 2005 00:13:27 +0000 (GMT) Received: from larry.aptalaska.net (larry.aptalaska.net [64.186.96.3]) by svr1.postgresql.org (Postfix) with ESMTP id 487EE529B6 for ; Thu, 28 Jul 2005 21:13:22 -0300 (ADT) Received: from [192.168.98.9] (rdbck-static-287.palmer.mtaonline.net [64.4.232.33]) (authenticated bits=0) by larry.aptalaska.net (8.13.4/8.13.4) with ESMTP id j6T0Qgja015145 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO) for ; Thu, 28 Jul 2005 16:26:43 -0800 Message-ID: <42E9749F.6000709@aptalaska.net> Date: Thu, 28 Jul 2005 16:13:19 -0800 From: Matthew Schumacher User-Agent: Mozilla Thunderbird 1.0.2 (X11/20050317) X-Accept-Language: en-us, en MIME-Version: 1.0 To: pgsql-performance@postgresql.org Subject: Re: Performance problems testing with Spamassassin 3.1.0 References: <42E80C28.2040608@aptalaska.net> <1122532023.25574.1.camel@localhost.localdomain> In-Reply-To: <1122532023.25574.1.camel@localhost.localdomain> X-Enigmail-Version: 0.91.0.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit X-Spam-Bayes: Learn: ham X-Scanned-By: MIMEDefang 2.52 on 64.186.96.3 X-Virus-Scanned: by amavisd-new at hub.org X-Spam-Status: No, hits=0 tagged_above=0 required=5 tests= X-Spam-Level: X-Archive-Number: 200507/449 X-Sequence-Number: 13690 Karim Nassar wrote: > On Wed, 2005-07-27 at 14:35 -0800, Matthew Schumacher wrote: > > >>I put the rest of the schema up at >>http://www.aptalaska.net/~matt.s/bayes/bayes_pg.sql in case someone >>needs to see it too. > > > Do you have sample data too? > Ok, I finally got some test data together so that others can test without installing SA. The schema and test dataset is over at http://www.aptalaska.net/~matt.s/bayes/bayesBenchmark.tar.gz I have a pretty fast machine with a tuned postgres and it takes it about 2 minutes 30 seconds to load the test data. Since the test data is the bayes information on 616 spam messages than comes out to be about 250ms per message. While that is doable, it does add quite a bit of overhead to the email system. Perhaps this is as fast as I can expect it to go, if that's the case I may have to look at mysql, but I really don't want to do that. I will be working on some other benchmarks, and reading though exactly how bayes works, but at least there is some data to play with. schu