X-Original-To: pgsql-performance-postgresql.org@localhost.postgresql.org Received: from localhost (unknown [200.46.204.144]) by svr1.postgresql.org (Postfix) with ESMTP id CB5965355C for ; Wed, 20 Apr 2005 21:26:01 -0300 (ADT) Received: from svr1.postgresql.org ([200.46.204.71]) by localhost (av.hub.org [200.46.204.144]) (amavisd-new, port 10024) with ESMTP id 91047-08 for ; Thu, 21 Apr 2005 00:25:56 +0000 (GMT) Received: from vms046pub.verizon.net (vms046pub.verizon.net [206.46.252.46]) by svr1.postgresql.org (Postfix) with ESMTP id D9E0B5354A for ; Wed, 20 Apr 2005 21:25:54 -0300 (ADT) Received: from jfradkin ([63.162.100.127]) by vms046.mailsrvcs.net (Sun Java System Messaging Server 6.2 HotFix 0.04 (built Dec 24 2004)) with ESMTPA id <0IF900AZNT790433@vms046.mailsrvcs.net> for pgsql-performance@postgresql.org; Wed, 20 Apr 2005 19:25:58 -0500 (CDT) Date: Wed, 20 Apr 2005 20:26:08 -0400 From: "Joel Fradkin" Subject: Re: Joel's Performance Issues WAS : Opteron vs Xeon In-reply-to: <4266BEB0.3050008@arbash-meinel.com> To: "'John A Meinel'" Cc: , Message-id: <001901c54608$b70ccfc0$797ba8c0@jfradkin> MIME-version: 1.0 X-MIMEOLE: Produced By Microsoft MimeOLE V6.00.2900.2180 X-Mailer: Microsoft Outlook, Build 10.0.6626 Content-type: text/plain; charset=US-ASCII Content-transfer-encoding: quoted-printable Importance: Normal X-Priority: 3 (Normal) X-MSMail-priority: Normal X-Virus-Scanned: by amavisd-new at hub.org X-Spam-Status: No, hits=0 tagged_above=0 required=5 tests=AWL X-Spam-Level: X-Archive-Number: 200504/543 X-Sequence-Number: 11940 I did think of something similar just loading the data tables with junk records and I may visit that idea with Josh. I did just do some comparisons on timing of a plain select * from tbl = where indexed column =3D x and it was considerably slower then both MSSQL and = MYSQL, so I am still a bit confused. This still might be configuration issue (I = ran on my 2gig desktop and the 8 gig Linux box comparisons were all ran on = the same machines as far MSSQL, MYSQL, and Postgres. I turned off postgres when running MYSQL and turned off MYSQL when = running postgres, MSSQL had one of the two running while I tested it. For the 360,000 records returned MYSQL did it in 40 seconds first run = and 17 seconds second run. MSSQL did it in 56 seconds first run and 16 seconds second run. Postgres was on the second run Total query runtime: 17109 ms. Data retrieval runtime: 72188 ms. 331640 rows retrieved. So like 89 on the second run. The first run was 147 secs all told. These are all on my 2 meg desktop running XP. I can post the config. I noticed the postgres was using 70% of the cpu = while MSSQL was 100%. Joel Fradkin =20 >I would of spent more $ with Command, but he does need my data base to = help >me and I am not able to do that. > > ... What if someone were to write an anonymization script. Something that changes any of the "data" of the database, but leaves all of the relational information. It could turn all strings into some sort of hashed version, so you don't give out any identifiable information. It could even modify relational entries, as long as it updated both ends, and this didn't affect the actual performance at all. I don't think this would be very hard to write. Especially if you can give a list of the tables, and what columns need to be modified. Probably this would generally be a useful script to have for cases like this where databases are confidential, but need to be tuned by someone = else. Would that be reasonable? I would think that by renaming columns, hashing the data in the columns, and renaming tables, most of the proprietary information is removed, without removing the database information. John =3D:->