pg.ddx.io  pgsql-sql@postgresql.org mailing list archive  
help / color / mirror / Atom feed
From: Scott Cain <cain@cshl.org>
To: Tom Lane <tgl@sss.pgh.pa.us>
Cc: Joe Conway <mail@joeconway.com>
Cc: pgsql-performance@postgresql.org
Subject: Re: EXTERNAL storage and substring on long strings
Date: 07 Aug 2003 17:15:51 -0400
Message-ID: <1060290951.6795.38.camel@localhost.localdomain> (raw)
In-Reply-To: <8177.1060204101@sss.pgh.pa.us>
References: <1059679600.1429.41.camel@localhost.localdomain>
	<7896.1060202191@sss.pgh.pa.us>
	<3F316A41.6020403@joeconway.com>
	<8177.1060204101@sss.pgh.pa.us>

> snipped much discussion about EXTERNAL storage and substring speed

Joe and Tom,

Thanks for all of your help; I went back to my (nearly) production
database, and executed the `update feature set residues = residues
||'';` and then redid my benchmark.  Here's a summary of the results:

substr in perl                      0.83sec/op
substring on default text column    0.24sec/op
substring on EXTERNAL column        0.0069sec/op

There's that 2 orders of magnitude improvement I was looking for!

Thanks again,
Scott

-- 
------------------------------------------------------------------------
Scott Cain, Ph. D.                                         cain@cshl.org
GMOD Coordinator (http://www.gmod.org/)                     216-392-3087
Cold Spring Harbor Laboratory




view thread (31+ messages)  latest in thread

Message-ID: <1060290951.6795.38.camel@localhost.localdomain>
Permalink:  ../1060290951.6795.38.camel@localhost.localdomain/
Also on:    postgresql.org/message-id/1060290951.6795.38.camel@localhost.localdomain

 · 

reply

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Reply to all the recipients using the --to and --cc options:
  reply via email

  To: pgsql-sql@postgresql.org
  Cc: cain@cshl.org, tgl@sss.pgh.pa.us, mail@joeconway.com, pgsql-performance@postgresql.org
  Subject: Re: EXTERNAL storage and substring on long strings
  In-Reply-To: <1060290951.6795.38.camel@localhost.localdomain>

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox