pg.ddx.io  pgsql-hackers@postgresql.org mailing list archive  
help / color / mirror / Atom feed
From: ktm@rice.edu <ktm@rice.edu>
To: Merlin Moncure <mmoncure@gmail.com>
Cc: Tom Lane <tgl@sss.pgh.pa.us>
Cc: Euler Taveira <euler@timbira.com>
Cc: Pgsql Hackers <pgsql-hackers@postgresql.org>
Subject: Re: libpq compression
Date: Thu, 14 Jun 2012 14:56:01 -0500
Message-ID: <20120614195601.GD6547@aart.rice.edu> (raw)
In-Reply-To: <CAHyXU0wnD=FYzQB3Y=ouJkW9hAx8DeSydiXpibvMA-WavEcYFQ@mail.gmail.com>
References: <4FD9698F.2090407@timbira.com>
	<29853.1339651170@sss.pgh.pa.us>
	<4FD9E70B.9040607@timbira.com>
	<11502.1339699384@sss.pgh.pa.us>
	<CAHyXU0wnD=FYzQB3Y=ouJkW9hAx8DeSydiXpibvMA-WavEcYFQ@mail.gmail.com>

On Thu, Jun 14, 2012 at 02:38:02PM -0500, Merlin Moncure wrote:
> On Thu, Jun 14, 2012 at 1:43 PM, Tom Lane <tgl@sss.pgh.pa.us> wrote:
> > So I've got very little patience with the idea of "let's put in some
> > hooks and then great things will happen".  It would be far better all
> > around if we supported exactly one, well-chosen, method.  But really
> > I still don't see a reason not to let openssl do it for us.
> 
> Well, for toast compression the right choice is definitely one of the
> lz based algorithms (not libz!).  For transport compression you have
> the case of sending large data over very slow and/or expensive links
> in which case you want to use bzip type methods.  But in the majority
> of cases I'd probably be using lz there too.  So if I had to pick just
> one, there you go.  But which one? the lz algorithm with arguably the
> best pedigree (lzo) is gnu but there are many other decent candidates,
> some of which have really tiny implementations.
> 
> merlin
> 

+1 for a very fast compressor/de-compressor. lz4 from Google has
a BSD license and at 8.5X faster compression than zlib(-1) and
5X faster de-compression the zlib (-1), 2X faster than LZO even
would be my pick. 

Regards,
Ken



view thread (289+ messages)  latest in thread

Message-ID: <20120614195601.GD6547@aart.rice.edu>
Permalink:  ../20120614195601.GD6547@aart.rice.edu/
Also on:    postgresql.org/message-id/20120614195601.GD6547@aart.rice.edu

 · 

reply

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Reply to all the recipients using the --to and --cc options:
  reply via email

  To: pgsql-hackers@postgresql.org
  Cc: ktm@rice.edu, mmoncure@gmail.com, tgl@sss.pgh.pa.us, euler@timbira.com
  Subject: Re: libpq compression
  In-Reply-To: <20120614195601.GD6547@aart.rice.edu>

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox