pg.ddx.io  pgsql-hackers@postgresql.org mailing list archive  

help / color / mirror / Atom feed
From: Nico Williams <nico@cryptonector.com>
To: Konstantin Knizhnik <k.knizhnik@postgrespro.ru>
Cc: Robbie Harwood <rharwood@redhat.com>
Cc: Thomas Munro <thomas.munro@enterprisedb.com>
Cc: Grigory Smolkin <g.smolkin@postgrespro.ru>
Cc: PostgreSQL Hackers <pgsql-hackers@lists.postgresql.org>
Subject: Re: libpq compression
Date: Fri, 22 Jun 2018 11:05:43 -0500
Message-ID: <20180622160543.GM4200@localhost> (raw)
In-Reply-To: <6eee9b98-0d77-c6a4-c800-6a9332c6010d@postgrespro.ru>
References: <CAEepm=3RAS8xVQK8rs+Xitzp+JXzGdGsMA7f+H8fjKQ7Do8aSA@mail.gmail.com>
	<f4ad0809-dd90-e321-5c1a-0ca68a136a8f@postgrespro.ru>
	<jlg4lhzdeak.fsf@redhat.com>
	<3b0260da-fe47-2341-da01-51383fe9172d@postgrespro.ru>
	<jlgzhzqbi84.fsf@redhat.com>
	<15419613-35b5-0ff6-6261-834abf73330c@postgrespro.ru>
	<jlgo9g5qjst.fsf@redhat.com>
	<9b3a735c-06c2-631f-8e97-e3982e575210@postgrespro.ru>
	<20180621213404.GK4200@localhost>
	<6eee9b98-0d77-c6a4-c800-6a9332c6010d@postgrespro.ru>

On Fri, Jun 22, 2018 at 10:18:12AM +0300, Konstantin Knizhnik wrote:
> On 22.06.2018 00:34, Nico Williams wrote:
> >So I think you just have to have lengths.
> >
> >Now, this being about compression, I understand that you might now want
> >to have 4-byte lengths, especially given that most messages will be
> >under 8KB.  So use a varint encoding for the lengths.
>
> No explicit framing and lengths are needed in case of using streaming
> compression.
> There can be certainly some kind of frames inside compression protocol
> itself, but it is intrinsic of compression algorithm.

I don't think that's generally true.  It may be true of the compression
algorithm you're working with.  This is fine, of course, but plugging in
other compression algorithms will require the authors to add framing.




view thread (289+ messages)  latest in thread

Message-ID: <20180622160543.GM4200@localhost>
Permalink:  ../20180622160543.GM4200@localhost/
Also on:    postgresql.org/message-id/20180622160543.GM4200@localhost

 · 

reply
Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Reply to all the recipients using the --to and --cc options:
  reply via email

  To: pgsql-hackers@postgresql.org
  Cc: nico@cryptonector.com, k.knizhnik@postgrespro.ru, rharwood@redhat.com, thomas.munro@enterprisedb.com, g.smolkin@postgrespro.ru, pgsql-hackers@lists.postgresql.org
  Subject: Re: libpq compression
  In-Reply-To: <20180622160543.GM4200@localhost>

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox