From: Konstantin Knizhnik <k.knizhnik@postgrespro.ru>
To: Andreas Karlsson <andreas@proxel.se>
To: Ashwin Agrawal <aagrawal@pivotal.io>
To: Mark Kirkwood <mark.kirkwood@catalyst.net.nz>
Cc: PostgreSQL mailing lists <pgsql-hackers@postgresql.org>
Subject: Re: Zedstore - compressed in-core columnar storage
Date: Thu, 11 Apr 2019 16:52:33 +0300
Message-ID: <59ef6173-6667-8a02-ff7c-a52c8ce05a4f@postgrespro.ru> (raw)
In-Reply-To: <93222d26-2141-acf2-61ef-3127f57e80e6@proxel.se>
References: <CALfoeiuF-m5jg51mJUPm5GN8u396o5sA2AF5N97vTRAEDYac7w@mail.gmail.com>
<fc2d4f99-1ca6-854f-7025-ec3db94f6e04@catalyst.net.nz>
<f301066e-08e1-a4b6-e058-0c1f24a1cc92@catalyst.net.nz>
<6A2B85A8-1ABD-4F85-981E-C94172D662FD@pivotal.io>
<44cafbdf-0a04-64ef-3cf8-6d5b14b68643@postgrespro.ru>
<93222d26-2141-acf2-61ef-3127f57e80e6@proxel.se>
On 11.04.2019 16:18, Andreas Karlsson wrote:
>
> On 4/11/19 10:46 AM, Konstantin Knizhnik wrote:
>
>> This my results of compressing pbench data using different compressors:
>>
>> Configuration Size (Gb) Time (sec)
>> no compression
>> 15.31 92
>> zlib (default level) 2.37 284
>> zlib (best speed) 2.43 191
>> postgres internal lz 3.89 214
>> lz4 4.12
>> 95
>> snappy 5.18 99
>> lzfse 2.80 1099
>> (apple) 2.80 1099
>> 1.69 125
>>
>>
>>
>> You see that zstd provides almost 2 times better compression ration
>> and almost at the same speed.
>
>
> What is "(apple) 2.80 1099"? Was that intended to be zstd?
>
> Andreas
>
Ugh...
Cut and paste problems.
The whole document can be found here:
http://garret.ru/PageLevelCompression.pdf
lzfse (apple) 2.80 1099
zstd (facebook) 1.69 125
ztsd is compression algorithm proposed by facebook:
https://github.com/facebook/zstd
Looks like it provides the best speed/compress ratio result.
--
Konstantin Knizhnik
Postgres Professional: http://www.postgrespro.com
The Russian Postgres Company
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Reply to all the recipients using the --to and --cc options:
reply via email
To: pgsql-hackers@postgresql.org
Cc: k.knizhnik@postgrespro.ru, andreas@proxel.se, aagrawal@pivotal.io, mark.kirkwood@catalyst.net.nz
Subject: Re: Zedstore - compressed in-core columnar storage
In-Reply-To: <59ef6173-6667-8a02-ff7c-a52c8ce05a4f@postgrespro.ru>
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox