pg.ddx.io  pgsql-admin@postgresql.org mailing list archive  
help / color / mirror / Atom feed
pg_basebackup compression
6+ messages / 3 participants
[nested] [flat]

* pg_basebackup compression
@ 2020-06-29 16:22  Scott Ribe <scott_ribe@elevated-dev.com>
  0 siblings, 2 replies; 6+ messages in thread

From: Scott Ribe @ 2020-06-29 16:22 UTC (permalink / raw)
  To: pgsql-admin@lists.postgresql.org

pg_basebackup does not compress data over the wire, correct?

It's not that I need it to, it's that either pg_basebackup is doing compression that I wasn't aware of, or that a tool is giving me completely bogus numbers for network I/O. I suspect the latter, and just want to confirm.

--
Scott Ribe
scott_ribe@elevated-dev.com
https://www.linkedin.com/in/scottribe/








^ permalink  raw  reply  [nested|flat] 6+ messages in thread

* Re: pg_basebackup compression
@ 2020-06-29 16:53  Magnus Hagander <magnus@hagander.net>
  parent: Scott Ribe <scott_ribe@elevated-dev.com>
  1 sibling, 2 replies; 6+ messages in thread

From: Magnus Hagander @ 2020-06-29 16:53 UTC (permalink / raw)
  To: Scott Ribe <scott_ribe@elevated-dev.com>; +Cc: pgsql-admin@lists.postgresql.org

On Mon, Jun 29, 2020 at 6:22 PM Scott Ribe <scott_ribe@elevated-dev.com>
wrote:

> pg_basebackup does not compress data over the wire, correct?
>

Correct. Unless you turn on SSL compression, which ias been deprecated a
long time ago and is actually quite tricky (or even impossible) on most
modern Linux distros.

-- 
 Magnus Hagander
 Me: https://www.hagander.net/ <http://www.hagander.net/;
 Work: https://www.redpill-linpro.com/ <http://www.redpill-linpro.com/;

^ permalink  raw  reply  [nested|flat] 6+ messages in thread

* Re: pg_basebackup compression
@ 2020-06-29 16:58  Scott Ribe <scott_ribe@elevated-dev.com>
  parent: Magnus Hagander <magnus@hagander.net>
  1 sibling, 1 reply; 6+ messages in thread

From: Scott Ribe @ 2020-06-29 16:58 UTC (permalink / raw)
  To: Magnus Hagander <magnus@hagander.net>; +Cc: pgsql-admin@lists.postgresql.org

> On Jun 29, 2020, at 10:53 AM, Magnus Hagander <magnus@hagander.net> wrote:
> 
> Correct. Unless you turn on SSL compression, which ias been deprecated a long time ago and is actually quite tricky (or even impossible) on most modern Linux distros.

Thanks for confirming--shortly after I posted I remembered that I'd noticed the same issue with the same tool once before (Rancher, FYI), and what it is doing is labeling the y-axis as "Mbps" when it's actually displaying MBps. So, LOL, data is appearing on my disk 8x faster than that UI shows it transferring over the network ;-)







^ permalink  raw  reply  [nested|flat] 6+ messages in thread

* Re: pg_basebackup compression
@ 2020-07-01 07:30  Marlene Villanueva <villanuevamarlene906@gmail.com>
  parent: Scott Ribe <scott_ribe@elevated-dev.com>
  0 siblings, 0 replies; 6+ messages in thread

From: Marlene Villanueva @ 2020-07-01 07:30 UTC (permalink / raw)
  To: Scott Ribe <scott_ribe@elevated-dev.com>; +Cc: magnus@hagander.net; pgsql-admin@lists.postgresql.org

On Mon, Jun 29, 2020, 9:59 AM Scott Ribe <scott_ribe@elevated-dev.com>
wrote:

> > On Jun 29, 2020, at 10:53 AM, Magnus Hagander <magnus@hagander.net>
> wrote:
> >
> > Correct. Unless you turn on SSL compression, which ias been deprecated a
> long time ago and is actually quite tricky (or even impossible) on most
> modern Linux distros.
>
> Thanks for confirming--shortly after I posted I remembered that I'd
> noticed the same issue with the same tool once before (Rancher, FYI), and
> what it is doing is labeling the y-axis as "Mbps" when it's actually
> displaying MBps. So, LOL, data is appearing on my disk 8x faster than that
> UI shows it transferring over the network ;-)
>
>
>
>
>

^ permalink  raw  reply  [nested|flat] 6+ messages in thread

* Re: pg_basebackup compression
@ 2020-07-01 07:32  Marlene Villanueva <villanuevamarlene906@gmail.com>
  parent: Magnus Hagander <magnus@hagander.net>
  1 sibling, 0 replies; 6+ messages in thread

From: Marlene Villanueva @ 2020-07-01 07:32 UTC (permalink / raw)
  To: Magnus Hagander <magnus@hagander.net>; +Cc: Scott Ribe <scott_ribe@elevated-dev.com>; pgsql-admin@lists.postgresql.org

On Mon, Jun 29, 2020, 9:54 AM Magnus Hagander <magnus@hagander.net> wrote:

>
>
> On Mon, Jun 29, 2020 at 6:22 PM Scott Ribe <scott_ribe@elevated-dev.com>
> wrote:
>
>> pg_basebackup does not compress data over the wire, correct?
>>
>
> Correct. Unless you turn on SSL compression, which ias been deprecated a
> long time ago and is actually quite tricky (or even impossible) on most
> modern Linux distros.
>
> --
>  Magnus Hagander
>  Me: https://www.hagander.net/ <http://www.hagander.net/;
>  Work: https://www.redpill-linpro.com/ <http://www.redpill-linpro.com/;
>

^ permalink  raw  reply  [nested|flat] 6+ messages in thread

* Re: pg_basebackup compression
@ 2020-07-01 07:33  Marlene Villanueva <villanuevamarlene906@gmail.com>
  parent: Scott Ribe <scott_ribe@elevated-dev.com>
  1 sibling, 0 replies; 6+ messages in thread

From: Marlene Villanueva @ 2020-07-01 07:33 UTC (permalink / raw)
  To: Scott Ribe <scott_ribe@elevated-dev.com>; +Cc: pgsql-admin@lists.postgresql.org

On Mon, Jun 29, 2020, 9:22 AM Scott Ribe <scott_ribe@elevated-dev.com>
wrote:

> pg_basebackup does not compress data over the wire, correct?
>
> It's not that I need it to, it's that either pg_basebackup is doing
> compression that I wasn't aware of, or that a tool is giving me completely
> bogus numbers for network I/O. I suspect the latter, and just want to
> confirm.
>
> --
> Scott Ribe
> scott_ribe@elevated-dev.com
> https://www.linkedin.com/in/scottribe/
>
>
>
>
>
>

^ permalink  raw  reply  [nested|flat] 6+ messages in thread


end of thread, other threads:[~2020-07-01 07:33 UTC | newest]

Thread overview: 6+ messages (download: mbox mbox.gz follow: Atom feed)
-- links below jump to the message on this page --
2020-06-29 16:22 pg_basebackup compression Scott Ribe <scott_ribe@elevated-dev.com>
2020-06-29 16:53 ` Magnus Hagander <magnus@hagander.net>
2020-06-29 16:58   ` Scott Ribe <scott_ribe@elevated-dev.com>
2020-07-01 07:30     ` Marlene Villanueva <villanuevamarlene906@gmail.com>
2020-07-01 07:32   ` Marlene Villanueva <villanuevamarlene906@gmail.com>
2020-07-01 07:33 ` Marlene Villanueva <villanuevamarlene906@gmail.com>

This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox