pg.ddx.io  pgsql-general@postgresql.org mailing list archive  

help / color / mirror / Atom feed
From: Tom Lane <tgl@sss.pgh.pa.us>
To: Mathieu Fenniak <mathieu.fenniak@replicon.com>
Cc: Andres Freund <andres@anarazel.de>
Cc: pgsql-general@postgresql.org
Subject: Re: Logical decoding CPU-bound w/ large number of tables
Date: Fri, 12 May 2017 16:32:41 -0400
Message-ID: <28461.1494621161@sss.pgh.pa.us> (raw)
In-Reply-To: <CAHoiPjyvnhB4WXuo7LUfWFeVocoJ1ZpB9FeqA6keamQu2_td8g@mail.gmail.com>
References: <CAHoiPjzea6N0zuCi=+f9v_j94nfsy6y8SU7-=bp4=7qw6_i=Rg@mail.gmail.com>
	<20170506012055.hhmx5hirj2yk7d3g@alap3.anarazel.de>
	<19256.1494034347@sss.pgh.pa.us>
	<20170506013810.2og6vax6a2u3rhjc@alap3.anarazel.de>
	<CAHoiPjwSEHKdWkL0cz1usioc9MQPuTB8a=vbtVy=JLpuAm4Axw@mail.gmail.com>
	<12184.1494450131@sss.pgh.pa.us>
	<20170510211025.scae63m476ftv7i3@alap3.anarazel.de>
	<CAHoiPjyvnhB4WXuo7LUfWFeVocoJ1ZpB9FeqA6keamQu2_td8g@mail.gmail.com>
List-Unsubscribe: <mailto:majordomo@postgresql.org?body=unsub%20pgsql-general>

Mathieu Fenniak <mathieu.fenniak@replicon.com> writes:
> I've taken your patches, Tom, and applied them to a test deployment of my
> actual application.

> The most accessible way I have to reproduce this issue is to run a
> maintenance task that we typically run during a software deployment, which
> will remove some tenant schemas from our database system.  I ran that task
> with and without the patches, and monitored how long logical replication
> stalled.  This test was on a database with 22 schemas containing 400 tables
> each (~8800 tables).

> As a baseline, PostgreSQL 9.5.6 stalled completely for 21m 13s

> PostgreSQL 9.5.6 + all three patches stalled completely for 4m 11s.

> Definitely a fantastic improvement. :-)

Thanks for confirming that these patches help in a real-world scenario.
Obviously there's still room for improvement, but I think it's worth
pushing what I've done, so I'll go do that.  I hope Andres will follow
up with trying to improve matters from the other angle.

			regards, tom lane


-- 
Sent via pgsql-general mailing list (pgsql-general@postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-general



view thread (11+ messages)

Message-ID: <28461.1494621161@sss.pgh.pa.us>
Permalink:  ../28461.1494621161@sss.pgh.pa.us/
Also on:    postgresql.org/message-id/28461.1494621161@sss.pgh.pa.us

 · 

reply
Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Reply to all the recipients using the --to and --cc options:
  reply via email

  To: pgsql-general@postgresql.org
  Cc: tgl@sss.pgh.pa.us, mathieu.fenniak@replicon.com, andres@anarazel.de
  Subject: Re: Logical decoding CPU-bound w/ large number of tables
  In-Reply-To: <28461.1494621161@sss.pgh.pa.us>

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox