public inbox for [email protected]
help / color / mirror / Atom feedFrom: [email protected] <[email protected]>
To: Amit Kapila <[email protected]>
To: Masahiko Sawada <[email protected]>
Cc: Peter Smith <[email protected]>
Cc: [email protected] <[email protected]>
Cc: PostgreSQL Hackers <[email protected]>
Subject: RE: Perform streaming logical transactions by background workers and parallel apply
Date: Fri, 13 May 2022 08:52:32 +0000
Message-ID: <OS0PR01MB5716F2FCFE30298EC34E86B994CA9@OS0PR01MB5716.jpnprd01.prod.outlook.com> (raw)
In-Reply-To: <CAA4eK1+7D4qAQUQEE8zzQ0fGCqeBWd3rzTaY5N0jVs-VXFc_Xw@mail.gmail.com>
References: <CAA4eK1+wyN6zpaHUkCLorEWNx75MG0xhMwcFhvjqm2KURZEAGw@mail.gmail.com>
<OS0PR01MB57160DFDEF5B1C4668346B7D94E99@OS0PR01MB5716.jpnprd01.prod.outlook.com>
<CAD21AoB9UqvozzFuSaQ12r7-Vg+gY-kA4D7kzkwuyLU-A6bo1g@mail.gmail.com>
<CAA4eK1+4qAc8vbma3obtzrzJOTx_w-DJvBzxY9JuUG_uCP9OiQ@mail.gmail.com>
<CAD21AoDPHstj+jD3ODS-bd1uM+ZE=cpDKf8npeNFZD+YdM28fA@mail.gmail.com>
<CAA4eK1LYWZ+reJ-jSz7naM6GwdS2VqydmJaHmL_mpjbtMC9vgg@mail.gmail.com>
<CAHut+PvPwTQ_GpVMw3JgZzhWcwTrAiT-_5M-XzEO7GUnHH8hGA@mail.gmail.com>
<CAHut+PsP6WMHeui5WsGbabZqZNj5+hUp=ivxFJLLKD0Zi5QfVw@mail.gmail.com>
<CAD21AoB8YTFSXcA0OGUN4DOvqyUzgkcUKYZuME5nmme9eOT1JQ@mail.gmail.com>
<CAA4eK1KJmdhxDxPyfpc61cp4gpnNXL6racTXFVUBfUUYT-0FYA@mail.gmail.com>
<CAD21AoCwaU8SqjmC7UkKWNjDg3Uz4FDGurMpis3zw5SEC+27jQ@mail.gmail.com>
<CAA4eK1+7D4qAQUQEE8zzQ0fGCqeBWd3rzTaY5N0jVs-VXFc_Xw@mail.gmail.com>
On Wednesday, May 11, 2022 1:10 PM Amit Kapila <[email protected]> wrote:
>
> On Wed, May 11, 2022 at 9:35 AM Masahiko Sawada
> <[email protected]> wrote:
> >
> > On Tue, May 10, 2022 at 5:59 PM Amit Kapila <[email protected]>
> wrote:
> > >
> > > On Tue, May 10, 2022 at 10:39 AM Masahiko Sawada
> <[email protected]> wrote:
> > > >
> > > > Having it optional seems a good idea. BTW can the user configure
> > > > how many apply bgworkers can be used per subscription or in the
> > > > whole system? Like max_sync_workers_per_subscription, is it better
> > > > to have a configuration parameter or a subscription option for
> > > > that? If so, setting it to 0 probably means to disable the parallel apply
> feature.
> > > >
> > >
> > > Yeah, that might be useful but we are already giving an option while
> > > creating a subscription whether to allow parallelism, so will it be
> > > useful to give one more way to disable this feature? OTOH, having
> > > something like max_parallel_apply_workers/max_bg_apply_workers at
> > > the system level can give better control for how much parallelism
> > > the user wishes to allow for apply work.
> >
> > Or we can have something like
> > max_parallel_apply_workers_per_subscription that controls how many
> > parallel apply workers can launch per subscription. That also gives
> > better control for the number of parallel apply workers.
> >
>
> I think we can go either way in this matter as both have their pros and cons. I
> feel limiting the parallel workers per subscription gives better control but
> OTOH, it may not allow max usage of parallelism because some quota from
> other subscriptions might remain unused. Let us see what Hou-San or others
> think on this matter?
Thanks for Amit and Sawada-san's comments !
I will think over these approaches and reply soon.
Best regards,
Hou zj
view thread (627+ messages) latest in thread
reply
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Reply to all the recipients using the --to and --cc options:
reply via email
To: [email protected]
Cc: [email protected], [email protected], [email protected], [email protected], [email protected], [email protected]
Subject: RE: Perform streaming logical transactions by background workers and parallel apply
In-Reply-To: <OS0PR01MB5716F2FCFE30298EC34E86B994CA9@OS0PR01MB5716.jpnprd01.prod.outlook.com>
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
This inbox is served by agora; see mirroring instructions
for how to clone and mirror all data and code used for this inbox