public inbox for [email protected]
help / color / mirror / Atom feedFrom: David G. Johnston <[email protected]>
To: Shaozhong SHI <[email protected]>
Cc: pgsql-sql <[email protected]>
Subject: Re: How best to do parallel query given tens of thousands of iteration of a loop of recursive queries?
Date: Sun, 10 Apr 2022 09:13:14 -0700
Message-ID: <CAKFQuwYsSUU1USBTzBjyNFUTzgGbLqoxZyT7o2hhuYFcyfR2CA@mail.gmail.com> (raw)
In-Reply-To: <CA+i5JwYMZ_eUtbdGBX9vg2GQzpTLo9m+bMoW1wniEqVv5sxV-w@mail.gmail.com>
References: <CA+i5JwYMZ_eUtbdGBX9vg2GQzpTLo9m+bMoW1wniEqVv5sxV-w@mail.gmail.com>
On Sun, Apr 10, 2022 at 6:50 AM Shaozhong SHI <[email protected]>
wrote:
> There is a plpgsql script that have a loop to carry out the same recursive
> queries.
>
> The estimation of iteration is in the order of tens of thousands.
>
> What is the best way of making using parallel query strategy.
>
An example would be helpful.
However, as a general guideline, since parallelism is done at the per-row
scope, removing looping logic from the script and turning the main script
logic into one or more functions that operate on a single row, while
obeying the rules such functions need to abide by in order to be marked
parallel safe, will open up the possibility for the server to process
different rows using different workers and then appending their results
together for the next node to consume.
David J.
view thread (3+ messages)
reply
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Reply to all the recipients using the --to and --cc options:
reply via email
To: [email protected]
Cc: [email protected], [email protected], [email protected]
Subject: Re: How best to do parallel query given tens of thousands of iteration of a loop of recursive queries?
In-Reply-To: <CAKFQuwYsSUU1USBTzBjyNFUTzgGbLqoxZyT7o2hhuYFcyfR2CA@mail.gmail.com>
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
This inbox is served by agora; see mirroring instructions
for how to clone and mirror all data and code used for this inbox