public inbox for [email protected]
help / color / mirror / Atom feedpg_dump -j
4+ messages / 3 participants
[nested] [flat]
* pg_dump -j
@ 2025-11-12 15:33 Sam Stearns <[email protected]>
0 siblings, 1 reply; 4+ messages in thread
From: Sam Stearns @ 2025-11-12 15:33 UTC (permalink / raw)
To: Pgsql-admin <[email protected]>; +Cc: Henry Ashu <[email protected]>; Avi Vallarapu <[email protected]>
Howdy,
Would someone be able to advise on the correct setting for the -j option of
pg_dump to run the dump in parallel, please? Is it based on CPU count, or
something else? The output of nproc is 32.
Thank you,
Sam
--
Samuel Stearns
Team Lead - Database
c: 971 762 6879 | o: 971 762 6879 | DAT.com
<https://www.dat.com/?utm_medium=email&utm_source=DAT_email_signature_link;
^ permalink raw reply [nested|flat] 4+ messages in thread
* Re: pg_dump -j
@ 2025-11-12 16:11 Ron Johnson <[email protected]>
parent: Sam Stearns <[email protected]>
0 siblings, 1 reply; 4+ messages in thread
From: Ron Johnson @ 2025-11-12 16:11 UTC (permalink / raw)
To: Pgsql-admin <[email protected]>
On Wed, Nov 12, 2025 at 10:34 AM Sam Stearns <[email protected]> wrote:
> Howdy,
>
> Would someone be able to advise on the correct setting for the -j option
> of pg_dump to run the dump in parallel, please? Is it based on CPU count,
> or something else? The output of nproc is 32.
>
I'd certainly never go *beyond* $(nproc), but since COPY generates a lot of
IO and compression burns through CPU, it all depends on the system's other
workload. Only you know what your system's other workload is when pg_dump
is running.
--
Death to <Redacted>, and butter sauce.
Don't boil me, I'm still alive.
<Redacted> lobster!
^ permalink raw reply [nested|flat] 4+ messages in thread
* Re: pg_dump -j
@ 2025-11-13 08:28 CONVERS Yann - DREAL Auvergne-Rhône-Alpes/CIDDAE/SIG <[email protected]>
parent: Ron Johnson <[email protected]>
0 siblings, 1 reply; 4+ messages in thread
From: CONVERS Yann - DREAL Auvergne-Rhône-Alpes/CIDDAE/SIG @ 2025-11-13 08:28 UTC (permalink / raw)
To: [email protected]
<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=UTF-8">
</head>
<body text="#000000" bgcolor="#FFFFFF">
<p>Hi,<br>
</p>
<p>Processeurs is on of the parameters . An other is the
outpout:input capacity to write on disks.<br>
</p>
<p>I purpose to test your hardware performance with 12 jobs to begin
and test less and high to learn which is better.<br>
</p>
<p>You can found it approximately with the rate of your speeding
writing ratio on disk or outpout of LAN card factoring by job's
number.<br>
</p>
<p>But testing IRL is more efficient.<br>
</p>
<p>We use 7 jobs for à 16 nprocs on saving on a master save dedicate
to with car LAN 1000GhZ for example.<br>
</p>
<p>We do it online but without clients traffic and without
maintenance operation.<br>
</p>
<p>Tell us wich is your better choice!<br>
</p>
<p>Bye<br>
</p>
<p>Yann<br>
</p>
<p><br>
</p>
<div class="moz-cite-prefix">Le 12/11/2025 à 17:11, >
ronljohnsonjr (par Internet, dépôt
<a class="moz-txt-link-abbreviated" href="mailto:[email protected]">[email protected]</a>) a écrit :<br>
</div>
<blockquote type="cite"
cite="mid:CANzqJaCfOQBa06TfkAs63dbnLRegOtOdDumKdn2S101KkiFrVA@mail.gmail.com">
<meta http-equiv="content-type" content="text/html; charset=UTF-8">
<div dir="ltr">
<div dir="ltr">On Wed, Nov 12, 2025 at 10:34 AM Sam Stearns <<a
href="mailto:[email protected]" moz-do-not-send="true">[email protected]</a>>
wrote:</div>
<div class="gmail_quote gmail_quote_container">
<blockquote class="gmail_quote" style="margin:0px 0px 0px
0.8ex;border-left:1px solid
rgb(204,204,204);padding-left:1ex">
<div dir="ltr">
<div>Howdy,</div>
<div><br>
</div>
<div>Would someone be able to advise on the correct
setting for the -j option of pg_dump to run the dump in
parallel, please? Is it based on CPU count, or
something else? The output of nproc is 32.</div>
</div>
</blockquote>
</div>
<div><br>
</div>
<div>I'd certainly never go <i>beyond</i> $(nproc), but since
COPY generates a lot of IO and compression burns through CPU,
it all depends on the system's other workload. Only you know
what your system's other workload is when pg_dump is running.</div>
<div><br>
</div>
<span class="gmail_signature_prefix">-- </span><br>
<div dir="ltr" class="gmail_signature">
<div dir="ltr">Death to <Redacted>, and butter sauce.
<div>Don't boil me, I'm still alive.<br>
<div>
<div><Redacted> lobster!</div>
</div>
</div>
</div>
</div>
</div>
</blockquote>
</body>
</html>
^ permalink raw reply [nested|flat] 4+ messages in thread
* Re: pg_dump -j
@ 2025-11-13 15:12 Sam Stearns <[email protected]>
parent: CONVERS Yann - DREAL Auvergne-Rhône-Alpes/CIDDAE/SIG <[email protected]>
0 siblings, 0 replies; 4+ messages in thread
From: Sam Stearns @ 2025-11-13 15:12 UTC (permalink / raw)
To: CONVERS Yann - DREAL Auvergne-Rhône-Alpes/CIDDAE/SIG <[email protected]>; +Cc: [email protected]; Henry Ashu <[email protected]>
Thanks, Yann!
On Thu, Nov 13, 2025 at 3:40 AM CONVERS Yann - DREAL
Auvergne-Rhône-Alpes/CIDDAE/SIG <[email protected]>
wrote:
> Hi, Processeurs is on of the parameters . An other is the outpout: input
> capacity to write on disks. I purpose to test your hardware performance
> with 12 jobs to begin and test less and high to learn which is better. You
> can found it approximately
> ZjQcmQRYFpfptBannerStart
> This Message Is From an Untrusted Sender
> You have not previously corresponded with this sender.
>
> ZjQcmQRYFpfptBannerEnd
>
> Hi,
>
> Processeurs is on of the parameters . An other is the outpout:input
> capacity to write on disks.
>
> I purpose to test your hardware performance with 12 jobs to begin and test
> less and high to learn which is better.
>
> You can found it approximately with the rate of your speeding writing
> ratio on disk or outpout of LAN card factoring by job's number.
>
> But testing IRL is more efficient.
>
> We use 7 jobs for à 16 nprocs on saving on a master save dedicate to with
> car LAN 1000GhZ for example.
>
> We do it online but without clients traffic and without maintenance
> operation.
>
> Tell us wich is your better choice!
>
> Bye
>
> Yann
>
>
> Le 12/11/2025 à 17:11, > ronljohnsonjr (par Internet, dépôt
> [email protected]) a écrit :
>
> On Wed, Nov 12, 2025 at 10:34 AM Sam Stearns <[email protected]> wrote:
>
>> Howdy,
>>
>> Would someone be able to advise on the correct setting for the -j option
>> of pg_dump to run the dump in parallel, please? Is it based on CPU count,
>> or something else? The output of nproc is 32.
>>
>
> I'd certainly never go *beyond* $(nproc), but since COPY generates a lot
> of IO and compression burns through CPU, it all depends on the system's
> other workload. Only you know what your system's other workload is when
> pg_dump is running.
>
> --
> Death to <Redacted>, and butter sauce.
> Don't boil me, I'm still alive.
> <Redacted> lobster!
>
>
--
Samuel Stearns
Team Lead - Database
c: 971 762 6879 | o: 971 762 6879 | DAT.com
<https://www.dat.com/?utm_medium=email&utm_source=DAT_email_signature_link;
^ permalink raw reply [nested|flat] 4+ messages in thread
end of thread, other threads:[~2025-11-13 15:12 UTC | newest]
Thread overview: 4+ messages (download: mbox mbox.gz follow: Atom feed)
-- links below jump to the message on this page --
2025-11-12 15:33 pg_dump -j Sam Stearns <[email protected]>
2025-11-12 16:11 ` Ron Johnson <[email protected]>
2025-11-13 08:28 ` CONVERS Yann - DREAL Auvergne-Rhône-Alpes/CIDDAE/SIG <[email protected]>
2025-11-13 15:12 ` Sam Stearns <[email protected]>
This inbox is served by agora; see mirroring instructions
for how to clone and mirror all data and code used for this inbox