public inbox for [email protected]
help / color / mirror / Atom feedxargs psql
5+ messages / 3 participants
[nested] [flat]
* xargs psql
@ 2022-04-28 11:32 Shaozhong SHI <[email protected]>
2022-04-28 13:10 ` AW: xargs psql Marc Mamin <[email protected]>
0 siblings, 1 reply; 5+ messages in thread
From: Shaozhong SHI @ 2022-04-28 11:32 UTC (permalink / raw)
To: pgsql-sql <[email protected]>
Running lots of postgres commands in parallel | Mark's blog
(markandruth.co.uk)
<https://markandruth.co.uk/2016/05/26/running-lots-of-postgres-commands-in-parallel;
Has anyone made success with this?
How to put xargs command line correctly?
Regards,
David
^ permalink raw reply [nested|flat] 5+ messages in thread
* AW: xargs psql
2022-04-28 11:32 xargs psql Shaozhong SHI <[email protected]>
@ 2022-04-28 13:10 ` Marc Mamin <[email protected]>
2022-04-28 13:59 ` Re: xargs psql Rob Sargent <[email protected]>
0 siblings, 1 reply; 5+ messages in thread
From: Marc Mamin @ 2022-04-28 13:10 UTC (permalink / raw)
To: Shaozhong SHI <[email protected]>; pgsql-sql <[email protected]>
Hello , it works for me.
I remember some difficulties with quote escaping. That's while I'm using $$ quoting for the sql aguments.
here is how ma commands look like:
psqlexec="psql -h$pghost -p$pgport -U$pguser -d${pgdb} -1 -P format=u -tqX";
$psqlexec -c "SELECT relname FROM pg_class WHERE ..." \
| xargs -n 1 -P 8 -I{} bash -c "$psqlexec -c 'select * from foo(\$\${}\$\$)' > ouputdir/{}.out"
HTH,
Marc Mamin
________________________________________
Von: Shaozhong SHI <[email protected]>
Gesendet: Donnerstag, 28. April 2022 13:32:42
An: pgsql-sql
Betreff: xargs psql
Running lots of postgres commands in parallel | Mark's blog (markandruth.co.uk)<https://markandruth.co.uk/2016/05/26/running-lots-of-postgres-commands-in-parallel;
Has anyone made success with this?
How to put xargs command line correctly?
Regards,
David
^ permalink raw reply [nested|flat] 5+ messages in thread
* Re: xargs psql
2022-04-28 11:32 xargs psql Shaozhong SHI <[email protected]>
2022-04-28 13:10 ` AW: xargs psql Marc Mamin <[email protected]>
@ 2022-04-28 13:59 ` Rob Sargent <[email protected]>
2022-04-28 14:05 ` Re: xargs psql Shaozhong SHI <[email protected]>
0 siblings, 1 reply; 5+ messages in thread
From: Rob Sargent @ 2022-04-28 13:59 UTC (permalink / raw)
To: Marc Mamin <[email protected]>; +Cc: Shaozhong SHI <[email protected]>; pgsql-sql <[email protected]>
> On Apr 28, 2022, at 6:10 AM, Marc Mamin <[email protected]> wrote:
>
> Hello , it works for me.
> I remember some difficulties with quote escaping. That's while I'm using $$ quoting for the sql aguments.
>
> here is how ma commands look like:
>
> psqlexec="psql -h$pghost -p$pgport -U$pguser -d${pgdb} -1 -P format=u -tqX";
>
> $psqlexec -c "SELECT relname FROM pg_class WHERE ..." \
> | xargs -n 1 -P 8 -I{} bash -c "$psqlexec -c 'select * from foo(\$\${}\$\$)' > ouputdir/{}.out"
>
> HTH,
>
> Marc Mamin
> ________________________________________
> Von: Shaozhong SHI <[email protected]>
> Gesendet: Donnerstag, 28. April 2022 13:32:42
> An: pgsql-sql
> Betreff: xargs psql
>
> Running lots of postgres commands in parallel | Mark's blog (markandruth.co.uk)<https://markandruth.co.uk/2016/05/26/running-lots-of-postgres-commands-in-parallel;
>
> Has anyone made success with this?
>
> How to put xargs command line correctly?
>
> Regards,
>
> David
>
You might be better off with gnu parallel
>
^ permalink raw reply [nested|flat] 5+ messages in thread
* Re: xargs psql
2022-04-28 11:32 xargs psql Shaozhong SHI <[email protected]>
2022-04-28 13:10 ` AW: xargs psql Marc Mamin <[email protected]>
2022-04-28 13:59 ` Re: xargs psql Rob Sargent <[email protected]>
@ 2022-04-28 14:05 ` Shaozhong SHI <[email protected]>
2022-04-28 14:53 ` Re: xargs psql Rob Sargent <[email protected]>
0 siblings, 1 reply; 5+ messages in thread
From: Shaozhong SHI @ 2022-04-28 14:05 UTC (permalink / raw)
To: Rob Sargent <[email protected]>; +Cc: Marc Mamin <[email protected]>; pgsql-sql <[email protected]>
Some suggested using no_hup. Would that work?
Regards,
David
On Thu, 28 Apr 2022 at 15:00, Rob Sargent <[email protected]> wrote:
>
>
> > On Apr 28, 2022, at 6:10 AM, Marc Mamin <[email protected]> wrote:
> >
> > Hello , it works for me.
> > I remember some difficulties with quote escaping. That's while I'm
> using $$ quoting for the sql aguments.
> >
> > here is how ma commands look like:
> >
> > psqlexec="psql -h$pghost -p$pgport -U$pguser -d${pgdb} -1 -P format=u
> -tqX";
> >
> > $psqlexec -c "SELECT relname FROM pg_class WHERE ..." \
> > | xargs -n 1 -P 8 -I{} bash -c "$psqlexec -c 'select * from
> foo(\$\${}\$\$)' > ouputdir/{}.out"
> >
> > HTH,
> >
> > Marc Mamin
> > ________________________________________
> > Von: Shaozhong SHI <[email protected]>
> > Gesendet: Donnerstag, 28. April 2022 13:32:42
> > An: pgsql-sql
> > Betreff: xargs psql
> >
> > Running lots of postgres commands in parallel | Mark's blog (
> markandruth.co.uk)<
> https://markandruth.co.uk/2016/05/26/running-lots-of-postgres-commands-in-parallel
> >
> >
> > Has anyone made success with this?
> >
> > How to put xargs command line correctly?
> >
> > Regards,
> >
> > David
> >
> You might be better off with gnu parallel
> >
>
^ permalink raw reply [nested|flat] 5+ messages in thread
* Re: xargs psql
2022-04-28 11:32 xargs psql Shaozhong SHI <[email protected]>
2022-04-28 13:10 ` AW: xargs psql Marc Mamin <[email protected]>
2022-04-28 13:59 ` Re: xargs psql Rob Sargent <[email protected]>
2022-04-28 14:05 ` Re: xargs psql Shaozhong SHI <[email protected]>
@ 2022-04-28 14:53 ` Rob Sargent <[email protected]>
0 siblings, 0 replies; 5+ messages in thread
From: Rob Sargent @ 2022-04-28 14:53 UTC (permalink / raw)
To: Shaozhong SHI <[email protected]>; +Cc: pgsql-sql <[email protected]>
> On Apr 28, 2022, at 7:05 AM, Shaozhong SHI <[email protected]> wrote:
>
> Some suggested using no_hup. Would that work?
>
> Regards,
>
> David
No not like gnu parallel.
^ permalink raw reply [nested|flat] 5+ messages in thread
end of thread, other threads:[~2022-04-28 14:53 UTC | newest]
Thread overview: 5+ messages (download: mbox mbox.gz follow: Atom feed)
-- links below jump to the message on this page --
2022-04-28 11:32 xargs psql Shaozhong SHI <[email protected]>
2022-04-28 13:10 ` AW: xargs psql Marc Mamin <[email protected]>
2022-04-28 13:59 ` Rob Sargent <[email protected]>
2022-04-28 14:05 ` Shaozhong SHI <[email protected]>
2022-04-28 14:53 ` Rob Sargent <[email protected]>
This inbox is served by agora; see mirroring instructions
for how to clone and mirror all data and code used for this inbox