MIME-Version: 1.0
References: <C1FD3065-84ED-47BA-BDA1-16B6A7E05EE7@gmail.com>
In-Reply-To: <C1FD3065-84ED-47BA-BDA1-16B6A7E05EE7@gmail.com>
From: Erik Brandsberg <erik@heimdalldata.com>
Date: Mon, 12 Dec 2022 11:55:39 -0500
Message-ID: 
 <CAFcck8HhsTh70ZjQEuvm2kfx0LULJAZR3NZNHvSEX1Y5BaxAMg@mail.gmail.com>
Subject: Re: PARALLEL CTAS
To: Shane Borden <sborden76@gmail.com>
Cc: pgsql-sql@lists.postgresql.org
Content-Type: multipart/alternative; boundary="0000000000002a0c0005efa4603e"
Archived-At: 
 <https://www.postgresql.org/message-id/CAFcck8HhsTh70ZjQEuvm2kfx0LULJAZR3NZNHvSEX1Y5BaxAMg%40mail.gmail.com>
Precedence: bulk

--0000000000002a0c0005efa4603e
Content-Type: text/plain; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable

Copy operations are by far the most efficient way to do bulk loads.  The
fdw extension isn't very efficient based on prior experience.

On Mon, Dec 12, 2022 at 11:17 AM Shane Borden <sborden76@gmail.com> wrote:

> Based on testing thus far, it appears that the only way to get a bulk loa=
d
> operation (similar to oracle) would be to use the COPY command or to use
> multiple connections and break up the inserts across connections.  I did
> see a possibility of using the postgres_fdw extension and use the batch
> functionality, but I haven=E2=80=99t tested that yet.
>
> Does anyone know the status of this feature / patch that was discussed in
> this link?
>
>
> https://www.postgresql.org/message-id/CAJcOf-cXnB5cnMKqWEp2E2z7Mvcd04iLVm=
V%3DqpFJrR3AcrTS3g%40mail.gmail.com
>
> Is there a way in PostgreSQL to parallelize a CTAS statement similar to
> how you can do it in Oracle?
>
> ---
>
> Thanks,
>
>
> Shane Borden
> sborden76@gmail.com
>
>

--0000000000002a0c0005efa4603e
Content-Type: text/html; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr">Copy operations are by far the most efficient=C2=A0way to =
do bulk loads.=C2=A0 The fdw extension isn&#39;t very efficient=C2=A0based =
on prior experience.</div><br><div class=3D"gmail_quote"><div dir=3D"ltr" c=
lass=3D"gmail_attr">On Mon, Dec 12, 2022 at 11:17 AM Shane Borden &lt;<a hr=
ef=3D"mailto:sborden76@gmail.com">sborden76@gmail.com</a>&gt; wrote:<br></d=
iv><blockquote class=3D"gmail_quote" style=3D"margin:0px 0px 0px 0.8ex;bord=
er-left:1px solid rgb(204,204,204);padding-left:1ex"><div><div>Based on tes=
ting thus far, it appears that the only way to get a bulk load operation (s=
imilar to oracle) would be to use the COPY command or to use multiple conne=
ctions and break up the inserts across connections.=C2=A0 I did see a possi=
bility of using the postgres_fdw extension and use the batch functionality,=
 but I haven=E2=80=99t tested that yet.</div><div><br></div><div>Does anyon=
e know the status of this feature / patch that was discussed in this link?<=
/div><div><br></div><div><a href=3D"https://www.postgresql.org/message-id/C=
AJcOf-cXnB5cnMKqWEp2E2z7Mvcd04iLVmV%3DqpFJrR3AcrTS3g%40mail.gmail.com" targ=
et=3D"_blank">https://www.postgresql.org/message-id/CAJcOf-cXnB5cnMKqWEp2E2=
z7Mvcd04iLVmV%3DqpFJrR3AcrTS3g%40mail.gmail.com</a></div><div><br></div><di=
v>Is there a way in PostgreSQL to parallelize a CTAS statement similar to h=
ow you can do it in Oracle?</div><br><div>
<div>---<br><br>Thanks,<br><br><br>Shane Borden<br><a href=3D"mailto:sborde=
n76@gmail.com" target=3D"_blank">sborden76@gmail.com</a></div>

</div>
<br></div></blockquote></div>

--0000000000002a0c0005efa4603e--