public inbox for [email protected]  

help / color / mirror / Atom feed

From: Shane Borden <[email protected]>
To: Erik Brandsberg <[email protected]>
Cc: [email protected]
Subject: Re: PARALLEL CTAS
Date: Mon, 12 Dec 2022 12:13:36 -0500
Message-ID: <[email protected]> (raw)
In-Reply-To: <CAFcck8HhsTh70ZjQEuvm2kfx0LULJAZR3NZNHvSEX1Y5BaxAMg@mail.gmail.com>
References: <[email protected]>
	<CAFcck8HhsTh70ZjQEuvm2kfx0LULJAZR3NZNHvSEX1Y5BaxAMg@mail.gmail.com>

The issue is there are certain performance benefits to be had by doing parallel CTAS operations and when converting from Oracle to PostgreSQL switching to a “COPY” operation isn’t feasible.
---

Thanks,


Shane Borden
[email protected]

> On Dec 12, 2022, at 11:55 AM, Erik Brandsberg <[email protected]> wrote:
> 
> Copy operations are by far the most efficient way to do bulk loads.  The fdw extension isn't very efficient based on prior experience.
> 
> On Mon, Dec 12, 2022 at 11:17 AM Shane Borden <[email protected] <mailto:[email protected]>> wrote:
>> Based on testing thus far, it appears that the only way to get a bulk load operation (similar to oracle) would be to use the COPY command or to use multiple connections and break up the inserts across connections.  I did see a possibility of using the postgres_fdw extension and use the batch functionality, but I haven’t tested that yet.
>> 
>> Does anyone know the status of this feature / patch that was discussed in this link?
>> 
>> https://www.postgresql.org/message-id/CAJcOf-cXnB5cnMKqWEp2E2z7Mvcd04iLVmV%3DqpFJrR3AcrTS3g%40mail.g...
>> 
>> Is there a way in PostgreSQL to parallelize a CTAS statement similar to how you can do it in Oracle?
>> 
>> ---
>> 
>> Thanks,
>> 
>> 
>> Shane Borden
>> [email protected] <mailto:[email protected]>

view thread (7+ messages)  latest in thread

reply

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Reply to all the recipients using the --to and --cc options:
  reply via email

  To: [email protected]
  Cc: [email protected], [email protected], [email protected]
  Subject: Re: PARALLEL CTAS
  In-Reply-To: <[email protected]>

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

This inbox is served by agora; see mirroring instructions
for how to clone and mirror all data and code used for this inbox