MIME-Version: 1.0
References: <CAM+6J95roDtn05fcobKJjWhG1YdJYwzoUFhjaj-dVOCw+9m6OQ@mail.gmail.com>
 <CH0PR03MB6100337240436C3FF72FDE37FE442@CH0PR03MB6100.namprd03.prod.outlook.com>
In-Reply-To: <CH0PR03MB6100337240436C3FF72FDE37FE442@CH0PR03MB6100.namprd03.prod.outlook.com>
From: Juan Rodrigo Alejandro Burgos Mella <rodrigoburgosmella@gmail.com>
Date: Tue, 15 Oct 2024 01:27:57 -0300
Message-ID: <CAHbZ42wy7dNouZkmOOc8-pbZ++W+7Ez2bSPkcsM3QD9JHVtNyg@mail.gmail.com>
Subject: Re: How to Copy/Load 1 billions rows into a Partition Tables Fast
To: "Wong, Kam Fook (TR Technology)" <kamfook.wong@thomsonreuters.com>
Cc: pgsql-general <pgsql-general@postgresql.org>
Content-Type: multipart/alternative; boundary="0000000000006d41d106247c612b"
Archived-At: <https://www.postgresql.org/message-id/CAHbZ42wy7dNouZkmOOc8-pbZ%2B%2BW%2B7Ez2bSPkcsM3QD9JHVtNyg%40mail.gmail.com>
Precedence: bulk

--0000000000006d41d106247c612b
Content-Type: text/plain; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable

Hi  Wong
On one occasion I had to upload 600 million records, and the most viable
and safest option was to generate plans and upload them through a massively
parallelized process (because for each process we audited that everything
was correct)

Atte.
JRBM

El lun, 14 oct 2024 a las 14:59, Wong, Kam Fook (TR Technology) (<
kamfook.wong@thomsonreuters.com>) escribi=C3=B3:

> I am trying to copy a table (Postgres) that is close to 1 billion rows
> into a Partition table (Postgres) within the same DB.  What is the fastes=
t
> way to copy the data?   This table has 37 columns where some of which are
> text data types.
>
> Thank you
> Kam Fook Wong
>
>
> This e-mail is for the sole use of the intended recipient and contains
> information that may be privileged and/or confidential. If you are not an
> intended recipient, please notify the sender by return e-mail and delete
> this e-mail and any attachments. Certain required legal entity disclosure=
s
> can be accessed on our website:
> https://www.thomsonreuters.com/en/resources/disclosures.html
>

--0000000000006d41d106247c612b
Content-Type: text/html; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr">Hi=C2=A0 Wong<div>On one occasion I had to upload 600 mill=
ion records, and the most viable and safest option was to generate plans an=
d upload them through a massively parallelized process (because for each pr=
ocess we audited that everything was correct)<br></div><div><br></div><div>=
Atte.</div><div>JRBM</div></div><br><div class=3D"gmail_quote"><div dir=3D"=
ltr" class=3D"gmail_attr">El lun, 14 oct 2024 a las 14:59, Wong, Kam Fook (=
TR Technology) (&lt;<a href=3D"mailto:kamfook.wong@thomsonreuters.com">kamf=
ook.wong@thomsonreuters.com</a>&gt;) escribi=C3=B3:<br></div><blockquote cl=
ass=3D"gmail_quote" style=3D"margin:0px 0px 0px 0.8ex;border-left:1px solid=
 rgb(204,204,204);padding-left:1ex"><div class=3D"msg7696377007567205978">


<div lang=3D"EN-US" style=3D"overflow-wrap: break-word;">
<div class=3D"m_7696377007567205978WordSection1">
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<p class=3D"MsoNormal"><span style=3D"font-size:11pt">I am trying to copy a=
 table (Postgres) that is close to 1 billion rows into a Partition table (P=
ostgres) within the same DB.=C2=A0 What is the fastest way to copy the data=
?=C2=A0 =C2=A0This table has 37 columns where some
 of which are text data types.<br>
<br>
Thank you<br>
Kam Fook Wong<br>
<br>
<br>
<u></u><u></u></span></p>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
This e-mail is for the sole use of the intended recipient and contains info=
rmation that may be privileged and/or confidential. If you are not an inten=
ded recipient, please notify the sender by return e-mail and delete this e-=
mail and any attachments. Certain
 required legal entity disclosures can be accessed on our website: <a href=
=3D"https://www.thomsonreuters.com/en/resources/disclosures.html" target=3D=
"_blank">https://www.thomsonreuters.com/en/resources/disclosures.html</a>
</div>

</div></blockquote></div>

--0000000000006d41d106247c612b--