MIME-Version: 1.0
From: sud <suds1434@gmail.com>
Date: Fri, 5 Jul 2024 14:38:25 +0530
Message-ID: <CAD=mzVUo9UpTw7F_8HKDK19ZmO6tE6Cfa4T-7i1J_QGfi6NpOw@mail.gmail.com>
Subject: Load a csv or a avro?
To: pgsql-general <pgsql-general@lists.postgresql.org>
Content-Type: multipart/alternative; boundary="000000000000958ac0061c7c6829"
Archived-At: <https://www.postgresql.org/message-id/CAD%3DmzVUo9UpTw7F_8HKDK19ZmO6tE6Cfa4T-7i1J_QGfi6NpOw%40mail.gmail.com>
Precedence: bulk

--000000000000958ac0061c7c6829
Content-Type: text/plain; charset="UTF-8"

Hello all,

Its postgres database. We have option of getting files in csv and/or in
avro format messages from another system to load it into our postgres
database. The volume will be 300million messages per day across many files
in batches.

My question was, which format should we chose in regards to faster data
loading performance ? and if any other aspects to it also should be
considered apart from just loading performance?

--000000000000958ac0061c7c6829
Content-Type: text/html; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable

<div dir=3D"auto"><p dir=3D"ltr">Hello all,=C2=A0</p>
<p dir=3D"ltr">Its postgres database. We have option of getting files in cs=
v and/or in avro format messages from another system to load it into our po=
stgres database. The volume will be 300million messages per day across many=
 files in batches. </p>
<p dir=3D"ltr"><span style=3D"font-size:1em">My question was, which format =
should we chose in regards to faster data loading performance ? and if any =
other aspects to it also should be considered apart from just loading perfo=
rmance?</span></p></div>

--000000000000958ac0061c7c6829--