MIME-Version: 1.0
From: Ayden Gera <aydengera@gmail.com>
Date: Fri, 25 Apr 2025 09:50:57 +1200
Message-ID: 
 <CANYJdW+Zq=CUbyMLiVqQ3nipS4S=W_Jn6J_bY=49qw1EDbBwyg@mail.gmail.com>
Subject: PGDump question/issue
To: pgsql-novice@lists.postgresql.org
Content-Type: multipart/alternative; boundary="00000000000021077006338d3774"
Archived-At: 
 <https://www.postgresql.org/message-id/CANYJdW%2BZq%3DCUbyMLiVqQ3nipS4S%3DW_Jn6J_bY%3D49qw1EDbBwyg%40mail.gmail.com>
Precedence: bulk

--00000000000021077006338d3774
Content-Type: text/plain; charset="UTF-8"

Hi,
Hoping someone may have a solution to this problem.
We get a daily PGDump file (@3Gb) from our SaaS provider (for BI purpose).
In it, it has a Drop Table IF Exists command..
This file has no row level security etc.
We want  to use the same file to populate Supabase with and add row level
security.. but I believe the drop table will destroy the rls each day and
manually adding it back *unless mabe scripted) isn't an option.

We have an inhouse Postgresql we can also use to potentially load and then
do its own PGDump with data only..

But the other issue we have is the source tables don't always have any
unique keys that we can tell.. so to be safe and avoid data duplicate
risk.. we prefer to delete the entire tables data before inserting..

Does anyone have any suggestions on how to best automate the daily updating
of data into the supabase tables without losing any RLS we might configure
on those tables?
Or what commands should we run on our own PG to get our own data
only/insert + commands to drop all data in all tables before running it.

I was also wondering if we could send PGDump from SaaS to Supabase Db1 and
then stream data to DB2 (Prod) but unclear if we can and/or risk data
duplication risk if we cannot somehow delete the tables in Prod just before
streaming..

Thanks in advance!

--00000000000021077006338d3774
Content-Type: text/html; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr"><div>Hi,</div><div>Hoping someone may have a solution to t=
his problem.</div><div>We get a daily PGDump file (@3Gb) from our SaaS prov=
ider (for BI purpose). In it, it has a Drop Table IF Exists command..</div>=
<div>This file has no row level security etc.</div><div>We want=C2=A0 to us=
e the same file to populate Supabase with and add row level security.. but =
I believe the drop table will destroy the rls each day and manually adding =
it back *unless mabe scripted) isn&#39;t an option.</div><div><br></div><di=
v>We have an inhouse Postgresql we can also use to potentially load and the=
n do its own PGDump with data only..</div><div><br></div><div>But the other=
 issue we have is the source tables don&#39;t always have any unique keys t=
hat we can tell.. so to be safe and avoid data duplicate risk.. we prefer t=
o delete the entire tables data before inserting..</div><div><br></div><div=
>Does anyone have any suggestions on how to best automate the daily updatin=
g of data into the supabase tables without losing any RLS we might configur=
e on those tables?</div><div>Or what commands should we run on our own PG t=
o get our own data only/insert + commands to drop all data in all tables be=
fore running it.</div><div><br></div><div>I was also wondering if we could =
send PGDump from SaaS to Supabase Db1 and then stream data to DB2 (Prod) bu=
t unclear if we can and/or risk data duplication risk if we cannot somehow =
delete the tables in Prod just before streaming..</div><div><br></div><div>=
Thanks in advance!</div><div><br></div><div><br></div><div><br></div></div>

--00000000000021077006338d3774--