pg.ddx.io pgsql-performance@postgresql.org mailing list archive
help / color / mirror / Atom feedpg_wal filling up while running huge updates
3+ messages / 3 participants
[nested] [flat]
* pg_wal filling up while running huge updates
@ 2022-08-05 12:30 aditya desai <admad123@gmail.com>
0 siblings, 2 replies; 3+ messages in thread
From: aditya desai @ 2022-08-05 12:30 UTC (permalink / raw)
To: Pgsql Performance <pgsql-performance@lists.postgresql.org>
Hi,
We are doing an oracle to postgres migration(5 TB+ data). We are encoding
and decoding BLOB data after migration and for that we are running updates
on tables having BLOB/CLOB data. When we execute this pg_wal is filling up.
Do you have any general guidelines for migrating a 5TB + database from
Oracle to Postgres? Any specific guidelines around archiving logs?
Regards,
Aditya.
^ permalink raw reply [nested|flat] 3+ messages in thread
* Re: pg_wal filling up while running huge updates
@ 2022-08-05 13:56 Don Seiler <don@seiler.us>
parent: aditya desai <admad123@gmail.com>
1 sibling, 0 replies; 3+ messages in thread
From: Don Seiler @ 2022-08-05 13:56 UTC (permalink / raw)
To: aditya desai <admad123@gmail.com>; +Cc: Pgsql Performance <pgsql-performance@lists.postgresql.org>
On Fri, Aug 5, 2022 at 7:30 AM aditya desai <admad123@gmail.com> wrote:
>
> We are doing an oracle to postgres migration(5 TB+ data). We are encoding
> and decoding BLOB data after migration and for that we are running updates
> on tables having BLOB/CLOB data. When we execute this pg_wal is filling up.
>
> Do you have any general guidelines for migrating a 5TB + database from
> Oracle to Postgres? Any specific guidelines around archiving logs?
>
If you use pgBackrest for WAL archiving, you could enable asynchronous
archiving.
https://pgbackrest.org/configuration.html#section-archive/option-archive-async
--
Don Seiler
www.seiler.us
^ permalink raw reply [nested|flat] 3+ messages in thread
* Re: pg_wal filling up while running huge updates
@ 2022-08-05 14:04 Justin Pryzby <pryzby@telsasoft.com>
parent: aditya desai <admad123@gmail.com>
1 sibling, 0 replies; 3+ messages in thread
From: Justin Pryzby @ 2022-08-05 14:04 UTC (permalink / raw)
To: aditya desai <admad123@gmail.com>; +Cc: pgsql-performance@lists.postgresql.org
On Fri, Aug 05, 2022 at 06:00:02PM +0530, aditya desai wrote:
> Hi,
> We are doing an oracle to postgres migration(5 TB+ data). We are encoding
> and decoding BLOB data after migration and for that we are running updates
> on tables having BLOB/CLOB data. When we execute this pg_wal is filling up.
Could you please include basic information in each new thread you create ?
https://wiki.postgresql.org/wiki/Server_Configuration
https://wiki.postgresql.org/wiki/Guide_to_reporting_problems
--
Justin
^ permalink raw reply [nested|flat] 3+ messages in thread
end of thread, other threads:[~2022-08-05 14:04 UTC | newest]
Thread overview: 3+ messages (download: mbox mbox.gz follow: Atom feed)
-- links below jump to the message on this page --
2022-08-05 12:30 pg_wal filling up while running huge updates aditya desai <admad123@gmail.com>
2022-08-05 13:56 ` Don Seiler <don@seiler.us>
2022-08-05 14:04 ` Justin Pryzby <pryzby@telsasoft.com>
This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox