From: Kostas Chasialis <koschasialis@gmail.com>
Content-Type: text/plain;
	charset=utf-8
Content-Transfer-Encoding: quoted-printable
Mime-Version: 1.0 (Mac OS X Mail 15.0 \(3693.20.0.1.32\))
Subject: [ERROR] Copy from CSV fails due to memory error.
Message-Id: <21D3CCA3-328F-46AC-93CB-CDEBF81BD4F8@gmail.com>
Date: Wed, 19 Jan 2022 15:01:25 +0200
To: pgsql-hackers@postgresql.org
Archived-At: <https://www.postgresql.org/message-id/21D3CCA3-328F-46AC-93CB-CDEBF81BD4F8%40gmail.com>
Precedence: bulk

Hey.

I am facing an issue when I try to run the following command

COPY <table_name> FROM <file> WITH DELIMITER E',=E2=80=99;

This file, is rather large, it's around 178GBs.=20

When I try to run this COPY command I get the following error:

ERROR:  out of memory
DETAIL:  Failed on request of size 2048 in memory context =
"AfterTriggerEvents".
CONTEXT:  COPY ssbm300_lineorder, line 50796791

Clearly a memory allocation function is failing but I have no clue how =
to fix it.

I have tried experimenting with shared_buffers value in postgresql.conf =
file but after searching a bit I quickly realized that I do not know =
what I am doing there so I left it with default value. Same with =
work_mem value.

Did you face this issue before? Can you help me resolve it?

Thanks in advance!