Message-ID: <fb4dc526d3660254500dfb44d508e67004aebb6a.camel@cybertec.at>
Subject: Re: Considerable performance downgrade of v11 and 12 on Windows
From: Laurenz Albe <laurenz.albe@cybertec.at>
To: Eugene Podshivalov <yaugenka@gmail.com>,
	pgsql-performance@lists.postgresql.org
Date: Mon, 02 Dec 2019 10:04:29 +0100
In-Reply-To: 
 <CAEPw1JXZ=gcbuw-OXXByFW5quB=oprG7CfU6kh8BDE_+NTvM1w@mail.gmail.com>
References: 
	<CAEPw1JWqO+Fi5J+bKek+OTh81fyMZV=d5L22Dg9KNxBh7tH_UA@mail.gmail.com>
	 <fcfa7b3e367b8ecaa2d986739125ceb68c70f257.camel@cybertec.at>
	 <CAEPw1JXCkajosmudaWDFFtmMtACw-LeJYTQ=UgSZ18KJDLtkpw@mail.gmail.com>
	 <CAEPw1JXZ=gcbuw-OXXByFW5quB=oprG7CfU6kh8BDE_+NTvM1w@mail.gmail.com>
Content-Type: text/plain; charset="UTF-8"
User-Agent: Evolution 3.32.5 (3.32.5-1.fc30) 
MIME-Version: 1.0
Content-Transfer-Encoding: 8bit
Precedence: bulk

On Sat, 2019-11-30 at 22:47 +0300, Eugene Podshivalov wrote:
> It sounds strange but the "type" is indeed impacting the overall
> performance somehow.
> I've just tried to execute the following sequence of commands on a
> fresh new database with PostreSQL v10 and both the copy and primary
> key commands performed as slow as in v11 and 12.
> 
> SET synchronous_commit TO OFF;
> SET client_encoding TO 'UTF8';
> COPY ways FROM program 'cmd /c "type D:\ways.txt"';
> ALTER TABLE ONLY ways ADD CONSTRAINT pk_ways PRIMARY KEY (id);
> 
> Regards
> 
> пт, 29 нояб. 2019 г. в 15:22, Eugene Podshivalov <yaugenka@gmail.com>:
> > Laurenz,
> > There is no way to run copy without the "type" on v11. See this thread
> > https://www.postgresql.org/message-id/CAKHmqNCfTMM6%3DPqc6RUMEQ_2BPfo5KGGG-0fzRXZCVooo%3DwdNA%40mail.gmail.com
> > 
> > My machine is running on NVMe disks, so the I/O subsystem very strong.
> > The 100% overload is not constant but periodical, as if there are some
> > kind of dumps for recovery performed in the background.

Is it an option to split the file into parts of less than 2GB in size?

Yours,
Laurenz Albe
-- 
Cybertec | https://www.cybertec-postgresql.com