Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtp (Exim 4.84_2) (envelope-from ) id 1dJJyH-00034U-QC for pgsql-performance@arkaria.postgresql.org; Fri, 09 Jun 2017 13:29:01 +0000 Received: from localhost ([127.0.0.1] helo=postgresql.org) by malur.postgresql.org with smtp (Exim 4.84_2) (envelope-from ) id 1dJJyH-0001f0-Ao for pgsql-performance@arkaria.postgresql.org; Fri, 09 Jun 2017 13:29:01 +0000 Received: from makus.postgresql.org ([2001:4800:1501:1::229]) by malur.postgresql.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_CBC_SHA384:256) (Exim 4.84_2) (envelope-from ) id 1dJJyG-0001e5-Cr for pgsql-performance@postgresql.org; Fri, 09 Jun 2017 13:29:00 +0000 Received: from aart.rice.edu ([168.7.56.48]) by makus.postgresql.org with esmtp (Exim 4.84_2) (envelope-from ) id 1dJJyD-0005BZ-Tl for pgsql-performance@postgresql.org; Fri, 09 Jun 2017 13:28:58 +0000 Received: by aart.rice.edu (Postfix, from userid 18612) id 54D30406968B; Fri, 9 Jun 2017 08:28:57 -0500 (CDT) Date: Fri, 9 Jun 2017 08:28:57 -0500 From: Kenneth Marshall To: Andreas Kretschmer Cc: pgsql-performance@postgresql.org Subject: Re: Improving PostgreSQL insert performance Message-ID: <20170609132857.GC26506@aart.rice.edu> References: <9e2a0a34-dd83-43af-d41a-791b34ff76e1@a-kretschmer.de> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <9e2a0a34-dd83-43af-d41a-791b34ff76e1@a-kretschmer.de> User-Agent: Mutt/1.5.21 (2010-09-15) X-Pg-Spam-Score: -1.9 (-) List-Archive: List-Help: List-ID: List-Owner: List-Post: List-Subscribe: List-Unsubscribe: X-Mailing-List: pgsql-performance Precedence: bulk Sender: pgsql-performance-owner@postgresql.org On Fri, Jun 09, 2017 at 03:24:15PM +0200, Andreas Kretschmer wrote: > > > Am 09.06.2017 um 15:04 schrieb Frits Jalvingh: > >Hi all, > > > >I am trying to improve the runtime of a big data warehouse > >application. One significant bottleneck found was insert > >performance, so I am investigating ways of getting Postgresql to > >insert data faster. > > * use COPY instead of Insert, it is much faster > * bundle all Insert into one transaction > * use a separate disk/spindel for the transaction log > > > > > > >I already changed the following config parameters: > >work_mem 512MB > >synchronous_commit off > >shared_buffers 512mb > >commit_delay 100000 > >autovacuum_naptime 10min > > > >Postgres version is 9.6.3 on Ubuntu 17.04 64 bit, on a i7-4790K > >with 16GB memory and an Intel 750 SSD. JDBC driver is > >postgresql-42.1.1. > > > > increase shared_buffers, with 16gb ram i would suggest 8gb +1 Without even checking, I think Oracle is configured to use a LOT more memory than 512mb. Regards, Ken -- Sent via pgsql-performance mailing list (pgsql-performance@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-performance