pg.ddx.io  pgsql-performance@postgresql.org mailing list archive  
help / color / mirror / Atom feed
From: Mark Kirkwood <mark.kirkwood@catalyst.net.nz>
To: pgsql-admin@lists.postgresql.org
Subject: Re: increase insert into local table from remote oracle table preformance
Date: Tue, 14 Aug 2018 17:21:23 +1200
Message-ID: <2e6e6255-d33f-dfc5-0470-b3adff075525@catalyst.net.nz> (raw)
In-Reply-To: <CA+t6e1nxh1VVMjD2NJZV_Mcb7UyF8-F3y=hxjamuMFA1bAk2Jg@mail.gmail.com>
References: <CA+t6e1nxh1VVMjD2NJZV_Mcb7UyF8-F3y=hxjamuMFA1bAk2Jg@mail.gmail.com>

Hi, we probably need more inforation to offer anything useful here, e.g:

- The network bandwidth between the 2 hosts

- the number of partitions on the Postgres end (i.e how many days in 
your case)

- single or batched INSERT

The lack of indexes is probably not going to effect INSERT performance 
that much, but the number of partition tables has a huge impact, so we 
need to know this stuff!

Cheers

Mark


On 14/08/18 08:34, Mariel Cherkassky wrote:
> Hi,
> I'm using postgresql v10.4. I have a local partitioned table (by range 
> - data, every day has its own table). I'm using the oracle_fdw 
> extension to bring data from the oracle partitioned table into my 
> local postgresql (insert into local select * from remote_oracle). 
> Currently, I dont have any indexes on the postgresql`s table. It takes 
> me 10 hours to copy 200G over the network and it is very slow.
> Any recommandations what can I change or improve ?
>
>
> Thanks , Mariel.





view thread (11+ messages)  latest in thread

Message-ID: <2e6e6255-d33f-dfc5-0470-b3adff075525@catalyst.net.nz>
Permalink:  ../2e6e6255-d33f-dfc5-0470-b3adff075525@catalyst.net.nz/
Also on:    postgresql.org/message-id/2e6e6255-d33f-dfc5-0470-b3adff075525@catalyst.net.nz

 · 

reply

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Reply to all the recipients using the --to and --cc options:
  reply via email

  To: pgsql-performance@postgresql.org
  Cc: mark.kirkwood@catalyst.net.nz, pgsql-admin@lists.postgresql.org
  Subject: Re: increase insert into local table from remote oracle table preformance
  In-Reply-To: <2e6e6255-d33f-dfc5-0470-b3adff075525@catalyst.net.nz>

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox