Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtp (Exim 4.84_2) (envelope-from ) id 1dhfuR-00009l-L1 for pgsql-performance@arkaria.postgresql.org; Tue, 15 Aug 2017 17:45:43 +0000 Received: from localhost ([127.0.0.1] helo=postgresql.org) by malur.postgresql.org with smtp (Exim 4.84_2) (envelope-from ) id 1dhfuQ-0007gh-ST for pgsql-performance@arkaria.postgresql.org; Tue, 15 Aug 2017 17:45:42 +0000 Received: from magus.postgresql.org ([2a02:c0:301:0:ffff::29]) by malur.postgresql.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_CBC_SHA384:256) (Exim 4.84_2) (envelope-from ) id 1dhfuP-0007gC-Vc for pgsql-performance@postgresql.org; Tue, 15 Aug 2017 17:45:42 +0000 Received: from mail-oi0-x235.google.com ([2607:f8b0:4003:c06::235]) by magus.postgresql.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_CBC_SHA1:256) (Exim 4.84_2) (envelope-from ) id 1dhfuH-0003GQ-V9 for pgsql-performance@postgresql.org; Tue, 15 Aug 2017 17:45:41 +0000 Received: by mail-oi0-x235.google.com with SMTP id g131so13845179oic.3 for ; Tue, 15 Aug 2017 10:45:33 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc; bh=eTizsQVqEbwOjquk3veqAP1s8yMFJNMqfF+drBqtz1M=; b=Fj0yF6efKmbcRWsVur4RVofCI3R8a9bSPP/NRDyqq7LpbWmthUVMJtR/xWb+ia3Vz/ 3lTe959zLB20hcysMKuSAbtfkaAOximKTJsb4gGtcLv8TnRCm8WMLOp3PK1BQ0/ijrPC gkpfRQKmq5OSeqG3FSlmd4/gfOdqjh82vDqI4njL2vxGHxmxrTxVisaZyaxysLXc4qb1 6W4pFcOUQDDmrFs71pecxY0AuAVTwKYkcMt1Mgo9jQRpyFhqDKmHzDGp5/jYUHWQmdsp qRvGi96Zj78g4C0HumQQ93Vmq/7WaeM8N/04wBtWu2FetJWImqs2x/nfSyVY923GVrTo YFsg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc; bh=eTizsQVqEbwOjquk3veqAP1s8yMFJNMqfF+drBqtz1M=; b=M3Cr4cDO8qjWDhs8ushctNILnbBWh03QPhTygtvWLs/fSlBWSDHxlpmSDMjejGyrGB jnkN1/QZXMZ89WaYfyzn8e1/x3WC0Rb0wSGuBihg776a+PzdFss/anAfkLcQcxM9aJg2 eD8exNl941g5SPQdf1ur3FC5HoYdssiIH8qpfmZaodGxKlavrPtiLL12FCBkJTvlsUoC kGguP9XApEuDtJgyXs5E7WqFPTEBlNT9uvHT4HLooXJiNLj5Xom9AZR9AAQQbYqGZRj6 tsqSJFDloQnqrLID1Cy27WRQaQ6GYuS3FMf//ZYCtV1ljCDZ7YQRB4dgmWtf4s6hjbSA 4xfA== X-Gm-Message-State: AHYfb5glvygfkVneF2z6cR1Ix9RIbxOtsIuFY0Gr2KpZ3IkD6bQlv03D dBbibhOlpOhL6AbOT70028dQM+7aNA== X-Received: by 10.202.82.11 with SMTP id g11mr34867828oib.310.1502819131606; Tue, 15 Aug 2017 10:45:31 -0700 (PDT) MIME-Version: 1.0 Received: by 10.157.22.229 with HTTP; Tue, 15 Aug 2017 10:44:51 -0700 (PDT) In-Reply-To: References: From: Pavel Stehule Date: Tue, 15 Aug 2017 19:44:51 +0200 Message-ID: Subject: Re: performance problem on big tables To: Jeff Janes Cc: Mariel Cherkassky , "pgsql-performance@postgresql.org" Content-Type: multipart/alternative; boundary="001a113d6ddc804e960556ce58b4" List-Archive: List-Help: List-ID: List-Owner: List-Post: List-Subscribe: List-Unsubscribe: X-Mailing-List: pgsql-performance Precedence: bulk Sender: pgsql-performance-owner@postgresql.org --001a113d6ddc804e960556ce58b4 Content-Type: text/plain; charset="UTF-8" 2017-08-15 18:13 GMT+02:00 Jeff Janes : > On Tue, Aug 15, 2017 at 3:06 AM, Mariel Cherkassky < > mariel.cherkassky@gmail.com> wrote: > >> Hi, >> So I I run the cheks that jeff mentioned : >> \copy (select * from oracle_remote_table) to /tmp/tmp with binary - 1 >> hour and 35 minutes >> \copy local_postresql_table from /tmp/tmp with binary - Didnt run because >> the remote oracle database is currently under maintenance work. >> > > The "\copy...from" doesn't depend on oracle, it would be only depend on > local file system (/tmp/tmp), provided that the "\copy...to" finished. > Anyway, given the length of time it took, I think you can conclude the > bottleneck is in oracle_fdw itself, or in Oracle, or the network. > dumping from Oracle is not fast - I seen it when oracle_fdw or ora2pg cases. Regards Pavel > > Cheers, > > Jeff > --001a113d6ddc804e960556ce58b4 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable


2017-08-15 18:13 GMT+02:00 Jeff Janes <jeff.janes@gmail.com>= :
On Tue, Aug 15, 2017 at 3:06 AM, Mar= iel Cherkassky <mariel.cherkassky@gmail.com> wrote= :
Hi,
So I I run the cheks that jeff mentioned : =C2=A0
\copy (select * from orac= le_remote_table) to /tmp/tmp with binary - 1 hour and 35 minutes
\copy local_postresql_table from /tmp/tmp with b= inary - Didnt run because the remote oracle database is currently under mai= ntenance work.

The "= \copy...from" doesn't depend on oracle, it would be only depend on= local file system (/tmp/tmp), provided that the "\copy...to" fin= ished.=C2=A0 Anyway, given the length of time it took, I think you can conc= lude the bottleneck is in oracle_fdw itself, or in Oracle, or the network.<= /div>

dumping from Oracle= is not fast - I seen it when oracle_fdw or ora2pg cases.

Regards

Pavel

=C2= =A0

Cheers,
<= br>
Jeff

--001a113d6ddc804e960556ce58b4--