Received: from localhost (unknown [200.46.204.184]) by developer.postgresql.org (Postfix) with ESMTP id 850EC2E003D for ; Mon, 28 Apr 2008 16:59:10 -0300 (ADT) Received: from developer.postgresql.org ([200.46.204.71]) by localhost (mx1.hub.org [200.46.204.184]) (amavisd-maia, port 10024) with ESMTP id 61215-06 for ; Mon, 28 Apr 2008 16:59:03 -0300 (ADT) X-Greylist: from auto-whitelisted by SQLgrey-1.7.5 Received: from service-web.de (p15093784.pureserver.info [217.160.106.224]) by developer.postgresql.org (Postfix) with ESMTP id 251B32E002D for ; Mon, 28 Apr 2008 16:59:07 -0300 (ADT) Received: from [192.168.178.24] (p548B1E34.dip0.t-ipconnect.de [84.139.30.52]) by service-web.de (Postfix) with ESMTP id 43126E8127; Mon, 28 Apr 2008 21:59:03 +0200 (CEST) Message-ID: <48162C86.1040405@wildenhain.de> Date: Mon, 28 Apr 2008 21:59:02 +0200 From: Tino Wildenhain User-Agent: Thunderbird 2.0.0.12 (Windows/20080213) MIME-Version: 1.0 To: Adonias Malosso Cc: pgsql-performance@postgresql.org Subject: Re: Best practice to load a huge table from ORACLE to PG References: <8a5d3c890804260625o7ad0700fp79f951c58c242720@mail.gmail.com> In-Reply-To: <8a5d3c890804260625o7ad0700fp79f951c58c242720@mail.gmail.com> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 8bit X-Virus-Scanned: Maia Mailguard 1.0.1 X-Archive-Number: 200804/413 X-Sequence-Number: 29906 Adonias Malosso wrote: > Hi All, > > I´d like to know what´s the best practice to LOAD a 70 milion rows, 101 > columns table > from ORACLE to PGSQL. > > The current approach is to dump the data in CSV and than COPY it to > Postgresql. > Uhm. 101 columns you say? Sounds interesting. There are dataloaders like: http://pgfoundry.org/projects/pgloader/ which could speed up loading the data over just copy csv. I wonder how much normalizing could help. Tino