Received: from maia.hub.org (maia-2.hub.org [200.46.204.251]) by mail.postgresql.org (Postfix) with ESMTP id 4563F1337B77 for ; Sat, 30 Oct 2010 21:33:00 -0300 (ADT) Received: from mail.postgresql.org ([200.46.204.86]) by maia.hub.org (mx1.hub.org [200.46.204.251]) (amavisd-maia, port 10024) with ESMTP id 46544-03 for ; Sun, 31 Oct 2010 00:32:53 +0000 (UTC) X-Greylist: from auto-whitelisted by SQLgrey-1.7.6 Received: from eagle.jhcloos.com (eagle.jhcloos.com [207.210.242.212]) by mail.postgresql.org (Postfix) with ESMTP id E0FD91337B6C for ; Sat, 30 Oct 2010 21:32:52 -0300 (ADT) Received: by eagle.jhcloos.com (Postfix, from userid 10) id 84B74400D0; Sun, 31 Oct 2010 00:32:27 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=jhcloos.com; s=eagle; t=1288485171; bh=TLJrT0hXYOE+RUfHzYQ74rpXoe9cKB5O7a4Io36OxeI=; h=From:To:Cc:Subject:In-Reply-To:References:Date:Message-ID: MIME-Version:Content-Type:Content-Transfer-Encoding; b=P3VJD9zoumo5qurB4G96rLXQ5rv48uYkdkCxJOnwPGda2lr+Blw8bi7orzXQYuH9z pUMy+0cqH1Wr1X+ceRkU+uxPo+JEKdpJjAR35IqFgW/ZTx6CJy1PegZhm+vlmB9eFx ll5rqEqbJYGvs/1EmtgxrulGTxjIbG3lVjSxZqJs= Received: from carbon (localhost [127.0.0.1]) by carbon.jhcloos.org (Postfix) with ESMTP id 3A4A11E9B12; Sun, 31 Oct 2010 00:26:46 +0000 (UTC) From: James Cloos To: Viktor =?utf-8?Q?Bojovi=C4=87?= Cc: pgsql-sql@postgresql.org Subject: Re: large xml database In-Reply-To: ("Viktor =?utf-8?Q?Bojovi=C4=87=22's?= message of "Sat, 30 Oct 2010 23:49:29 +0200") References: User-Agent: Gnus/5.110011 (No Gnus v0.11) Emacs/24.0.50 (gnu/linux) Face: iVBORw0KGgoAAAANSUhEUgAAABAAAAAQCAYAAAAf8/9hAAAABHNCSVQICAgIfAhkiAAAAI1J REFUOE+lU9ESgCAIg64P1y+ngUdxhl5H8wFbbM0OmUiEhKkCYaZThXCo6KE5sCbA1DDX3genvO4d eBQgEMaM5qy6uWk4SfBYfdu9jvBN9nSVDOKRtwb+I3epboOsOX5pZbJNsBJFvmQQ05YMfieIBnYX FK2N6dOawd97r/e8RjkTLzmMsiVgrAoEugtviCM3v2WzjgAAAABJRU5ErkJggg== Copyright: Copyright 2009 James Cloos OpenPGP: ED7DAEA6; url=http://jhcloos.com/public_key/0xED7DAEA6.asc OpenPGP-Fingerprint: E9E9 F828 61A4 6EA9 0F2B 63E7 997A 9F17 ED7D AEA6 Date: Sat, 30 Oct 2010 20:26:45 -0400 Message-ID: Lines: 13 MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 8bit X-Hashcash: 1:30:101031:viktor.bojovic@gmail.com::5J2nvAv0YIBXOyf/:000000000000000000000000000000000000BiTtQ X-Hashcash: 1:30:101031:pgsql-sql@postgresql.org::cldi1GxGM5M4R+Lg:000000000000000000000000000000000000u2ch5 X-Virus-Scanned: Maia Mailguard 1.0.1 X-Spam-Status: No, hits=-1.91 tagged_above=-5 required=5 tests=BAYES_00=-1.9, T_RP_MATCHES_RCVD=-0.01 X-Spam-Level: X-Archive-Number: 201010/77 X-Sequence-Number: 34728 >>>>> "VB" == Viktor Bojović writes: VB> i have very big XML documment which is larger than 50GB and want to VB> import it into databse, and transform it to relational schema. Were I doing such a conversion, I'd use perl to convert the xml into something which COPY can grok. Any other language, script or compiled, would work just as well. The goal is to avoid having to slurp the whole xml structure into memory. -JimC -- James Cloos OpenPGP: 1024D/ED7DAEA6