Received: from malur.postgresql.org ([217.196.149.56])
 by arkaria.postgresql.org with esmtp (Exim 4.80) (envelope-from
 <pgsql-admin-owner+M42844=pgsql+2Dadmin=arkaria.postgresql.org@postgresql.org>)
 id 1XTKYQ-00082O-8B
 for pgsql-admin@arkaria.postgresql.org; Mon, 15 Sep 2014 00:54:06 +0000
Received: from localhost ([127.0.0.1] helo=postgresql.org)
 by malur.postgresql.org with smtp (Exim 4.80) (envelope-from
 <pgsql-admin-owner+M42844=pgsql+2Dadmin=arkaria.postgresql.org@postgresql.org>)
 id 1XTKYP-00033Q-4u
 for pgsql-admin@arkaria.postgresql.org; Mon, 15 Sep 2014 00:54:05 +0000
Received: from magus.postgresql.org ([2a02:c0:301:0:ffff::29])
 by malur.postgresql.org with esmtps (TLS1.2:DHE_RSA_AES_256_CBC_SHA256:256)
 (Exim 4.80) (envelope-from <morgan.ramsay@gmail.com>)
 id 1XTKYN-00033H-T9
 for pgsql-admin@postgresql.org; Mon, 15 Sep 2014 00:54:04 +0000
Received: from mail-pd0-x236.google.com ([2607:f8b0:400e:c02::236])
 by magus.postgresql.org with esmtps (TLS1.0:RSA_AES_256_CBC_SHA1:256)
 (Exim 4.80) (envelope-from <morgan.ramsay@gmail.com>)
 id 1XTKYJ-0004ng-7j
 for pgsql-admin@postgresql.org; Mon, 15 Sep 2014 00:54:02 +0000
Received: by mail-pd0-f182.google.com with SMTP id w10so5153260pde.41
 for <pgsql-admin@postgresql.org>; Sun, 14 Sep 2014 17:53:55 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113;
 h=from:to:cc:references:in-reply-to:subject:date:message-id
 :mime-version:content-type:thread-index:content-language;
 bh=7QyhPBgKYTUd3vtJIgjSlfYplFuhpcXa1+uGETKETxQ=;
 b=qbmSmHpul39xslRGEeM2bV6UiXRf5anHqWCX+4Z92g4mr8dVt0ywr2CZ29yMUWW1R1
 5bifGOjSC+ThfhXtyK3EewI8mMltbADWxqK3iE9+On9es4u6vicDoFeQgyAnHzbNxpPO
 lPU8tRKPin/xoKunkTsk+mmnp3j1IirI1qpNDm9P569kfPq54eZMDX5ZWN5wy0rZyDUf
 xUE/VApMFo3490qk2Lr9koHBu3UxzT6r4/z1F61T/0Otsfmdo1UzZrIIrA1TVYQCLO1t
 U59CXySsPQQw6n15iaNY8QxH779QI0fbv3qzji8pXrqlSxQvwgtT7/QDn47bHbuacrks
 5Wlw==
X-Received: by 10.70.89.165 with SMTP id bp5mr38115pdb.142.1410742435254;
 Sun, 14 Sep 2014 17:53:55 -0700 (PDT)
Received: from Heretic (ip72-197-173-101.sd.sd.cox.net. [72.197.173.101])
 by mx.google.com with ESMTPSA id xu4sm10110176pab.30.2014.09.14.17.53.52
 for <multiple recipients>
 (version=TLSv1 cipher=ECDHE-RSA-AES128-SHA bits=128/128);
 Sun, 14 Sep 2014 17:53:53 -0700 (PDT)
From: "Morgan Ramsay" <morgan.ramsay@gmail.com>
To: "'Rosser Schwarz'" <rosser.schwarz@gmail.com>
Cc: "'PgSQL ADMIN'" <pgsql-admin@postgresql.org>
References: <1a9b601cfd07a$a16c71a0$e44554e0$@gmail.com>
 <CAFnxYwhgfLqyvvgYE-LMbiQHsdMX=jRi6=oR9jSPor2AnH2mWg@mail.gmail.com>
In-Reply-To: 
 <CAFnxYwhgfLqyvvgYE-LMbiQHsdMX=jRi6=oR9jSPor2AnH2mWg@mail.gmail.com>
Subject: Re: Out of memory running 560 MB query
Date: Sun, 14 Sep 2014 17:53:39 -0700
Message-ID: <000001cfd07f$7e577ac0$7b067040$@gmail.com>
MIME-Version: 1.0
Content-Type: multipart/alternative;
 boundary="----=_NextPart_000_0001_01CFD044.D1F93F00"
X-Mailer: Microsoft Outlook 14.0
Thread-Index: AQHyoDfDIMwHaIn9ozECB0XQXJ9dXgEW1zpTm7MFw6A=
Content-Language: en-us
X-Antivirus: avast! (VPS 140914-1, 09/14/2014), Outbound message
X-Antivirus-Status: Clean
X-Pg-Spam-Score: -1.7 (-)
List-Archive: <http://archives.postgresql.org/pgsql-admin>
List-Help: <mailto:majordomo@postgresql.org?body=help>
List-ID: <pgsql-admin.postgresql.org>
List-Owner: <mailto:pgsql-admin-owner@postgresql.org>
List-Post: <mailto:pgsql-admin@postgresql.org>
List-Subscribe: <mailto:majordomo@postgresql.org?body=sub%20pgsql-admin>
List-Unsubscribe: <mailto:majordomo@postgresql.org?body=unsub%20pgsql-admin>
X-Mailing-List: pgsql-admin
Precedence: bulk
Sender: pgsql-admin-owner@postgresql.org

This is a multipart message in MIME format.

------=_NextPart_000_0001_01CFD044.D1F93F00
Content-Type: text/plain;
	charset="utf-8"
Content-Transfer-Encoding: quoted-printable

Sorry, I was running the query on what appeared to be a cached copy of =
the old table=E2=80=94or something.

=20

After a reboot, everything seems to be working. The admin client =
wasn=E2=80=99t responding but now all of my data is there.

=20

With regard to the list, I wasn=E2=80=99t sure whether there was a .conf =
setting that limited the size of queries or whether there was a query =
size limit.

=20

=E2=80=94Morgan

=20

=20

From: Rosser Schwarz [mailto:rosser.schwarz@gmail.com]=20
Sent: Sunday, September 14, 2014 5:28 PM
To: Morgan Ramsay
Cc: PgSQL ADMIN
Subject: Re: [ADMIN] Out of memory running 560 MB query

=20

On Sun, Sep 14, 2014 at 5:18 PM, Morgan Ramsay <morgan.ramsay@gmail.com> =
wrote:

Any idea how to successfully run a query that large? What=E2=80=99s the =
size limit of a query?

=20

Without seeing your actual query (or a syntactically similar one, if =
there are private details you can't disclose), it's difficult to say.  =
In general, though, a couple of thoughts come to mind:

=20

Can you run it as a single COPY statement, instead of however many =
individual INSERTS?  Failing that, can you use the multi-row VALUES =
syntax for your INSERT?

=20

As an aside, this type of question is probably more suited for the =
pgsql-sql list, rather than -admin.

=20

rls

=20

--=20
:wq=20


------=_NextPart_000_0001_01CFD044.D1F93F00
Content-Type: text/html;
	charset="utf-8"
Content-Transfer-Encoding: quoted-printable

<html xmlns:v=3D"urn:schemas-microsoft-com:vml" =
xmlns:o=3D"urn:schemas-microsoft-com:office:office" =
xmlns:w=3D"urn:schemas-microsoft-com:office:word" =
xmlns:m=3D"http://schemas.microsoft.com/office/2004/12/omml" =
xmlns=3D"http://www.w3.org/TR/REC-html40"><head><meta =
http-equiv=3DContent-Type content=3D"text/html; charset=3Dutf-8"><meta =
name=3DGenerator content=3D"Microsoft Word 14 (filtered =
medium)"><style><!--
/* Font Definitions */
@font-face
	{font-family:"Cambria Math";
	panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
	{font-family:Calibri;
	panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
	{font-family:Tahoma;
	panose-1:2 11 6 4 3 5 4 4 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
	{margin:0in;
	margin-bottom:.0001pt;
	font-size:12.0pt;
	font-family:"Times New Roman","serif";}
a:link, span.MsoHyperlink
	{mso-style-priority:99;
	color:blue;
	text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
	{mso-style-priority:99;
	color:purple;
	text-decoration:underline;}
span.EmailStyle17
	{mso-style-type:personal-reply;
	font-family:"Calibri","sans-serif";
	color:windowtext;}
.MsoChpDefault
	{mso-style-type:export-only;
	font-family:"Calibri","sans-serif";}
@page WordSection1
	{size:8.5in 11.0in;
	margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
	{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext=3D"edit" spidmax=3D"1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext=3D"edit">
<o:idmap v:ext=3D"edit" data=3D"1" />
</o:shapelayout></xml><![endif]--></head><body lang=3DEN-US link=3Dblue =
vlink=3Dpurple><div class=3DWordSection1><p class=3DMsoNormal><span =
style=3D'font-size:11.0pt;font-family:"Calibri","sans-serif"'>Sorry, I =
was running the query on what appeared to be a cached copy of the old =
table=E2=80=94or something.<o:p></o:p></span></p><p =
class=3DMsoNormal><span =
style=3D'font-size:11.0pt;font-family:"Calibri","sans-serif"'><o:p>&nbsp;=
</o:p></span></p><p class=3DMsoNormal><span =
style=3D'font-size:11.0pt;font-family:"Calibri","sans-serif"'>After a =
reboot, everything seems to be working. The admin client wasn=E2=80=99t =
responding but now all of my data is there.<o:p></o:p></span></p><p =
class=3DMsoNormal><span =
style=3D'font-size:11.0pt;font-family:"Calibri","sans-serif"'><o:p>&nbsp;=
</o:p></span></p><p class=3DMsoNormal><span =
style=3D'font-size:11.0pt;font-family:"Calibri","sans-serif"'>With =
regard to the list, I wasn=E2=80=99t sure whether there was a .conf =
setting that limited the size of queries or whether there was a query =
size limit.<o:p></o:p></span></p><p class=3DMsoNormal><span =
style=3D'font-size:11.0pt;font-family:"Calibri","sans-serif"'><o:p>&nbsp;=
</o:p></span></p><p class=3DMsoNormal><span =
style=3D'font-size:11.0pt;font-family:"Calibri","sans-serif"'>=E2=80=94Mo=
rgan<o:p></o:p></span></p><p class=3DMsoNormal><span =
style=3D'font-size:11.0pt;font-family:"Calibri","sans-serif"'><o:p>&nbsp;=
</o:p></span></p><p class=3DMsoNormal><span =
style=3D'font-size:11.0pt;font-family:"Calibri","sans-serif"'><o:p>&nbsp;=
</o:p></span></p><p class=3DMsoNormal><b><span =
style=3D'font-size:10.0pt;font-family:"Tahoma","sans-serif"'>From:</span>=
</b><span style=3D'font-size:10.0pt;font-family:"Tahoma","sans-serif"'> =
Rosser Schwarz [mailto:rosser.schwarz@gmail.com] <br><b>Sent:</b> =
Sunday, September 14, 2014 5:28 PM<br><b>To:</b> Morgan =
Ramsay<br><b>Cc:</b> PgSQL ADMIN<br><b>Subject:</b> Re: [ADMIN] Out of =
memory running 560 MB query<o:p></o:p></span></p><p =
class=3DMsoNormal><o:p>&nbsp;</o:p></p><div><div><p class=3DMsoNormal>On =
Sun, Sep 14, 2014 at 5:18 PM, Morgan Ramsay &lt;<a =
href=3D"mailto:morgan.ramsay@gmail.com" =
target=3D"_blank">morgan.ramsay@gmail.com</a>&gt; =
wrote:<o:p></o:p></p></div><div><div><blockquote =
style=3D'border:none;border-left:solid #CCCCCC 1.0pt;padding:0in 0in 0in =
6.0pt;margin-left:4.8pt;margin-right:0in'><div><p class=3DMsoNormal =
style=3D'mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'>Any idea =
how to successfully run a query that large? What=E2=80=99s the size =
limit of a query?<o:p></o:p></p></div></blockquote></div><div><p =
class=3DMsoNormal><o:p>&nbsp;</o:p></p></div><div><p =
class=3DMsoNormal>Without seeing your actual query (or a syntactically =
similar one, if there are private details you can't disclose), it's =
difficult to say. &nbsp;In general, though, a couple of thoughts come to =
mind:<o:p></o:p></p></div><div><p =
class=3DMsoNormal><o:p>&nbsp;</o:p></p></div><p class=3DMsoNormal>Can =
you run it as a single COPY statement, instead of however many =
individual INSERTS? &nbsp;Failing that, can you use the multi-row VALUES =
syntax for your INSERT?<o:p></o:p></p><div><p =
class=3DMsoNormal><o:p>&nbsp;</o:p></p></div><div><p =
class=3DMsoNormal>As an aside, this type of question is probably more =
suited for the pgsql-sql list, rather than =
-admin.<o:p></o:p></p></div><div><p =
class=3DMsoNormal><o:p>&nbsp;</o:p></p></div><div><p =
class=3DMsoNormal>rls<o:p></o:p></p></div><div><p =
class=3DMsoNormal><o:p>&nbsp;</o:p></p></div><p class=3DMsoNormal>-- =
<br>:wq <o:p></o:p></p></div></div></div></body></html>
------=_NextPart_000_0001_01CFD044.D1F93F00--