pg.ddx.io  pgsql-admin@postgresql.org mailing list archive  
help / color / mirror / Atom feed
From: Aaron Bono <postgresql@aranya.com>
To: Jim C. Nasby <jim@nasby.net>
Cc: Bricklen Anderson <banderson@presinet.com>
Cc: Fourat Zouari <fourat@gmail.com>
Cc: pgsql-novice@postgresql.org
Cc: pgsql-admin@postgresql.org
Subject: Re: Copying data from table to table (cloned tables)
Date: Fri, 13 Oct 2006 16:45:18 -0500
Message-ID: <bf05e51c0610131445te0366cexe3216dd124950df@mail.gmail.com> (raw)
In-Reply-To: <20061010152457.GG72517@nasby.net>
References: <621eda8a0610091651oc78994fy2b358260f5c9b58a@mail.gmail.com>
	<452AE2FF.1020409@presinet.com>
	<20061010152457.GG72517@nasby.net>

On 10/10/06, Jim C. Nasby <jim@nasby.net> wrote:
>
> On Mon, Oct 09, 2006 at 05:02:07PM -0700, Bricklen Anderson wrote:
> > Fourat Zouari wrote:
> > >Hello all,
> > >Any one could suggest the best way to copy data from table to table in
> > >the same db, the reason why am seeking for this is that the first table
> > >is becoming very big, and old data has no reason why to stay there, so
> i
> > >created a cloned table but without indexes and constraints (lighter)
> and
> > >now i would like to copy 'some' data from first to second table (copied
> > >data is data older than 3 months, i have a timestamp column).
> > >
> > >In other way, i have a table called 'hotqueues' where i store fresh
> > >messages queued, once messages are treated, they stay in 'hotqueues'
> but
> > >with a flag indicating that their arent queued for treatment..
> > >so in this way, data will rest there forever, slowing down any searches
> > >in that table, the solution was to copy old messages to another table
> > >called 'coldqueues' that has the same structure as 'hotqueues' but
> > >lighter (without constraints and indexes).
> > >How to copy these data with 100% data-loose free.
> > >
> > >Thanks for any help you can provide.
> >
> > If you just want to copy the data across to the other table:
> > begin;
> > insert into table2 select * from table1 where <some criteria>;
> > commit;
> >
> > if you also want to remove that same data from table1:
> > begin;
> > insert into table2 select * from table1 where <some criteria>;
> > delete from table1 where <same criteria as above>;
> > commit;
>
> You need to be careful with this method. For what the OP wants to do it
> would probably work, but not always. The problem is that in some
> scenarios, <same criteria as above> won't necessarily return the same
> set of rows.
>
> Starting in 8.2 you'll be able to do something like
>
> INSERT INTO table2 DELET FROM table1 WHERE ... RETURNING *;
>
> The RETURNING * will return all the data that the command deleted. In
> older versions, your best bet is to store the data you're moving in a
> temporary table, and then use that to delete the exact rows.


You may want to lock the table before doing the copy/delete - that would
take care of having a record added between the copy and the delete.

If you are doing this on a regular basis, you may want to consider adding an
insert/update trigger on the original table to put a copy into the secondary
table and then all you have to do is do a simple delete from the originating
table every so often.

-- 
==================================================================
   Aaron Bono
   Aranya Software Technologies, Inc.
   http://www.aranya.com
   http://codeelixir.com
==================================================================

view thread (13+ messages)  latest in thread

Message-ID: <bf05e51c0610131445te0366cexe3216dd124950df@mail.gmail.com>
Permalink:  ../bf05e51c0610131445te0366cexe3216dd124950df@mail.gmail.com/
Also on:    postgresql.org/message-id/bf05e51c0610131445te0366cexe3216dd124950df@mail.gmail.com

 · 

reply

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Reply to all the recipients from your mail client; the link fills in
  the headers below: reply via email
  Some clients, webmail especially, drop In-Reply-To and References from
  a link, and the reply then starts a new thread: use the mbox below.

  To: pgsql-admin@postgresql.org
  Cc: postgresql@aranya.com, jim@nasby.net, banderson@presinet.com, fourat@gmail.com, pgsql-novice@postgresql.org
  Subject: Re: Copying data from table to table (cloned tables)
  In-Reply-To: <bf05e51c0610131445te0366cexe3216dd124950df@mail.gmail.com>
  References: <621eda8a0610091651oc78994fy2b358260f5c9b58a@mail.gmail.com> <452AE2FF.1020409@presinet.com> <20061010152457.GG72517@nasby.net> <bf05e51c0610131445te0366cexe3216dd124950df@mail.gmail.com>

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox