pg.ddx.io pgsql-performance@postgresql.org mailing list archive
help / color / mirror / Atom feedbulk data loading
2+ messages / 2 participants
[nested] [flat]
* bulk data loading
@ 2008-04-08 03:41 Potluri Srikanth <spotluri@ismartpanache.com>
0 siblings, 1 reply; 2+ messages in thread
From: Potluri Srikanth @ 2008-04-08 03:41 UTC (permalink / raw)
To: pgsql-performance
<HTML>
Hi all,<br>
<br>
I need to do a bulk data loading around 704GB (log file size) at present in 8 hrs (1 am - 9am). The data file size may increase 3 to 5 times in future.<br>
<br>
Using COPY it takes 96 hrs to finish the task.<br>
What is the best way to do it ?<br>
<br>
HARDWARE: SUN THUMPER/ RAID10<br>
OS : SOLARIS 10.<br>
DB: Greenplum/Postgres<br>
<br>
<br>
Regards,
<br>
Srikanth k Potluri
<br>
+63 9177444783(philippines) <br>
<br>
<span style="font-weight: bold;"><br>
</span><blockquote style="border-left: 2px solid rgb(245, 245, 245); margin-left: 5px; margin-right: 0px; padding-left: 5px; padding-right: 0px;"><br>
</blockquote><BR></HTML>
^ permalink raw reply [nested|flat] 2+ messages in thread
* Re: bulk data loading
@ 2008-04-08 07:40 Magnus Hagander <magnus@hagander.net>
parent: Potluri Srikanth <spotluri@ismartpanache.com>
0 siblings, 0 replies; 2+ messages in thread
From: Magnus Hagander @ 2008-04-08 07:40 UTC (permalink / raw)
To: spotluri@ismartpanache.com; +Cc: pgsql-performance
Potluri Srikanth wrote:
> Hi all,
>
> I need to do a bulk data loading around 704GB (log file size) at
> present in 8 hrs (1 am - 9am). The data file size may increase 3 to
> 5 times in future.
>
> Using COPY it takes 96 hrs to finish the task.
> What is the best way to do it ?
>
> HARDWARE: SUN THUMPER/ RAID10
> OS : SOLARIS 10.
> DB: Greenplum/Postgres
If you're using Greenplum, you should probably be talking to the
Greenplum folks. IIRC, they have made some fairly large changes to the
load process, so they'll be the ones with the proper answers for you.
//Magnus
^ permalink raw reply [nested|flat] 2+ messages in thread
end of thread, other threads:[~2008-04-08 07:40 UTC | newest]
Thread overview: 2+ messages (download: mbox mbox.gz follow: Atom feed)
-- links below jump to the message on this page --
2008-04-08 03:41 bulk data loading Potluri Srikanth <spotluri@ismartpanache.com>
2008-04-08 07:40 ` Magnus Hagander <magnus@hagander.net>
This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox