From: Magnus Hagander <magnus@hagander.net>
To: spotluri@ismartpanache.com
Cc: pgsql-performance@postgresql.org
Subject: Re: bulk data loading
Date: Tue, 8 Apr 2008 09:40:17 +0200
Message-ID: <20080408094017.349949af@mha-laptop> (raw)
In-Reply-To: <41583.1207626107@ismartpanache.com>
References: <41583.1207626107@ismartpanache.com>
Potluri Srikanth wrote:
> Hi all,
>
> I need to do a bulk data loading around 704GB (log file size) at
> present in 8 hrs (1 am - 9am). The data file size may increase 3 to
> 5 times in future.
>
> Using COPY it takes 96 hrs to finish the task.
> What is the best way to do it ?
>
> HARDWARE: SUN THUMPER/ RAID10
> OS : SOLARIS 10.
> DB: Greenplum/Postgres
If you're using Greenplum, you should probably be talking to the
Greenplum folks. IIRC, they have made some fairly large changes to the
load process, so they'll be the ones with the proper answers for you.
//Magnus
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Reply to all the recipients using the --to and --cc options:
reply via email
To: pgsql-performance@postgresql.org
Cc: magnus@hagander.net, spotluri@ismartpanache.com
Subject: Re: bulk data loading
In-Reply-To: <20080408094017.349949af@mha-laptop>
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox