pg.ddx.io  pgsql-performance@postgresql.org mailing list archive  
help / color / mirror / Atom feed
From: Tim Mohler <tamohler@nyc.rr.com>
To: pgsql-performance@postgresql.org
Subject: Batch copying of databases
Date: Wed, 5 Mar 2003 15:26:27 -0500
Message-ID: <LDEBIOHBEOBPKBBEPDFFKEBGCBAA.tamohler@nyc.rr.com> (raw)

Hi all,

I'm new to Postgres, and am not even the DBA for the system. I'm just a
sysadmin trying to make things run faster. Every month, we copy over a 25
million row table from the production server to the reporting server. Total
size is something like 40 gigabytes.

The copy in takes close to 24 hours, and I see the disks being hammered by
hundreds of small writes every second. The system is mostly waiting on I/O.
Is there any facility in Postgres to force batching of the I/O transactions
to something more reasonable than 8K?

Thanks for any advice,
Tim




view thread (3+ messages)  latest in thread

Message-ID: <LDEBIOHBEOBPKBBEPDFFKEBGCBAA.tamohler@nyc.rr.com>
Permalink:  ../LDEBIOHBEOBPKBBEPDFFKEBGCBAA.tamohler@nyc.rr.com/
Also on:    postgresql.org/message-id/LDEBIOHBEOBPKBBEPDFFKEBGCBAA.tamohler@nyc.rr.com

 · 

reply

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Reply to all the recipients from your mail client; the link fills in
  the headers below: reply via email
  Some clients, webmail especially, drop In-Reply-To and References from
  a link, and the reply then starts a new thread: use the mbox below.

  To: pgsql-performance@postgresql.org
  Cc: tamohler@nyc.rr.com
  Subject: Re: Batch copying of databases
  In-Reply-To: <LDEBIOHBEOBPKBBEPDFFKEBGCBAA.tamohler@nyc.rr.com>
  References: <LDEBIOHBEOBPKBBEPDFFKEBGCBAA.tamohler@nyc.rr.com>

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox