pg.ddx.io  pgsql-admin@postgresql.org mailing list archive  
help / color / mirror / Atom feed
From: Bruce Momjian <bruce@momjian.us>
To: Alejandro Martínez <zen@itram.es>
Cc: pgsql-admin@postgresql.org
Subject: Re: Upgrading cluster with thousands of DBs
Date: Tue, 21 Jan 2014 21:05:39 -0500
Message-ID: <20140122020539.GB5322@momjian.us> (raw)
In-Reply-To: <CAOx6PCJe-+=Y70fk7c5LcJ5aUqxpnXHtHpP34Sg8hS7nmMV6YQ@mail.gmail.com>
References: <CAOx6PCJe-+=Y70fk7c5LcJ5aUqxpnXHtHpP34Sg8hS7nmMV6YQ@mail.gmail.com>
List-Unsubscribe: <mailto:majordomo@postgresql.org?body=unsub%20pgsql-admin>

On Tue, Jan 14, 2014 at 11:45:33AM +0100, Alejandro Martínez wrote:
> Hi list,
> 
> We're working on upgrading from 9.1 to 9.3 some of our database
> clusters, while seeking to minimize (write) downtime by making the
> upgrades as fast as possible.
> 
> However, our clusters have the particularity that they get to host
> many different *databases*, as in, ~2000 databases per cluster. Most
> of those databases are small (only a table and PostGIS functions), so
> it's more a problem of the number of DBs than the space they use. The
> total size of the cluster is around 60gb.
> 
> I first started using pg_upgrade but, even when enabling
> parallelization and hardlinks, as most of the steps (preliminary
> check?) don't seem to be parallelized, the upgrade takes ~5 hours as
> it goes database-per-database serially on most steps.

That is surprising.  I know I see parallel hard link creation and
parallel database dump in my testing of 9.3 pg_upgrade.

-- 
  Bruce Momjian  <bruce@momjian.us>        http://momjian.us
  EnterpriseDB                             http://enterprisedb.com

  + Everyone has their own god. +


-- 
Sent via pgsql-admin mailing list (pgsql-admin@postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-admin



view thread (3+ messages)

Message-ID: <20140122020539.GB5322@momjian.us>
Permalink:  ../20140122020539.GB5322@momjian.us/
Also on:    postgresql.org/message-id/20140122020539.GB5322@momjian.us

 · 

reply

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Reply to all the recipients from your mail client; the link fills in
  the headers below: reply via email
  Some clients, webmail especially, drop In-Reply-To and References from
  a link, and the reply then starts a new thread: use the mbox below.

  To: pgsql-admin@postgresql.org
  Cc: bruce@momjian.us, zen@itram.es
  Subject: Re: Upgrading cluster with thousands of DBs
  In-Reply-To: <20140122020539.GB5322@momjian.us>
  References: <CAOx6PCJe-+=Y70fk7c5LcJ5aUqxpnXHtHpP34Sg8hS7nmMV6YQ@mail.gmail.com> <20140122020539.GB5322@momjian.us>

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox