From: Bruce Momjian <bruce@momjian.us>
To: Alejandro MartÃnez <zen@itram.es>
Cc: pgsql-admin@postgresql.org
Subject: Re: Upgrading cluster with thousands of DBs
Date: Tue, 21 Jan 2014 21:05:39 -0500
Message-ID: <20140122020539.GB5322@momjian.us> (raw)
In-Reply-To: <CAOx6PCJe-+=Y70fk7c5LcJ5aUqxpnXHtHpP34Sg8hS7nmMV6YQ@mail.gmail.com>
References: <CAOx6PCJe-+=Y70fk7c5LcJ5aUqxpnXHtHpP34Sg8hS7nmMV6YQ@mail.gmail.com>
List-Unsubscribe: <mailto:majordomo@postgresql.org?body=unsub%20pgsql-admin>
On Tue, Jan 14, 2014 at 11:45:33AM +0100, Alejandro MartÃnez wrote:
> Hi list,
>
> We're working on upgrading from 9.1 to 9.3 some of our database
> clusters, while seeking to minimize (write) downtime by making the
> upgrades as fast as possible.
>
> However, our clusters have the particularity that they get to host
> many different *databases*, as in, ~2000 databases per cluster. Most
> of those databases are small (only a table and PostGIS functions), so
> it's more a problem of the number of DBs than the space they use. The
> total size of the cluster is around 60gb.
>
> I first started using pg_upgrade but, even when enabling
> parallelization and hardlinks, as most of the steps (preliminary
> check?) don't seem to be parallelized, the upgrade takes ~5 hours as
> it goes database-per-database serially on most steps.
That is surprising. I know I see parallel hard link creation and
parallel database dump in my testing of 9.3 pg_upgrade.
--
Bruce Momjian <bruce@momjian.us> http://momjian.us
EnterpriseDB http://enterprisedb.com
+ Everyone has their own god. +
--
Sent via pgsql-admin mailing list (pgsql-admin@postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-admin
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Reply to all the recipients from your mail client; the link fills in
the headers below: reply via email
Some clients, webmail especially, drop In-Reply-To and References from
a link, and the reply then starts a new thread: use the mbox below.
To: pgsql-admin@postgresql.org
Cc: bruce@momjian.us, zen@itram.es
Subject: Re: Upgrading cluster with thousands of DBs
In-Reply-To: <20140122020539.GB5322@momjian.us>
References: <CAOx6PCJe-+=Y70fk7c5LcJ5aUqxpnXHtHpP34Sg8hS7nmMV6YQ@mail.gmail.com> <20140122020539.GB5322@momjian.us>
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox