pg.ddx.io  pgsql-performance@postgresql.org mailing list archive  

help / color / mirror / Atom feed
From: "Hugo <Nabble>
From: " <hugo.tech@gmail.com>
To: pgsql-performance@postgresql.org
Subject: Re: pg_dump and thousands of schemas
Date: Sat, 26 May 2012 21:12:13 -0700 (PDT)
Message-ID: <1338091933763-5710183.post@n5.nabble.com> (raw)
In-Reply-To: <20887.1337956883@sss.pgh.pa.us>
References: <1337843209018-5709766.post@n5.nabble.com>
	<CAFwQ8rdZ3LjiwdDuzNR3vN=OryQ6fzDb08hzeKzNbOzrQXNPbA@mail.gmail.com>
	<CAMkU=1zgUUqT6ZPAFAMR6cFx01Bbk+y05Fmwk63PBHOMrBPPoQ@mail.gmail.com>
	<20120525035455.GC25444@momjian.us>
	<1337921645663-5709975.post@n5.nabble.com>
	<20887.1337956883@sss.pgh.pa.us>

Here is a sample dump that takes a long time to be written by pg_dump:
http://postgresql.1045698.n5.nabble.com/file/n5710183/test.dump.tar.gz
test.dump.tar.gz 
(the file above has 2.4Mb, the dump itself has 66Mb)

This database has 2,311 schemas similar to those in my production database.
All schemas are empty, but pg_dump still takes 3 hours to finish it on my
computer. So now you can imagine my production database with more than
20,000 schemas like that. Can you guys take a look and see if the code has
room for improvements? I generated this dump with postgresql 9.1 (which is
what I have on my local computer), but my production database uses
postgresql 9.0. So it would be great if improvements could be delivered to
version 9.0 as well.

Thanks a lot for all the help!

Hugo

--
View this message in context: http://postgresql.1045698.n5.nabble.com/pg-dump-and-thousands-of-schemas-tp5709766p5710183.html
Sent from the PostgreSQL - performance mailing list archive at Nabble.com.



view thread (66+ messages)  latest in thread

Message-ID: <1338091933763-5710183.post@n5.nabble.com>
Permalink:  ../1338091933763-5710183.post@n5.nabble.com/
Also on:    postgresql.org/message-id/1338091933763-5710183.post@n5.nabble.com

 · 

reply
Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Reply to all the recipients using the --to and --cc options:
  reply via email

  To: pgsql-performance@postgresql.org
  Cc: Nabble, hugo.tech@gmail.com
  Subject: Re: pg_dump and thousands of schemas
  In-Reply-To: <1338091933763-5710183.post@n5.nabble.com>

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox