pg.ddx.io pgsql-performance@postgresql.org mailing list archive
help / color / mirror / Atom feedHundreds of database and FSM
3+ messages / 3 participants
[nested] [flat]
* Hundreds of database and FSM
@ 2006-11-15 16:31 Craig A. James <cjames@modgraph-usa.com>
2006-11-15 17:31 ` Re: Hundreds of database and FSM Alvaro Herrera <alvherre@commandprompt.com>
0 siblings, 1 reply; 3+ messages in thread
From: Craig A. James @ 2006-11-15 16:31 UTC (permalink / raw)
To: pgsql-performance
A few months ago a couple guys got "bragging rights" for having the most separate databases. A couple guys claimed several hundred databases and one said he had several thousand databases. The concensus was that Postgres has no problem handling many separate databases.
I took that to heart and redesigned our system; we now have about 150 "primary data sources" that are used to build couple of "warehouses" that our customers actually search. Each database has about 20 tables. The total size (all databases and all tables together) is not huge, about 40 million rows. Eventually the warehouse (customer accessible) databases will be moved to separate servers, configured and indexed specifically for the task.
The only problem I've encountered is messages in the log:
NOTICE: number of page slots needed (131904) exceeds max_fsm_pages (100000)
HINT: Consider increasing the configuration parameter "max_fsm_pages" to a value over 131904.
So I dutifully followed this advice:
max_fsm_pages = 320000
max_fsm_relations = 20000
This is based on our current 150 databases times 20 tables, or 3000 tables total. But I wasn't sure if sequences count as "relations", which would double the number. So I set it at 20K relations to allow for growth.
Is there anything else I need to worry about? What happens if I go to, say, 500 databases (aside from increasing the FSM numbers even more)? 1000 databases?
The servers are 4 GB, dual Xeon, Postgres 8.1.4 on Linux FC4.
Thanks,
Craig
^ permalink raw reply [nested|flat] 3+ messages in thread
* Re: Hundreds of database and FSM
2006-11-15 16:31 Hundreds of database and FSM Craig A. James <cjames@modgraph-usa.com>
@ 2006-11-15 17:31 ` Alvaro Herrera <alvherre@commandprompt.com>
2006-11-15 17:42 ` Re: Hundreds of database and FSM Steinar H. Gunderson <sgunderson@bigfoot.com>
0 siblings, 1 reply; 3+ messages in thread
From: Alvaro Herrera @ 2006-11-15 17:31 UTC (permalink / raw)
To: Craig A. James <cjames@modgraph-usa.com>; +Cc: pgsql-performance
Craig A. James wrote:
> This is based on our current 150 databases times 20 tables, or 3000 tables
> total. But I wasn't sure if sequences count as "relations", which would
> double the number.
They don't because they don't have free space.
--
Alvaro Herrera http://www.CommandPrompt.com/
PostgreSQL Replication, Consulting, Custom Development, 24x7 support
^ permalink raw reply [nested|flat] 3+ messages in thread
* Re: Hundreds of database and FSM
2006-11-15 16:31 Hundreds of database and FSM Craig A. James <cjames@modgraph-usa.com>
2006-11-15 17:31 ` Re: Hundreds of database and FSM Alvaro Herrera <alvherre@commandprompt.com>
@ 2006-11-15 17:42 ` Steinar H. Gunderson <sgunderson@bigfoot.com>
0 siblings, 0 replies; 3+ messages in thread
From: Steinar H. Gunderson @ 2006-11-15 17:42 UTC (permalink / raw)
To: Craig A. James <cjames@modgraph-usa.com>; pgsql-performance
On Wed, Nov 15, 2006 at 02:31:45PM -0300, Alvaro Herrera wrote:
>> This is based on our current 150 databases times 20 tables, or 3000 tables
>> total. But I wasn't sure if sequences count as "relations", which would
>> double the number.
> They don't because they don't have free space.
OTOH, indexes do.
/* Steinar */
--
Homepage: http://www.sesse.net/
^ permalink raw reply [nested|flat] 3+ messages in thread
end of thread, other threads:[~2006-11-15 17:42 UTC | newest]
Thread overview: 3+ messages (download: mbox mbox.gz follow: Atom feed)
-- links below jump to the message on this page --
2006-11-15 16:31 Hundreds of database and FSM Craig A. James <cjames@modgraph-usa.com>
2006-11-15 17:31 ` Alvaro Herrera <alvherre@commandprompt.com>
2006-11-15 17:42 ` Steinar H. Gunderson <sgunderson@bigfoot.com>
This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox