From: Tom Lane <tgl@sss.pgh.pa.us>
To: Sorin N. Ciolofan <ciolofan@ics.forth.gr>
Cc: 'Shoaib Mir' <shoaibmir@gmail.com>
Cc: pgsql-general@postgresql.org, pgsql-admin@postgresql.org, "'Dimitris Kotzinos'" <kotzino@ics.forth.gr>
Subject: Re: [GENERAL] Increasing the shared memory
Date: Fri, 13 Apr 2007 10:08:28 -0400
Message-ID: <18737.1176473308@sss.pgh.pa.us> (raw)
In-Reply-To: <20070413081234.B59698E40FC@mailhost.ics.forth.gr>
References: <20070413081234.B59698E40FC@mailhost.ics.forth.gr>
"Sorin N. Ciolofan" <ciolofan@ics.forth.gr> writes:
> I will simplify the things in order to describe when the error occurred:
> The input of the application is some data which is read from files on disk,
> processed and then inserted in the database in one transaction. This total
> quantity of data represents an integer number of data files, n*q, where q is
> a file which has always 60kb and n is the positive integer.
> For n=23 and shared_buffers=1000 and max_locks_per_transaction=64 the
> Postgres throws the following exception:
> org.postgresql.util.PSQLException: ERROR: out of shared memory
> For n=23 I estimated that we create and manipulate about 8000 tables.
Okay, as far as I know the only user-causable way to get that message is
to run out of lock-table space, and a transaction does take a lock for
each table it touches, so I concur that raising
max_locks_per_transaction is an appropriate response. If you didn't see
any change in the maximum N you could handle then I wonder whether you
actually did raise it --- does "show max_locks_per_transaction" reflect
the intended new value?
Another possibility is that there's something about your code that makes
the number of locks involved very nonlinear in N. You could try
checking the number of rows in pg_locks immediately before commit at
some smaller values of N to confirm what the scaling is really like.
regards, tom lane
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Reply to all the recipients using the --to and --cc options:
reply via email
To: pgsql-admin@postgresql.org
Cc: tgl@sss.pgh.pa.us, ciolofan@ics.forth.gr, shoaibmir@gmail.com, kotzino@ics.forth.gr
Subject: Re: [GENERAL] Increasing the shared memory
In-Reply-To: <18737.1176473308@sss.pgh.pa.us>
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox