From: Tom Samplonius <tom@sdf.com>
To: Alexaki Sofia <alexaki@ics.forth.gr>
Cc: pgsql-sql@postgresql.org
Cc: pgsql-interfaces@postgresql.org
Subject: Re: improve performance
Date: Mon, 15 Jan 2001 08:37:23 -0800 (PST)
Message-ID: <Pine.BSF.4.05.10101150831420.22851-100000@misery.sdf.com> (raw)
In-Reply-To: <Pine.GSO.4.10.10101151201390.22937-100000@athena.ics.forth.gr>
On Mon, 15 Jan 2001, Alexaki Sofia wrote:
> Hello,
>
> A)
> I am going to load a huge amount of data in the DBMS using JDBC
> and I want to reduce as much as possible the required loading time.
>
> Initially I loaded all data in one transaction. Subsequently, I increased
> the number of buffers and disabled fsync() (-o -F) and I loaded the
> data again but the performance was almost unchanged. Does it make sense??
Yes. Syncing is only done at the end of a transaction. The difference
between one fsync() and none is not measurable.
Large amounts of buffers helps in read performance, not write
performance.
> How can I improve performance? To note that no indexes are created on the
> tables and that I load both "insert into" and "create table" statements.
> ------------------------------
> B)
> I want to reduce the space (8 Kb) allocated by
> DBMS when more space is required to load the data in a table. I reduced
> the parameter BLCKSZ but the space allocated remains the same, that is 8
> KB.
> How can the allocated space be reduced? If the space was reduced
> would loading time and query time increase?
No. Reducing the blocksize does not sound like a good idea. Why would
you want to reduce the amount of allocated space? I actually wish that
Postgres would preallocate a lot of blocks in advance (ie. 100 x 8KB).
That would probably improve performance, as it would not have to keep
re-extending the file.
The best way to improve write performance, is to get faster disks
connecting to a fast interface. Also, get lots of disks (4 to 6). Pair
them into RAID1 sets, then strip over them. Use a RAID controler with a
battery backed cache in write-back (write cache) mode.
> Thank you in advance for your help
> Sofia Alexaki
Tom
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Reply to all the recipients from your mail client; the link fills in
the headers below: reply via email
Some clients, webmail especially, drop In-Reply-To and References from
a link, and the reply then starts a new thread: use the mbox below.
To: pgsql-sql@postgresql.org
Cc: tom@sdf.com, alexaki@ics.forth.gr, pgsql-interfaces@postgresql.org
Subject: Re: improve performance
In-Reply-To: <Pine.BSF.4.05.10101150831420.22851-100000@misery.sdf.com>
References: <Pine.GSO.4.10.10101151201390.22937-100000@athena.ics.forth.gr> <Pine.BSF.4.05.10101150831420.22851-100000@misery.sdf.com>
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox