pg.ddx.io  pgsql-admin@postgresql.org mailing list archive  
help / color / mirror / Atom feed
Does PostgreSQL Stores its database in multiple disks?
8+ messages / 7 participants
[nested] [flat]

* Does PostgreSQL Stores its database in multiple disks?
@ 2004-10-01 21:01 Igor Maciel Macaubas <igor@providerst.com.br>
  2004-10-01 21:09 ` Re: Does PostgreSQL Stores its database in multiple disks? Björn Lundin <bnl@tiscali.se>
  2004-10-01 21:17 ` Re: Does PostgreSQL Stores its database in multiple disks? Heather Johnson <hjohnson@nypost.com>
  2004-10-01 23:56 ` Re: Does PostgreSQL Stores its database in multiple disks? Christian Fowler <spider@steelsun.com>
  2004-10-02 00:20 ` Re: Does PostgreSQL Stores its database in multiple disks? Stephen Frost <sfrost@snowman.net>
  2004-10-02 00:40 ` Re: Does PostgreSQL Stores its database in multiple disks? Scott Marlowe <smarlowe@qwest.net>
  0 siblings, 5 replies; 8+ messages in thread

From: Igor Maciel Macaubas @ 2004-10-01 21:01 UTC (permalink / raw)
  To: pgsql-admin

Hi Guys,

I have a PostgreSQL server, running 7.4.2, that will store a really large amount of data (200GB) being migrated from an Oracle database. I have a machine with two 120GB Ultra ATA IDE disks, and I'd like to know if PostgreSQL could split it over both disks (that gives me 240GB or storage). Does he do this automatically ?
Or I'll have to split it manually, creating symbolic links on my file system (ext3)?
Does anyone ever stored a database (see, it's ONE database only, not a cluster) on multiple disks ?

What about PgSQL 8? It'll include this feature?

Thanks!

Regards,
Igor
--
igor@providerst.com.br

^ permalink  raw  reply  [nested|flat] 8+ messages in thread

* Re: Does PostgreSQL Stores its database in multiple disks?
  2004-10-01 21:01 Does PostgreSQL Stores its database in multiple disks? Igor Maciel Macaubas <igor@providerst.com.br>
@ 2004-10-01 21:09 ` Björn Lundin <bnl@tiscali.se>
  4 siblings, 0 replies; 8+ messages in thread

From: Björn Lundin @ 2004-10-01 21:09 UTC (permalink / raw)
  To: pgsql-admin

Igor Maciel Macaubas wrote:

> Hi Guys,
> 
> I have a PostgreSQL server, running 7.4.2, that will store a really large
> amount of data (200GB) being migrated from an Oracle database. I have a
> machine with two 120GB Ultra ATA IDE disks, and I'd like to know if
> PostgreSQL could split it over both disks (that gives me 240GB or
> storage). 

Have you considered Raid? Raid 0 or 1 (I keep forgetting which)
will make the 2 disks to appear as one (The other will mirror one disk)

-- 
/Björn
-------------------------------------------------------------------
http://lundin.homelinux.net
Registered Linux User No. 267342 <http://counter.li.org;



^ permalink  raw  reply  [nested|flat] 8+ messages in thread

* Re: Does PostgreSQL Stores its database in multiple disks?
  2004-10-01 21:01 Does PostgreSQL Stores its database in multiple disks? Igor Maciel Macaubas <igor@providerst.com.br>
@ 2004-10-01 21:17 ` Heather Johnson <hjohnson@nypost.com>
  2004-10-01 21:28   ` Re: Does PostgreSQL Stores its database in multiple disks? Igor Maciel Macaubas <igor@providerst.com.br>
  4 siblings, 1 reply; 8+ messages in thread

From: Heather Johnson @ 2004-10-01 21:17 UTC (permalink / raw)
  To: Igor Maciel Macaubas <igor@providerst.com.br>; +Cc: pgsql-admin

Could you configure the two volumes as one volume with RAID? If so, then 
Postgres shouldn't require any special adjusting to accomplish what you 
are after.

Heather Johnson
Senior Database Programmer
New York Post

Igor Maciel Macaubas wrote:
> Hi Guys,
>  
> I have a PostgreSQL server, running 7.4.2, that will store a really 
> large amount of data (200GB) being migrated from an Oracle database. I 
> have a machine with two 120GB Ultra ATA IDE disks, and I'd like to know 
> if PostgreSQL could split it over both disks (that gives me 240GB or 
> storage). Does he do this automatically ?
> Or I'll have to split it manually, creating symbolic links on my file 
> system (ext3)?
> Does anyone ever stored a database (see, it's ONE database only, not a 
> cluster) on multiple disks ?
>  
> What about PgSQL 8? It'll include this feature?
>  
> Thanks!
>  
> Regards,
> Igor
> --
> igor@providerst.com.br <mailto:igor@providerst.com.br>
>  



^ permalink  raw  reply  [nested|flat] 8+ messages in thread

* Re: Does PostgreSQL Stores its database in multiple disks?
  2004-10-01 21:01 Does PostgreSQL Stores its database in multiple disks? Igor Maciel Macaubas <igor@providerst.com.br>
  2004-10-01 21:17 ` Re: Does PostgreSQL Stores its database in multiple disks? Heather Johnson <hjohnson@nypost.com>
@ 2004-10-01 21:28   ` Igor Maciel Macaubas <igor@providerst.com.br>
  2004-10-01 22:10     ` Re: Does PostgreSQL Stores its database in multiple disks? Christopher Browne <cbbrowne@acm.org>
  0 siblings, 1 reply; 8+ messages in thread

From: Igor Maciel Macaubas @ 2004-10-01 21:28 UTC (permalink / raw)
  To: Heather Johnson <hjohnson@nypost.com>; +Cc: pgsql-admin

Hi,

Heather, I might be able to do it. Let me check .. I can buy a cheap RAID 
IDE controller and try to mount everything as one.

I was looking at the change log of postgresql 8, and figured out that it 
supports tablespace now, giving me the flexibility of storing my tables in 
different disks and even different directories if I want.

So, I'm thinking in, instead of migrating it from oracle to 7.4.2, migrate 
it directly to 8.0 and be a beta tester for 8.0. that would be a great 
experiment, don't you think?
Is anyone here using pgsql 8.0 in production now? I'm already using it in my 
development environment, around 80 tables but just a few megabytes of data 
(it's development). Is anyone here using it in a real world application by 
now?

Regards,
Igor
--
igor@providerst.com.br


----- Original Message ----- 
From: "Heather Johnson" <hjohnson@nypost.com>
To: "Igor Maciel Macaubas" <igor@providerst.com.br>
Cc: <pgsql-admin@postgresql.org>
Sent: Friday, October 01, 2004 6:17 PM
Subject: Re: [ADMIN] Does PostgreSQL Stores its database in multiple disks?


> Could you configure the two volumes as one volume with RAID? If so, then 
> Postgres shouldn't require any special adjusting to accomplish what you 
> are after.
>
> Heather Johnson
> Senior Database Programmer
> New York Post
>
> Igor Maciel Macaubas wrote:
>> Hi Guys,
>>  I have a PostgreSQL server, running 7.4.2, that will store a really 
>> large amount of data (200GB) being migrated from an Oracle database. I 
>> have a machine with two 120GB Ultra ATA IDE disks, and I'd like to know 
>> if PostgreSQL could split it over both disks (that gives me 240GB or 
>> storage). Does he do this automatically ?
>> Or I'll have to split it manually, creating symbolic links on my file 
>> system (ext3)?
>> Does anyone ever stored a database (see, it's ONE database only, not a 
>> cluster) on multiple disks ?
>>  What about PgSQL 8? It'll include this feature?
>>  Thanks!
>>  Regards,
>> Igor
>> --
>> igor@providerst.com.br <mailto:igor@providerst.com.br>
>> 




^ permalink  raw  reply  [nested|flat] 8+ messages in thread

* Re: Does PostgreSQL Stores its database in multiple disks?
  2004-10-01 21:01 Does PostgreSQL Stores its database in multiple disks? Igor Maciel Macaubas <igor@providerst.com.br>
  2004-10-01 21:17 ` Re: Does PostgreSQL Stores its database in multiple disks? Heather Johnson <hjohnson@nypost.com>
  2004-10-01 21:28   ` Re: Does PostgreSQL Stores its database in multiple disks? Igor Maciel Macaubas <igor@providerst.com.br>
@ 2004-10-01 22:10     ` Christopher Browne <cbbrowne@acm.org>
  0 siblings, 0 replies; 8+ messages in thread

From: Christopher Browne @ 2004-10-01 22:10 UTC (permalink / raw)
  To: pgsql-admin

Centuries ago, Nostradamus foresaw when igor@providerst.com.br ("Igor Maciel Macaubas") would write:
> Heather, I might be able to do it. Let me check .. I can buy a cheap
> RAID IDE controller and try to mount everything as one.

You'd be about as well off, if you're running Linux, to use the "md"
RAID driver that simulates RAID in software.

> I was looking at the change log of postgresql 8, and figured out that
> it supports tablespace now, giving me the flexibility of storing my
> tables in different disks and even different directories if I want.
>
> So, I'm thinking in, instead of migrating it from oracle to 7.4.2,
> migrate it directly to 8.0 and be a beta tester for 8.0. that would be
> a great experiment, don't you think?
> Is anyone here using pgsql 8.0 in production now? I'm already using it
> in my development environment, around 80 tables but just a few
> megabytes of data (it's development). Is anyone here using it in a
> real world application by now?

Nobody should be considering using 8.0 for anything called "production
use" at this point in time, because it is NOT guaranteed that there
will be an upgrade path to the "official" release.

Now, I'm possibly 'somewhat conservative,' as someone that wouldn't
want to call a system 'production' if it's using cheapo IDE drives.

But what you're proposing isn't merely a matter of 'trying to jump the
learning curve;' you're tempting, instead, the "learning cliff," and
the results of problems, there, are that instead of scuffing your
knees, you wind up falling 8 stories and going "splat."
-- 
output = ("cbbrowne" "@" "ntlug.org")
http://www.ntlug.org/~cbbrowne/spiritual.html
Rules of the  Evil Overlord #33. "I won't  require high-ranking female
members of  my organization to wear a  stainless-steel bustier. Morale
is  better with  a more  casual dress-code.   Similarly,  outfits made
entirely from black leather will be reserved for formal occasions."
<http://www.eviloverlord.com/;



^ permalink  raw  reply  [nested|flat] 8+ messages in thread

* Re: Does PostgreSQL Stores its database in multiple disks?
  2004-10-01 21:01 Does PostgreSQL Stores its database in multiple disks? Igor Maciel Macaubas <igor@providerst.com.br>
@ 2004-10-01 23:56 ` Christian Fowler <spider@steelsun.com>
  4 siblings, 0 replies; 8+ messages in thread

From: Christian Fowler @ 2004-10-01 23:56 UTC (permalink / raw)
  To: Igor Maciel Macaubas <igor@providerst.com.br>; +Cc: pgsql-admin



Igor,

I would recommend you investigate LVM:

http://www.tldp.org/HOWTO/LVM-HOWTO/

This enables you to string multiple physical units into a single volume - 
as well as expand and grow the volume. I am unsure about postgres 
consequences of this for as much data as you have, so I will leave it up 
to others to comment about this.

However, my recommendation is for a modest investment of a third 120GB 
drive and a RAID card, you could do RAID 5 with 3 disks and get 240GB of 
storage.


On Fri, 1 Oct 2004, Igor Maciel Macaubas wrote:

> Hi Guys,
>
> I have a PostgreSQL server, running 7.4.2, that will store a really 
> large amount of data (200GB) being migrated from an Oracle database. I 
> have a machine with two 120GB Ultra ATA IDE disks, and I'd like to know 
> if PostgreSQL could split it over both disks (that gives me 240GB or 
> storage). Does he do this automatically ? Or I'll have to split it 
> manually, creating symbolic links on my file system (ext3)? Does anyone 
> ever stored a database (see, it's ONE database only, not a cluster) on 
> multiple disks ?
>
> What about PgSQL 8? It'll include this feature?
>
> Thanks!
>
> Regards,
> Igor
> --
> igor@providerst.com.br
>

[ \ /
[ >X<   spider@steelsun.com   |   http://www.viovio.com/
[ / \



^ permalink  raw  reply  [nested|flat] 8+ messages in thread

* Re: Does PostgreSQL Stores its database in multiple disks?
  2004-10-01 21:01 Does PostgreSQL Stores its database in multiple disks? Igor Maciel Macaubas <igor@providerst.com.br>
@ 2004-10-02 00:20 ` Stephen Frost <sfrost@snowman.net>
  4 siblings, 0 replies; 8+ messages in thread

From: Stephen Frost @ 2004-10-02 00:20 UTC (permalink / raw)
  To: Igor Maciel Macaubas <igor@providerst.com.br>; +Cc: pgsql-admin

* Igor Maciel Macaubas (igor@providerst.com.br) wrote:
> I have a PostgreSQL server, running 7.4.2, that will store a really large amount of data (200GB) being migrated from an Oracle database. I have a machine with two 120GB Ultra ATA IDE disks, and I'd like to know if PostgreSQL could split it over both disks (that gives me 240GB or storage). Does he do this automatically ?
> Or I'll have to split it manually, creating symbolic links on my file system (ext3)?
> Does anyone ever stored a database (see, it's ONE database only, not a cluster) on multiple disks ?
> 
> What about PgSQL 8? It'll include this feature?

An alternative might be to use some kind of LVM (such as device
mapper/LVM2 under Linux) to combine the two disks into one logical
device.

	Stephen

Attachments:

  signature.asc (application/pgp-signature, 188B) download

^ permalink  raw  reply  [nested|flat] 8+ messages in thread

* Re: Does PostgreSQL Stores its database in multiple disks?
  2004-10-01 21:01 Does PostgreSQL Stores its database in multiple disks? Igor Maciel Macaubas <igor@providerst.com.br>
@ 2004-10-02 00:40 ` Scott Marlowe <smarlowe@qwest.net>
  4 siblings, 0 replies; 8+ messages in thread

From: Scott Marlowe @ 2004-10-02 00:40 UTC (permalink / raw)
  To: Igor Maciel Macaubas <igor@providerst.com.br>; +Cc: pgsql-admin

On Fri, 2004-10-01 at 15:01, Igor Maciel Macaubas wrote:
> Hi Guys,
>  
> I have a PostgreSQL server, running 7.4.2, that will store a really
> large amount of data (200GB) being migrated from an Oracle database. I
> have a machine with two 120GB Ultra ATA IDE disks,

I'd normally advise against ATA drives in a production system.  If you
must use them, make sure the write cache is turned off or you risk data
corruption should the machine lose power.  

>  and I'd like to know if PostgreSQL could split it over both disks
> (that gives me 240GB or storage). Does he do this automatically ?

Not automatically, no.  With 8.0's table space feature, you could put
half your database tables etc... on one drive and one half on another. 
This would require you to keep track of how much your putting in one or
other, and could get rather tedious.

If you don't mind shutting down the database and copying / linking the
individual table files you could do that, but again, that's gonna
require you to do a lot of housekeeping on your own.

Lastly, you could use some kind of RAID or LVM setup to accomplish this.

For testing purposes running this on a RAID-0 with linux's MD or LVM
modules should work fine.  But RAID-0 has no redundancy and a single
drive failure means the whole set goes down.

With 4 drives you could set up a RAID 1+0 array (or 0+1) and place your
data there.  That setup could survive a single drive failure and keep on
going.

If your database will be writing a lot, it would be well worth your
while to investigate a SCSI RAID controller with battery backed cache
set to write back.

> Or I'll have to split it manually, creating symbolic links on my file
> system (ext3)?

That would be a lot of work.

> Does anyone ever stored a database (see, it's ONE database only, not a
> cluster) on multiple disks ?

Standard answer is use RAID arrays.

> What about PgSQL 8? It'll include this feature?

Not really.  While it will support table spaces, the job of combining
multiple drives into one large logical drive is the domain of your
operating system / underlying hardware.

I recommend the LSI MegaRAID series controllers, and a few other folks
on the list have had good luck with the Escalade IDE RAID controllers,
which aren't the toys most IDE RAID controllers are, they support
multiple RAID levels as well as battery backed cache.





^ permalink  raw  reply  [nested|flat] 8+ messages in thread


end of thread, other threads:[~2004-10-02 00:40 UTC | newest]

Thread overview: 8+ messages (download: mbox mbox.gz follow: Atom feed)
-- links below jump to the message on this page --
2004-10-01 21:01 Does PostgreSQL Stores its database in multiple disks? Igor Maciel Macaubas <igor@providerst.com.br>
2004-10-01 21:09 ` Björn Lundin <bnl@tiscali.se>
2004-10-01 21:17 ` Heather Johnson <hjohnson@nypost.com>
2004-10-01 21:28   ` Igor Maciel Macaubas <igor@providerst.com.br>
2004-10-01 22:10     ` Christopher Browne <cbbrowne@acm.org>
2004-10-01 23:56 ` Christian Fowler <spider@steelsun.com>
2004-10-02 00:20 ` Stephen Frost <sfrost@snowman.net>
2004-10-02 00:40 ` Scott Marlowe <smarlowe@qwest.net>

This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox