pg.ddx.io  pgsql-admin@postgresql.org mailing list archive  
help / color / mirror / Atom feed
From: Achilleas Mantzios <achill@matrix.gatewaynet.com>
To: pgsql-admin@lists.postgresql.org
Subject: Re: backup postgresql with snapshot AWS
Date: Tue, 23 Jan 2018 13:08:19 +0200
Message-ID: <3d79b954-55d1-a042-a819-5024ed9a2b9e@matrix.gatewaynet.com> (raw)
In-Reply-To: <725266372.1794661.1516705371389@mail.virgilio.it>
References: <166191299.1443519.1516368751643@mail.virgilio.it>
	<58e57feb-1a0a-bb44-55a6-5c94d294de9e@pgmasters.net>
	<2ce36d42-c90a-ed10-173d-7b8445c1cec9@denninger.net>
	<A6F69AB0-A8A3-4102-B11A-24868D7FD031@icloud.com>
	<ae8b9394-aabe-2dfa-70e1-b349100f90ee@matrix.gatewaynet.com>
	<863cffbe-0c4b-bcda-189d-3026bc949c95@denninger.net>
	<5F7F898C-23FD-4543-8623-BF9FFDE648B7@icloud.com>
	<725266372.1794661.1516705371389@mail.virgilio.it>

On 23/01/2018 13:02, flumbador@virgilio.it wrote:
> Hi
> I confirm that we have only one EBS volume, but Postgresql spans multiple filesystem on that EBS volume.
> Filesystems are:
>
> /pgsql/pdbabe/data      => PGDATA
> /pgsql/pdbabe/tsdata    => Tablespace Data
> /pgsql/pdbabe/tsindex   => Tablespace Index
> /pgsql/pdbabe/tstemp    => Tablespace temporary
> /pgsql/pdbabe/xlog      => pg_xlog

filesystem != directory. Do a
% df /pgsql/pdbabe/* | sort -u
to show you all filesystems involved. Might be only one.

>
> But all on the same EBS Volume.
> Does snapshot work fine in this scenario?
>
> Thanks & Regards
> Gabriele
>
>> Il 19 gennaio 2018 alle 20.39 Rui DeSousa <rui.desousa@icloud.com> ha scritto:
>>
>>
>>
>>> IMHO the more you intertwine things you cannot be certain of because they operate outside of your particular VM's space with a process that relies on them the more you are risking finding out that your assumptions are wrong the hard way.  You *shouldn't* get bit by this in a well-designed cloud or cluster system but that's not an acceptable word to describe the expected results when it's important.
>> One needs to understand their technology stack. You need to know where your data is after a sync() call… is it cached in the controller, some other application layer, or safely on disk? You also need to understand the relationship between luns, volume managers, and filesystems and where your atomic operation are in your setup.
>>
>> i.e. If the filesystem spans multiple EBS volumes then you can’t use EBS snapshots otherwise you end up with a corrupted filesystem/database; however, if you use one filesystem per EBS volume then EBS snapshots work fine.  Amazon’s own RDS service uses EBS snapshots for backups.


-- 
Achilleas Mantzios
IT DEV Lead
IT DEPT
Dynacom Tankers Mgmt





view thread (13+ messages)  latest in thread

Message-ID: <3d79b954-55d1-a042-a819-5024ed9a2b9e@matrix.gatewaynet.com>
Permalink:  ../3d79b954-55d1-a042-a819-5024ed9a2b9e@matrix.gatewaynet.com/
Also on:    postgresql.org/message-id/3d79b954-55d1-a042-a819-5024ed9a2b9e@matrix.gatewaynet.com

 · 

reply

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Reply to all the recipients using the --to and --cc options:
  reply via email

  To: pgsql-admin@postgresql.org
  Cc: achill@matrix.gatewaynet.com, pgsql-admin@lists.postgresql.org
  Subject: Re: backup postgresql with snapshot AWS
  In-Reply-To: <3d79b954-55d1-a042-a819-5024ed9a2b9e@matrix.gatewaynet.com>

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox