pg.ddx.io pgsql-admin@postgresql.org mailing list archive
help / color / mirror / Atom feedpostgresql and glusterFS
12+ messages / 7 participants
[nested] [flat]
* postgresql and glusterFS
@ 2018-09-12 08:55 Alfredo De Luca <alfredo.deluca@gmail.com>
2018-09-12 09:11 ` Re: postgresql and glusterFS Prince Pathria <prince.pathria@goevive.com>
2018-09-12 09:48 ` Re: postgresql and glusterFS Flavio Henrique Araque Gurgel <fhagur@gmail.com>
0 siblings, 2 replies; 12+ messages in thread
From: Alfredo De Luca @ 2018-09-12 08:55 UTC (permalink / raw)
To: pgsql-admin@lists.postgresql.org
Hi all. I wonder if I can install/configure postgresql with a distributed
file system ...specifically glusterFS? is it supported? Does it work
properly.
the ENV is on Centos 7
Any idea?
Cheers
--
*Alfredo*
^ permalink raw reply [nested|flat] 12+ messages in thread
* Re: postgresql and glusterFS
2018-09-12 08:55 postgresql and glusterFS Alfredo De Luca <alfredo.deluca@gmail.com>
@ 2018-09-12 09:11 ` Prince Pathria <prince.pathria@goevive.com>
2018-09-12 09:15 ` Re: postgresql and glusterFS Alfredo De Luca <alfredo.deluca@gmail.com>
2018-09-12 09:37 ` 答复: postgresql and glusterFS For your eyes only... <xzyshnok@msn.com>
2018-09-13 10:05 ` Re: postgresql and glusterFS Mark Kirkwood <mark.kirkwood@catalyst.net.nz>
1 sibling, 3 replies; 12+ messages in thread
From: Prince Pathria @ 2018-09-12 09:11 UTC (permalink / raw)
To: alfredo.deluca@gmail.com; +Cc: pgsql-admin@lists.postgresql.org
Hey Alfredo,
You can set up ceph as back end/data storage for postgres. Moreover you'll
get a better community support as well.
Happy to help :)
Prince Pathria Systems Architect Intern Evive +91 9478670472 goevive.com
On Wed, Sep 12, 2018 at 2:26 PM Alfredo De Luca <alfredo.deluca@gmail.com>
wrote:
> Hi all. I wonder if I can install/configure postgresql with a distributed
> file system ...specifically glusterFS? is it supported? Does it work
> properly.
> the ENV is on Centos 7
>
> Any idea?
>
>
> Cheers
>
>
> --
> *Alfredo*
>
>
^ permalink raw reply [nested|flat] 12+ messages in thread
* Re: postgresql and glusterFS
2018-09-12 08:55 postgresql and glusterFS Alfredo De Luca <alfredo.deluca@gmail.com>
2018-09-12 09:11 ` Re: postgresql and glusterFS Prince Pathria <prince.pathria@goevive.com>
@ 2018-09-12 09:15 ` Alfredo De Luca <alfredo.deluca@gmail.com>
2 siblings, 0 replies; 12+ messages in thread
From: Alfredo De Luca @ 2018-09-12 09:15 UTC (permalink / raw)
To: prince.pathria@goevive.com; +Cc: pgsql-admin@lists.postgresql.org
Thanks Prince. Appreciated.
So glusterFS is not good/suppported you think?
Cheers
On Wed, Sep 12, 2018 at 11:12 AM Prince Pathria <prince.pathria@goevive.com>
wrote:
> Hey Alfredo,
>
> You can set up ceph as back end/data storage for postgres. Moreover you'll
> get a better community support as well.
>
> Happy to help :)
> Prince Pathria Systems Architect Intern Evive +91 9478670472 goevive.com
>
>
> On Wed, Sep 12, 2018 at 2:26 PM Alfredo De Luca <alfredo.deluca@gmail.com>
> wrote:
>
>> Hi all. I wonder if I can install/configure postgresql with a distributed
>> file system ...specifically glusterFS? is it supported? Does it work
>> properly.
>> the ENV is on Centos 7
>>
>> Any idea?
>>
>>
>> Cheers
>>
>>
>> --
>> *Alfredo*
>>
>>
--
*Alfredo*
^ permalink raw reply [nested|flat] 12+ messages in thread
* 答复: postgresql and glusterFS
2018-09-12 08:55 postgresql and glusterFS Alfredo De Luca <alfredo.deluca@gmail.com>
2018-09-12 09:11 ` Re: postgresql and glusterFS Prince Pathria <prince.pathria@goevive.com>
@ 2018-09-12 09:37 ` For your eyes only... <xzyshnok@msn.com>
2 siblings, 0 replies; 12+ messages in thread
From: For your eyes only... @ 2018-09-12 09:37 UTC (permalink / raw)
To: Prince Pathria <prince.pathria@goevive.com>; alfredo.deluca@gmail.com <alfredo.deluca@gmail.com>; +Cc: pgsql-admin@lists.postgresql.org <pgsql-admin@lists.postgresql.org>
Dear team,
Would please remove me from the group? thx
Beat Regard,
Zhenyu Xu
发件人: Prince Pathria <prince.pathria@goevive.com>
发送时间: Wednesday, September 12, 2018 17:12
收件人: alfredo.deluca@gmail.com
抄送: pgsql-admin@lists.postgresql.org
主题: Re: postgresql and glusterFS
Hey Alfredo,
You can set up ceph as back end/data storage for postgres. Moreover you'll get a better community support as well.
Happy to help :)
Prince Pathria Systems Architect Intern Evive +91 9478670472 goevive.com<http://goevive.com;
On Wed, Sep 12, 2018 at 2:26 PM Alfredo De Luca <alfredo.deluca@gmail.com<mailto:alfredo.deluca@gmail.com>> wrote:
Hi all. I wonder if I can install/configure postgresql with a distributed file system ...specifically glusterFS? is it supported? Does it work properly.
the ENV is on Centos 7
Any idea?
Cheers
--
Alfredo
^ permalink raw reply [nested|flat] 12+ messages in thread
* Re: postgresql and glusterFS
2018-09-12 08:55 postgresql and glusterFS Alfredo De Luca <alfredo.deluca@gmail.com>
2018-09-12 09:11 ` Re: postgresql and glusterFS Prince Pathria <prince.pathria@goevive.com>
@ 2018-09-13 10:05 ` Mark Kirkwood <mark.kirkwood@catalyst.net.nz>
2018-09-13 10:37 ` Re: postgresql and glusterFS Alfredo De Luca <alfredo.deluca@gmail.com>
2 siblings, 1 reply; 12+ messages in thread
From: Mark Kirkwood @ 2018-09-13 10:05 UTC (permalink / raw)
To: Prince Pathria <prince.pathria@goevive.com>; alfredo.deluca@gmail.com; +Cc: pgsql-admin@lists.postgresql.org
On 12/09/18 21:11, Prince Pathria wrote:
> Hey Alfredo,
>
> You can set up ceph as back end/data storage for postgres. Moreover
> you'll get a better community support as well.
>
I'd add a +1 for Ceph as opposed to Gluster. Great community support and
a better designed product.
Where I work, we run an Openstack Cloud with Ceph as the backing for the
block storage provider (Cinder). A number of customers use Postgres and
Mysql on this setup.
regards
Mark
^ permalink raw reply [nested|flat] 12+ messages in thread
* Re: postgresql and glusterFS
2018-09-12 08:55 postgresql and glusterFS Alfredo De Luca <alfredo.deluca@gmail.com>
2018-09-12 09:11 ` Re: postgresql and glusterFS Prince Pathria <prince.pathria@goevive.com>
2018-09-13 10:05 ` Re: postgresql and glusterFS Mark Kirkwood <mark.kirkwood@catalyst.net.nz>
@ 2018-09-13 10:37 ` Alfredo De Luca <alfredo.deluca@gmail.com>
2018-09-13 13:07 ` Re: postgresql and glusterFS Peter Tormey <ptormey@sofi.org>
0 siblings, 1 reply; 12+ messages in thread
From: Alfredo De Luca @ 2018-09-13 10:37 UTC (permalink / raw)
To: mark.kirkwood@catalyst.net.nz; +Cc: prince.pathria@goevive.com; pgsql-admin@lists.postgresql.org
thanks everybody. I don't think we can use ceph (which I would prefere
anyway) as we have already glusterFS for other stuff.
thanks heaps
On Thu, Sep 13, 2018 at 12:05 PM Mark Kirkwood <
mark.kirkwood@catalyst.net.nz> wrote:
> On 12/09/18 21:11, Prince Pathria wrote:
>
> > Hey Alfredo,
> >
> > You can set up ceph as back end/data storage for postgres. Moreover
> > you'll get a better community support as well.
> >
>
> I'd add a +1 for Ceph as opposed to Gluster. Great community support and
> a better designed product.
>
> Where I work, we run an Openstack Cloud with Ceph as the backing for the
> block storage provider (Cinder). A number of customers use Postgres and
> Mysql on this setup.
>
> regards
> Mark
>
--
*Alfredo*
^ permalink raw reply [nested|flat] 12+ messages in thread
* Re: postgresql and glusterFS
2018-09-12 08:55 postgresql and glusterFS Alfredo De Luca <alfredo.deluca@gmail.com>
2018-09-12 09:11 ` Re: postgresql and glusterFS Prince Pathria <prince.pathria@goevive.com>
2018-09-13 10:05 ` Re: postgresql and glusterFS Mark Kirkwood <mark.kirkwood@catalyst.net.nz>
2018-09-13 10:37 ` Re: postgresql and glusterFS Alfredo De Luca <alfredo.deluca@gmail.com>
@ 2018-09-13 13:07 ` Peter Tormey <ptormey@sofi.org>
0 siblings, 0 replies; 12+ messages in thread
From: Peter Tormey @ 2018-09-13 13:07 UTC (permalink / raw)
To: Alfredo De Luca <alfredo.deluca@gmail.com>; +Cc: mark.kirkwood@catalyst.net.nz; pgsql-admin@lists.postgresql.org; prince.pathria@goevive.com
Using k8s you'll get the best performance and reliability using a pvc
(persistent volume claim) with something like an EBS volume. NFS has
historically performed horrible for us.
On Thu, Sep 13, 2018, 4:38 AM Alfredo De Luca <alfredo.deluca@gmail.com>
wrote:
> thanks everybody. I don't think we can use ceph (which I would prefere
> anyway) as we have already glusterFS for other stuff.
>
> thanks heaps
>
>
> On Thu, Sep 13, 2018 at 12:05 PM Mark Kirkwood <
> mark.kirkwood@catalyst.net.nz> wrote:
>
>> On 12/09/18 21:11, Prince Pathria wrote:
>>
>> > Hey Alfredo,
>> >
>> > You can set up ceph as back end/data storage for postgres. Moreover
>> > you'll get a better community support as well.
>> >
>>
>> I'd add a +1 for Ceph as opposed to Gluster. Great community support and
>> a better designed product.
>>
>> Where I work, we run an Openstack Cloud with Ceph as the backing for the
>> block storage provider (Cinder). A number of customers use Postgres and
>> Mysql on this setup.
>>
>> regards
>> Mark
>>
>
>
> --
> *Alfredo*
>
>
--
The information contained in this email message is PRIVATE and intended
only for the personal and confidential use of the recipient named above. If
the reader of this message is not the intended recipient or an agent
responsible for delivering it to the intended recipient, you are hereby
notified that you have received this message in error and that any review,
dissemination, distribution or copying of this message is strictly
prohibited. If you have received this communication in error, please
notify us immediately by email, and delete the original message.
^ permalink raw reply [nested|flat] 12+ messages in thread
* Re: postgresql and glusterFS
2018-09-12 08:55 postgresql and glusterFS Alfredo De Luca <alfredo.deluca@gmail.com>
@ 2018-09-12 09:48 ` Flavio Henrique Araque Gurgel <fhagur@gmail.com>
2018-09-13 08:06 ` Re: postgresql and glusterFS Alfredo De Luca <alfredo.deluca@gmail.com>
1 sibling, 1 reply; 12+ messages in thread
From: Flavio Henrique Araque Gurgel @ 2018-09-12 09:48 UTC (permalink / raw)
To: Alfredo De Luca <alfredo.deluca@gmail.com>; +Cc: pgsql-admin@lists.postgresql.org
Em qua, 12 de set de 2018 às 10:56, Alfredo De Luca <
alfredo.deluca@gmail.com> escreveu:
> Hi all. I wonder if I can install/configure postgresql with a distributed
> file system ...specifically glusterFS? is it supported? Does it work
> properly.
> the ENV is on Centos 7
>
> Any idea?
>
It works and it supports all POSIX semantics. And because of it, it's slow
as hell to writes because a FS lock acquired by PostgreSQL has to be
replicated to all nodes before being confirmed. If you have a read bound
database you should be fine tho.
I have tested it but never put in production, it's useless.
What exactly you want to do?
Flavio
^ permalink raw reply [nested|flat] 12+ messages in thread
* Re: postgresql and glusterFS
2018-09-12 08:55 postgresql and glusterFS Alfredo De Luca <alfredo.deluca@gmail.com>
2018-09-12 09:48 ` Re: postgresql and glusterFS Flavio Henrique Araque Gurgel <fhagur@gmail.com>
@ 2018-09-13 08:06 ` Alfredo De Luca <alfredo.deluca@gmail.com>
2018-09-13 08:21 ` Re: postgresql and glusterFS Flavio Henrique Araque Gurgel <fhagur@gmail.com>
0 siblings, 1 reply; 12+ messages in thread
From: Alfredo De Luca @ 2018-09-13 08:06 UTC (permalink / raw)
To: fhagur@gmail.com; +Cc: pgsql-admin@lists.postgresql.org
thanks heaps.
The idea is actually to use K8s so install postgres with glusterfs as
storage manager so in case a POD crashes can start again on another node
with the same file systems
Cheers
On Wed, Sep 12, 2018 at 11:48 AM Flavio Henrique Araque Gurgel <
fhagur@gmail.com> wrote:
>
>
> Em qua, 12 de set de 2018 às 10:56, Alfredo De Luca <
> alfredo.deluca@gmail.com> escreveu:
>
>> Hi all. I wonder if I can install/configure postgresql with a distributed
>> file system ...specifically glusterFS? is it supported? Does it work
>> properly.
>> the ENV is on Centos 7
>>
>> Any idea?
>>
>
> It works and it supports all POSIX semantics. And because of it, it's slow
> as hell to writes because a FS lock acquired by PostgreSQL has to be
> replicated to all nodes before being confirmed. If you have a read bound
> database you should be fine tho.
>
> I have tested it but never put in production, it's useless.
> What exactly you want to do?
>
> Flavio
>
--
*Alfredo*
^ permalink raw reply [nested|flat] 12+ messages in thread
* Re: postgresql and glusterFS
2018-09-12 08:55 postgresql and glusterFS Alfredo De Luca <alfredo.deluca@gmail.com>
2018-09-12 09:48 ` Re: postgresql and glusterFS Flavio Henrique Araque Gurgel <fhagur@gmail.com>
2018-09-13 08:06 ` Re: postgresql and glusterFS Alfredo De Luca <alfredo.deluca@gmail.com>
@ 2018-09-13 08:21 ` Flavio Henrique Araque Gurgel <fhagur@gmail.com>
2018-09-13 09:39 ` Re: postgresql and glusterFS Christoph Berg <myon@debian.org>
0 siblings, 1 reply; 12+ messages in thread
From: Flavio Henrique Araque Gurgel @ 2018-09-13 08:21 UTC (permalink / raw)
To: Alfredo De Luca <alfredo.deluca@gmail.com>; +Cc: pgsql-admin@lists.postgresql.org
Em qui, 13 de set de 2018 às 10:06, Alfredo De Luca <
alfredo.deluca@gmail.com> escreveu:
> thanks heaps.
> The idea is actually to use K8s so install postgres with glusterfs as
> storage manager so in case a POD crashes can start again on another node
> with the same file systems
>
So it was a case of problem A question B.
If you're really looking that way I would never consider a networked
filesystem.
k8s has mechanisms to restart a pod on the same node if you configure your
pod correctly. Also, you should declare a data container with a well
defined hardware dedicated volume and use a known stable filesystem like
xfs or ext4 on it.
You should think of using PostgreSQL native replication to a standby pod on
another kubernetes node.
If you really think you don't want to replicate your data (not recommended
anyway) you can use a hardware storage system connected to two (or more)
servers and use CLVM to switch a volume between servers in a controlled
way. I don't know how to automate that with kubernetes maybe someone has
more answers to you.
I don't see the point of using kubernetes for such a statefull beast like a
database, kubernetes basics assume that a pod may fail at any time and you
can have other instances running in parallel without worrying about their
current state, which is *not* what a database system can do transparently.
You may consider using that for development or testing purposes but I don't
see it in production by current technology. Some people run production
databases on containers (replicating things as I said), I don't know about
k8s.
Flavio Gurgel
^ permalink raw reply [nested|flat] 12+ messages in thread
* Re: postgresql and glusterFS
2018-09-12 08:55 postgresql and glusterFS Alfredo De Luca <alfredo.deluca@gmail.com>
2018-09-12 09:48 ` Re: postgresql and glusterFS Flavio Henrique Araque Gurgel <fhagur@gmail.com>
2018-09-13 08:06 ` Re: postgresql and glusterFS Alfredo De Luca <alfredo.deluca@gmail.com>
2018-09-13 08:21 ` Re: postgresql and glusterFS Flavio Henrique Araque Gurgel <fhagur@gmail.com>
@ 2018-09-13 09:39 ` Christoph Berg <myon@debian.org>
2018-09-13 10:03 ` Re: postgresql and glusterFS Flavio Henrique Araque Gurgel <fhagur@gmail.com>
0 siblings, 1 reply; 12+ messages in thread
From: Christoph Berg @ 2018-09-13 09:39 UTC (permalink / raw)
To: Flavio Henrique Araque Gurgel <fhagur@gmail.com>; +Cc: Alfredo De Luca <alfredo.deluca@gmail.com>; pgsql-admin@lists.postgresql.org
Re: Flavio Henrique Araque Gurgel 2018-09-13 <CAGHTAeMkTMRe+nMAxW_2sMPPraMoBMTnbvZVa=SmXX4Ci1S+fA@mail.gmail.com>
> You should think of using PostgreSQL native replication to a standby pod on
> another kubernetes node.
patroni supports kubernetes, have a look at that.
Christoph
^ permalink raw reply [nested|flat] 12+ messages in thread
* Re: postgresql and glusterFS
2018-09-12 08:55 postgresql and glusterFS Alfredo De Luca <alfredo.deluca@gmail.com>
2018-09-12 09:48 ` Re: postgresql and glusterFS Flavio Henrique Araque Gurgel <fhagur@gmail.com>
2018-09-13 08:06 ` Re: postgresql and glusterFS Alfredo De Luca <alfredo.deluca@gmail.com>
2018-09-13 08:21 ` Re: postgresql and glusterFS Flavio Henrique Araque Gurgel <fhagur@gmail.com>
2018-09-13 09:39 ` Re: postgresql and glusterFS Christoph Berg <myon@debian.org>
@ 2018-09-13 10:03 ` Flavio Henrique Araque Gurgel <fhagur@gmail.com>
0 siblings, 0 replies; 12+ messages in thread
From: Flavio Henrique Araque Gurgel @ 2018-09-13 10:03 UTC (permalink / raw)
To: Christoph Berg <myon@debian.org>; +Cc: Alfredo De Luca <alfredo.deluca@gmail.com>; pgsql-admin@lists.postgresql.org
Em qui, 13 de set de 2018 às 11:39, Christoph Berg <myon@debian.org>
escreveu:
> Re: Flavio Henrique Araque Gurgel 2018-09-13
> <CAGHTAeMkTMRe+nMAxW_2sMPPraMoBMTnbvZVa=SmXX4Ci1S+fA@mail.gmail.com>
> > You should think of using PostgreSQL native replication to a standby pod
> on
> > another kubernetes node.
>
> patroni supports kubernetes, have a look at that.
>
> Thanks for your contributions to the community Christoph, patroni is a
fine piece of software.
To help the OP to take his decisions, a recent post from Josh about the
state of databases on containers is here:
http://www.databasesoup.com/2018/07/should-i-run-postgres-on-kubernetes_12.html
Best,
Flavio
^ permalink raw reply [nested|flat] 12+ messages in thread
end of thread, other threads:[~2018-09-13 13:07 UTC | newest]
Thread overview: 12+ messages (download: mbox mbox.gz follow: Atom feed)
-- links below jump to the message on this page --
2018-09-12 08:55 postgresql and glusterFS Alfredo De Luca <alfredo.deluca@gmail.com>
2018-09-12 09:11 ` Prince Pathria <prince.pathria@goevive.com>
2018-09-12 09:15 ` Alfredo De Luca <alfredo.deluca@gmail.com>
2018-09-12 09:37 ` 答复: postgresql and glusterFS For your eyes only... <xzyshnok@msn.com>
2018-09-13 10:05 ` Mark Kirkwood <mark.kirkwood@catalyst.net.nz>
2018-09-13 10:37 ` Alfredo De Luca <alfredo.deluca@gmail.com>
2018-09-13 13:07 ` Peter Tormey <ptormey@sofi.org>
2018-09-12 09:48 ` Flavio Henrique Araque Gurgel <fhagur@gmail.com>
2018-09-13 08:06 ` Alfredo De Luca <alfredo.deluca@gmail.com>
2018-09-13 08:21 ` Flavio Henrique Araque Gurgel <fhagur@gmail.com>
2018-09-13 09:39 ` Christoph Berg <myon@debian.org>
2018-09-13 10:03 ` Flavio Henrique Araque Gurgel <fhagur@gmail.com>
This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox