pg.ddx.io pgsql-admin@postgresql.org mailing list archive
help / color / mirror / Atom feedNeed inputs on postgresql HA with consul cluster
16+ messages / 5 participants
[nested] [flat]
* Need inputs on postgresql HA with consul cluster
@ 2023-12-19 14:12 Rambabu V <ram.wissen@gmail.com>
2023-12-19 14:22 ` Re: Need inputs on postgresql HA with consul cluster Scott Ribe <scott_ribe@elevated-dev.com>
0 siblings, 1 reply; 16+ messages in thread
From: Rambabu V @ 2023-12-19 14:12 UTC (permalink / raw)
To: pgsql-admin@lists.postgresql.org
Hi Team,
We have implemented postgresql HA with Patroni + Consul cluster on Docker
based PostgreSQL Setup.
We are seeing the issue below.
our consul cluster built with 3 nodes, if consul cluster completely down,
Patroni triggering failover.
Is there any option to prevent this failure even if the consul cluster is
down also?
and also any effective alternative for HA for docker based PostgreSQL setup?
^ permalink raw reply [nested|flat] 16+ messages in thread
* Re: Need inputs on postgresql HA with consul cluster
2023-12-19 14:12 Need inputs on postgresql HA with consul cluster Rambabu V <ram.wissen@gmail.com>
@ 2023-12-19 14:22 ` Scott Ribe <scott_ribe@elevated-dev.com>
2023-12-19 17:32 ` Re: Need inputs on postgresql HA with consul cluster Rambabu V <ram.wissen@gmail.com>
0 siblings, 1 reply; 16+ messages in thread
From: Scott Ribe @ 2023-12-19 14:22 UTC (permalink / raw)
To: Rambabu V <ram.wissen@gmail.com>; +Cc: pgsql-admin@lists.postgresql.org
> On Dec 19, 2023, at 7:12 AM, Rambabu V <ram.wissen@gmail.com> wrote:
>
> Hi Team,
>
> We have implemented postgresql HA with Patroni + Consul cluster on Docker based PostgreSQL Setup.
>
> We are seeing the issue below.
>
> our consul cluster built with 3 nodes, if consul cluster completely down, Patroni triggering failover.
> Is there any option to prevent this failure even if the consul cluster is down also?
>
> and also any effective alternative for HA for docker based PostgreSQL setup?
How do you expect to have working HA without working networking?
^ permalink raw reply [nested|flat] 16+ messages in thread
* Re: Need inputs on postgresql HA with consul cluster
2023-12-19 14:12 Need inputs on postgresql HA with consul cluster Rambabu V <ram.wissen@gmail.com>
2023-12-19 14:22 ` Re: Need inputs on postgresql HA with consul cluster Scott Ribe <scott_ribe@elevated-dev.com>
@ 2023-12-19 17:32 ` Rambabu V <ram.wissen@gmail.com>
2023-12-19 17:40 ` Re: Need inputs on postgresql HA with consul cluster Ron Johnson <ronljohnsonjr@gmail.com>
2023-12-19 19:05 ` Re: Need inputs on postgresql HA with consul cluster Karthik Yellapragada <karthik.yellapragada@gmail.com>
0 siblings, 2 replies; 16+ messages in thread
From: Rambabu V @ 2023-12-19 17:32 UTC (permalink / raw)
To: Scott Ribe <scott_ribe@elevated-dev.com>; +Cc: pgsql-admin@lists.postgresql.org
Thanks, any alternative solution for my requirement .
In above case if consul down , db master node going down, replica nodes
remains recovery mode.its complete downtime.
On Tue, Dec 19, 2023, 22:23 Scott Ribe <scott_ribe@elevated-dev.com> wrote:
> > On Dec 19, 2023, at 7:12 AM, Rambabu V <ram.wissen@gmail.com> wrote:
> >
> > Hi Team,
> >
> > We have implemented postgresql HA with Patroni + Consul cluster on
> Docker based PostgreSQL Setup.
> >
> > We are seeing the issue below.
> >
> > our consul cluster built with 3 nodes, if consul cluster completely
> down, Patroni triggering failover.
> > Is there any option to prevent this failure even if the consul cluster
> is down also?
> >
> > and also any effective alternative for HA for docker based PostgreSQL
> setup?
>
> How do you expect to have working HA without working networking?
>
>
^ permalink raw reply [nested|flat] 16+ messages in thread
* Re: Need inputs on postgresql HA with consul cluster
2023-12-19 14:12 Need inputs on postgresql HA with consul cluster Rambabu V <ram.wissen@gmail.com>
2023-12-19 14:22 ` Re: Need inputs on postgresql HA with consul cluster Scott Ribe <scott_ribe@elevated-dev.com>
2023-12-19 17:32 ` Re: Need inputs on postgresql HA with consul cluster Rambabu V <ram.wissen@gmail.com>
@ 2023-12-19 17:40 ` Ron Johnson <ronljohnsonjr@gmail.com>
1 sibling, 0 replies; 16+ messages in thread
From: Ron Johnson @ 2023-12-19 17:40 UTC (permalink / raw)
To: Rambabu V <ram.wissen@gmail.com>; +Cc: Scott Ribe <scott_ribe@elevated-dev.com>; pgsql-admin@lists.postgresql.org
Have you asked the consul developers?
On Tue, Dec 19, 2023 at 12:33 PM Rambabu V <ram.wissen@gmail.com> wrote:
> Thanks, any alternative solution for my requirement .
>
> In above case if consul down , db master node going down, replica nodes
> remains recovery mode.its complete downtime.
>
> On Tue, Dec 19, 2023, 22:23 Scott Ribe <scott_ribe@elevated-dev.com>
> wrote:
>
>> > On Dec 19, 2023, at 7:12 AM, Rambabu V <ram.wissen@gmail.com> wrote:
>> >
>> > Hi Team,
>> >
>> > We have implemented postgresql HA with Patroni + Consul cluster on
>> Docker based PostgreSQL Setup.
>> >
>> > We are seeing the issue below.
>> >
>> > our consul cluster built with 3 nodes, if consul cluster completely
>> down, Patroni triggering failover.
>> > Is there any option to prevent this failure even if the consul cluster
>> is down also?
>> >
>> > and also any effective alternative for HA for docker based PostgreSQL
>> setup?
>>
>> How do you expect to have working HA without working networking?
>>
>>
^ permalink raw reply [nested|flat] 16+ messages in thread
* Re: Need inputs on postgresql HA with consul cluster
2023-12-19 14:12 Need inputs on postgresql HA with consul cluster Rambabu V <ram.wissen@gmail.com>
2023-12-19 14:22 ` Re: Need inputs on postgresql HA with consul cluster Scott Ribe <scott_ribe@elevated-dev.com>
2023-12-19 17:32 ` Re: Need inputs on postgresql HA with consul cluster Rambabu V <ram.wissen@gmail.com>
@ 2023-12-19 19:05 ` Karthik Yellapragada <karthik.yellapragada@gmail.com>
2023-12-20 01:52 ` Re: Need inputs on postgresql HA with consul cluster Rambabu V <ram.wissen@gmail.com>
1 sibling, 1 reply; 16+ messages in thread
From: Karthik Yellapragada @ 2023-12-19 19:05 UTC (permalink / raw)
To: Rambabu V <ram.wissen@gmail.com>; +Cc: Scott Ribe <scott_ribe@elevated-dev.com>; pgsql-admin@lists.postgresql.org
May be you can pg auto failover..
On Tue, Dec 19, 2023 at 9:33 AM Rambabu V <ram.wissen@gmail.com> wrote:
> Thanks, any alternative solution for my requirement .
>
> In above case if consul down , db master node going down, replica nodes
> remains recovery mode.its complete downtime.
>
> On Tue, Dec 19, 2023, 22:23 Scott Ribe <scott_ribe@elevated-dev.com>
> wrote:
>
>> > On Dec 19, 2023, at 7:12 AM, Rambabu V <ram.wissen@gmail.com> wrote:
>> >
>> > Hi Team,
>> >
>> > We have implemented postgresql HA with Patroni + Consul cluster on
>> Docker based PostgreSQL Setup.
>> >
>> > We are seeing the issue below.
>> >
>> > our consul cluster built with 3 nodes, if consul cluster completely
>> down, Patroni triggering failover.
>> > Is there any option to prevent this failure even if the consul cluster
>> is down also?
>> >
>> > and also any effective alternative for HA for docker based PostgreSQL
>> setup?
>>
>> How do you expect to have working HA without working networking?
>>
>> --
Thanks & Regards
Karthik Yellapragada
+1 860 830 5235
^ permalink raw reply [nested|flat] 16+ messages in thread
* Re: Need inputs on postgresql HA with consul cluster
2023-12-19 14:12 Need inputs on postgresql HA with consul cluster Rambabu V <ram.wissen@gmail.com>
2023-12-19 14:22 ` Re: Need inputs on postgresql HA with consul cluster Scott Ribe <scott_ribe@elevated-dev.com>
2023-12-19 17:32 ` Re: Need inputs on postgresql HA with consul cluster Rambabu V <ram.wissen@gmail.com>
2023-12-19 19:05 ` Re: Need inputs on postgresql HA with consul cluster Karthik Yellapragada <karthik.yellapragada@gmail.com>
@ 2023-12-20 01:52 ` Rambabu V <ram.wissen@gmail.com>
2023-12-20 17:42 ` Re: Need inputs on postgresql HA with consul cluster kaido vaikla <kaido.vaikla@gmail.com>
0 siblings, 1 reply; 16+ messages in thread
From: Rambabu V @ 2023-12-20 01:52 UTC (permalink / raw)
To: Karthik Yellapragada <karthik.yellapragada@gmail.com>; +Cc: Scott Ribe <scott_ribe@elevated-dev.com>; pgsql-admin@lists.postgresql.org
Hi Karthik,
This is docker based Postgtresql, behavior is different than our normal one
for failover and promotion.
On Wed, Dec 20, 2023, 03:05 Karthik Yellapragada <
karthik.yellapragada@gmail.com> wrote:
> May be you can pg auto failover..
>
> On Tue, Dec 19, 2023 at 9:33 AM Rambabu V <ram.wissen@gmail.com> wrote:
>
>> Thanks, any alternative solution for my requirement .
>>
>> In above case if consul down , db master node going down, replica nodes
>> remains recovery mode.its complete downtime.
>>
>> On Tue, Dec 19, 2023, 22:23 Scott Ribe <scott_ribe@elevated-dev.com>
>> wrote:
>>
>>> > On Dec 19, 2023, at 7:12 AM, Rambabu V <ram.wissen@gmail.com> wrote:
>>> >
>>> > Hi Team,
>>> >
>>> > We have implemented postgresql HA with Patroni + Consul cluster on
>>> Docker based PostgreSQL Setup.
>>> >
>>> > We are seeing the issue below.
>>> >
>>> > our consul cluster built with 3 nodes, if consul cluster completely
>>> down, Patroni triggering failover.
>>> > Is there any option to prevent this failure even if the consul cluster
>>> is down also?
>>> >
>>> > and also any effective alternative for HA for docker based PostgreSQL
>>> setup?
>>>
>>> How do you expect to have working HA without working networking?
>>>
>>> --
> Thanks & Regards
> Karthik Yellapragada
> +1 860 830 5235
>
^ permalink raw reply [nested|flat] 16+ messages in thread
* Re: Need inputs on postgresql HA with consul cluster
2023-12-19 14:12 Need inputs on postgresql HA with consul cluster Rambabu V <ram.wissen@gmail.com>
2023-12-19 14:22 ` Re: Need inputs on postgresql HA with consul cluster Scott Ribe <scott_ribe@elevated-dev.com>
2023-12-19 17:32 ` Re: Need inputs on postgresql HA with consul cluster Rambabu V <ram.wissen@gmail.com>
2023-12-19 19:05 ` Re: Need inputs on postgresql HA with consul cluster Karthik Yellapragada <karthik.yellapragada@gmail.com>
2023-12-20 01:52 ` Re: Need inputs on postgresql HA with consul cluster Rambabu V <ram.wissen@gmail.com>
@ 2023-12-20 17:42 ` kaido vaikla <kaido.vaikla@gmail.com>
2023-12-20 18:30 ` Re: Need inputs on postgresql HA with consul cluster kaido vaikla <kaido.vaikla@gmail.com>
0 siblings, 1 reply; 16+ messages in thread
From: kaido vaikla @ 2023-12-20 17:42 UTC (permalink / raw)
To: Rambabu V <ram.wissen@gmail.com>; +Cc: Karthik Yellapragada <karthik.yellapragada@gmail.com>; Scott Ribe <scott_ribe@elevated-dev.com>; pgsql-admin@lists.postgresql.org
Consul is DCS for patroni. If consul cluster is completely down, then
patroni is unaware of state of cluster.
And "In above case if consul down , db master node going down, replica
nodes remains recovery mode"
is expected. Actually this behave protects database from split brain
br
Kaido
On Wed, 20 Dec 2023 at 03:52, Rambabu V <ram.wissen@gmail.com> wrote:
> Hi Karthik,
>
> This is docker based Postgtresql, behavior is different than our normal
> one for failover and promotion.
>
> On Wed, Dec 20, 2023, 03:05 Karthik Yellapragada <
> karthik.yellapragada@gmail.com> wrote:
>
>> May be you can pg auto failover..
>>
>> On Tue, Dec 19, 2023 at 9:33 AM Rambabu V <ram.wissen@gmail.com> wrote:
>>
>>> Thanks, any alternative solution for my requirement .
>>>
>>> In above case if consul down , db master node going down, replica nodes
>>> remains recovery mode.its complete downtime.
>>>
>>> On Tue, Dec 19, 2023, 22:23 Scott Ribe <scott_ribe@elevated-dev.com>
>>> wrote:
>>>
>>>> > On Dec 19, 2023, at 7:12 AM, Rambabu V <ram.wissen@gmail.com> wrote:
>>>> >
>>>> > Hi Team,
>>>> >
>>>> > We have implemented postgresql HA with Patroni + Consul cluster on
>>>> Docker based PostgreSQL Setup.
>>>> >
>>>> > We are seeing the issue below.
>>>> >
>>>> > our consul cluster built with 3 nodes, if consul cluster completely
>>>> down, Patroni triggering failover.
>>>> > Is there any option to prevent this failure even if the consul
>>>> cluster is down also?
>>>> >
>>>> > and also any effective alternative for HA for docker based PostgreSQL
>>>> setup?
>>>>
>>>> How do you expect to have working HA without working networking?
>>>>
>>>> --
>> Thanks & Regards
>> Karthik Yellapragada
>> +1 860 830 5235
>>
>
^ permalink raw reply [nested|flat] 16+ messages in thread
* Re: Need inputs on postgresql HA with consul cluster
2023-12-19 14:12 Need inputs on postgresql HA with consul cluster Rambabu V <ram.wissen@gmail.com>
2023-12-19 14:22 ` Re: Need inputs on postgresql HA with consul cluster Scott Ribe <scott_ribe@elevated-dev.com>
2023-12-19 17:32 ` Re: Need inputs on postgresql HA with consul cluster Rambabu V <ram.wissen@gmail.com>
2023-12-19 19:05 ` Re: Need inputs on postgresql HA with consul cluster Karthik Yellapragada <karthik.yellapragada@gmail.com>
2023-12-20 01:52 ` Re: Need inputs on postgresql HA with consul cluster Rambabu V <ram.wissen@gmail.com>
2023-12-20 17:42 ` Re: Need inputs on postgresql HA with consul cluster kaido vaikla <kaido.vaikla@gmail.com>
@ 2023-12-20 18:30 ` kaido vaikla <kaido.vaikla@gmail.com>
2023-12-21 01:49 ` Re: Need inputs on postgresql HA with consul cluster Rambabu V <ram.wissen@gmail.com>
0 siblings, 1 reply; 16+ messages in thread
From: kaido vaikla @ 2023-12-20 18:30 UTC (permalink / raw)
To: Rambabu V <ram.wissen@gmail.com>; +Cc: Karthik Yellapragada <karthik.yellapragada@gmail.com>; Scott Ribe <scott_ribe@elevated-dev.com>; pgsql-admin@lists.postgresql.org
@Rambabu
You can try this: DCS Failsafe Mode
https://patroni.readthedocs.io/en/master/dcs_failsafe_mode.html#id2
https://speakerdeck.com/cyberdemn/failsafe-patroni-3-dot-0
br
Kaido
On Wed, 20 Dec 2023 at 19:42, kaido vaikla <kaido.vaikla@gmail.com> wrote:
> Consul is DCS for patroni. If consul cluster is completely down, then
> patroni is unaware of state of cluster.
> And "In above case if consul down , db master node going down, replica
> nodes remains recovery mode"
> is expected. Actually this behave protects database from split brain
>
> br
> Kaido
>
>
> On Wed, 20 Dec 2023 at 03:52, Rambabu V <ram.wissen@gmail.com> wrote:
>
>> Hi Karthik,
>>
>> This is docker based Postgtresql, behavior is different than our normal
>> one for failover and promotion.
>>
>> On Wed, Dec 20, 2023, 03:05 Karthik Yellapragada <
>> karthik.yellapragada@gmail.com> wrote:
>>
>>> May be you can pg auto failover..
>>>
>>> On Tue, Dec 19, 2023 at 9:33 AM Rambabu V <ram.wissen@gmail.com> wrote:
>>>
>>>> Thanks, any alternative solution for my requirement .
>>>>
>>>> In above case if consul down , db master node going down, replica nodes
>>>> remains recovery mode.its complete downtime.
>>>>
>>>> On Tue, Dec 19, 2023, 22:23 Scott Ribe <scott_ribe@elevated-dev.com>
>>>> wrote:
>>>>
>>>>> > On Dec 19, 2023, at 7:12 AM, Rambabu V <ram.wissen@gmail.com> wrote:
>>>>> >
>>>>> > Hi Team,
>>>>> >
>>>>> > We have implemented postgresql HA with Patroni + Consul cluster on
>>>>> Docker based PostgreSQL Setup.
>>>>> >
>>>>> > We are seeing the issue below.
>>>>> >
>>>>> > our consul cluster built with 3 nodes, if consul cluster completely
>>>>> down, Patroni triggering failover.
>>>>> > Is there any option to prevent this failure even if the consul
>>>>> cluster is down also?
>>>>> >
>>>>> > and also any effective alternative for HA for docker based
>>>>> PostgreSQL setup?
>>>>>
>>>>> How do you expect to have working HA without working networking?
>>>>>
>>>>> --
>>> Thanks & Regards
>>> Karthik Yellapragada
>>> +1 860 830 5235
>>>
>>
^ permalink raw reply [nested|flat] 16+ messages in thread
* Re: Need inputs on postgresql HA with consul cluster
2023-12-19 14:12 Need inputs on postgresql HA with consul cluster Rambabu V <ram.wissen@gmail.com>
2023-12-19 14:22 ` Re: Need inputs on postgresql HA with consul cluster Scott Ribe <scott_ribe@elevated-dev.com>
2023-12-19 17:32 ` Re: Need inputs on postgresql HA with consul cluster Rambabu V <ram.wissen@gmail.com>
2023-12-19 19:05 ` Re: Need inputs on postgresql HA with consul cluster Karthik Yellapragada <karthik.yellapragada@gmail.com>
2023-12-20 01:52 ` Re: Need inputs on postgresql HA with consul cluster Rambabu V <ram.wissen@gmail.com>
2023-12-20 17:42 ` Re: Need inputs on postgresql HA with consul cluster kaido vaikla <kaido.vaikla@gmail.com>
2023-12-20 18:30 ` Re: Need inputs on postgresql HA with consul cluster kaido vaikla <kaido.vaikla@gmail.com>
@ 2023-12-21 01:49 ` Rambabu V <ram.wissen@gmail.com>
2023-12-23 06:11 ` Re: Need inputs on postgresql HA with consul cluster Rambabu V <ram.wissen@gmail.com>
0 siblings, 1 reply; 16+ messages in thread
From: Rambabu V @ 2023-12-21 01:49 UTC (permalink / raw)
To: kaido vaikla <kaido.vaikla@gmail.com>; +Cc: Karthik Yellapragada <karthik.yellapragada@gmail.com>; Scott Ribe <scott_ribe@elevated-dev.com>; pgsql-admin@lists.postgresql.org
thanks Kaido, applied to the above option. getting good result.
On Thu, Dec 21, 2023 at 2:30 AM kaido vaikla <kaido.vaikla@gmail.com> wrote:
> @Rambabu
> You can try this: DCS Failsafe Mode
> https://patroni.readthedocs.io/en/master/dcs_failsafe_mode.html#id2
> https://speakerdeck.com/cyberdemn/failsafe-patroni-3-dot-0
> br
> Kaido
>
>
> On Wed, 20 Dec 2023 at 19:42, kaido vaikla <kaido.vaikla@gmail.com> wrote:
>
>> Consul is DCS for patroni. If consul cluster is completely down, then
>> patroni is unaware of state of cluster.
>> And "In above case if consul down , db master node going down, replica
>> nodes remains recovery mode"
>> is expected. Actually this behave protects database from split brain
>>
>> br
>> Kaido
>>
>>
>> On Wed, 20 Dec 2023 at 03:52, Rambabu V <ram.wissen@gmail.com> wrote:
>>
>>> Hi Karthik,
>>>
>>> This is docker based Postgtresql, behavior is different than our normal
>>> one for failover and promotion.
>>>
>>> On Wed, Dec 20, 2023, 03:05 Karthik Yellapragada <
>>> karthik.yellapragada@gmail.com> wrote:
>>>
>>>> May be you can pg auto failover..
>>>>
>>>> On Tue, Dec 19, 2023 at 9:33 AM Rambabu V <ram.wissen@gmail.com> wrote:
>>>>
>>>>> Thanks, any alternative solution for my requirement .
>>>>>
>>>>> In above case if consul down , db master node going down, replica
>>>>> nodes remains recovery mode.its complete downtime.
>>>>>
>>>>> On Tue, Dec 19, 2023, 22:23 Scott Ribe <scott_ribe@elevated-dev.com>
>>>>> wrote:
>>>>>
>>>>>> > On Dec 19, 2023, at 7:12 AM, Rambabu V <ram.wissen@gmail.com>
>>>>>> wrote:
>>>>>> >
>>>>>> > Hi Team,
>>>>>> >
>>>>>> > We have implemented postgresql HA with Patroni + Consul cluster on
>>>>>> Docker based PostgreSQL Setup.
>>>>>> >
>>>>>> > We are seeing the issue below.
>>>>>> >
>>>>>> > our consul cluster built with 3 nodes, if consul cluster completely
>>>>>> down, Patroni triggering failover.
>>>>>> > Is there any option to prevent this failure even if the consul
>>>>>> cluster is down also?
>>>>>> >
>>>>>> > and also any effective alternative for HA for docker based
>>>>>> PostgreSQL setup?
>>>>>>
>>>>>> How do you expect to have working HA without working networking?
>>>>>>
>>>>>> --
>>>> Thanks & Regards
>>>> Karthik Yellapragada
>>>> +1 860 830 5235
>>>>
>>>
^ permalink raw reply [nested|flat] 16+ messages in thread
* Re: Need inputs on postgresql HA with consul cluster
2023-12-19 14:12 Need inputs on postgresql HA with consul cluster Rambabu V <ram.wissen@gmail.com>
2023-12-19 14:22 ` Re: Need inputs on postgresql HA with consul cluster Scott Ribe <scott_ribe@elevated-dev.com>
2023-12-19 17:32 ` Re: Need inputs on postgresql HA with consul cluster Rambabu V <ram.wissen@gmail.com>
2023-12-19 19:05 ` Re: Need inputs on postgresql HA with consul cluster Karthik Yellapragada <karthik.yellapragada@gmail.com>
2023-12-20 01:52 ` Re: Need inputs on postgresql HA with consul cluster Rambabu V <ram.wissen@gmail.com>
2023-12-20 17:42 ` Re: Need inputs on postgresql HA with consul cluster kaido vaikla <kaido.vaikla@gmail.com>
2023-12-20 18:30 ` Re: Need inputs on postgresql HA with consul cluster kaido vaikla <kaido.vaikla@gmail.com>
2023-12-21 01:49 ` Re: Need inputs on postgresql HA with consul cluster Rambabu V <ram.wissen@gmail.com>
@ 2023-12-23 06:11 ` Rambabu V <ram.wissen@gmail.com>
2023-12-23 06:11 ` Re: Need inputs on postgresql HA with consul cluster Rambabu V <ram.wissen@gmail.com>
2023-12-23 06:13 ` Re: Need inputs on postgresql HA with consul cluster Rambabu V <ram.wissen@gmail.com>
2023-12-23 13:29 ` Re: Need inputs on postgresql HA with consul cluster Scott Ribe <scott_ribe@elevated-dev.com>
0 siblings, 3 replies; 16+ messages in thread
From: Rambabu V @ 2023-12-23 06:11 UTC (permalink / raw)
To: kaido vaikla <kaido.vaikla@gmail.com>; +Cc: Karthik Yellapragada <karthik.yellapragada@gmail.com>; Scott Ribe <scott_ribe@elevated-dev.com>; pgsql-admin@lists.postgresql.org
Hi Kaido,
Using patroni 3+ version, even though enabled failsafe_mide, still if
consul cluster down, master db going down. Replicas remaining same.
On Thu, Dec 21, 2023, 09:49 Rambabu V <ram.wissen@gmail.com> wrote:
> thanks Kaido, applied to the above option. getting good result.
>
> On Thu, Dec 21, 2023 at 2:30 AM kaido vaikla <kaido.vaikla@gmail.com>
> wrote:
>
>> @Rambabu
>> You can try this: DCS Failsafe Mode
>> https://patroni.readthedocs.io/en/master/dcs_failsafe_mode.html#id2
>> https://speakerdeck.com/cyberdemn/failsafe-patroni-3-dot-0
>> br
>> Kaido
>>
>>
>> On Wed, 20 Dec 2023 at 19:42, kaido vaikla <kaido.vaikla@gmail.com>
>> wrote:
>>
>>> Consul is DCS for patroni. If consul cluster is completely down, then
>>> patroni is unaware of state of cluster.
>>> And "In above case if consul down , db master node going down, replica
>>> nodes remains recovery mode"
>>> is expected. Actually this behave protects database from split brain
>>>
>>> br
>>> Kaido
>>>
>>>
>>> On Wed, 20 Dec 2023 at 03:52, Rambabu V <ram.wissen@gmail.com> wrote:
>>>
>>>> Hi Karthik,
>>>>
>>>> This is docker based Postgtresql, behavior is different than our normal
>>>> one for failover and promotion.
>>>>
>>>> On Wed, Dec 20, 2023, 03:05 Karthik Yellapragada <
>>>> karthik.yellapragada@gmail.com> wrote:
>>>>
>>>>> May be you can pg auto failover..
>>>>>
>>>>> On Tue, Dec 19, 2023 at 9:33 AM Rambabu V <ram.wissen@gmail.com>
>>>>> wrote:
>>>>>
>>>>>> Thanks, any alternative solution for my requirement .
>>>>>>
>>>>>> In above case if consul down , db master node going down, replica
>>>>>> nodes remains recovery mode.its complete downtime.
>>>>>>
>>>>>> On Tue, Dec 19, 2023, 22:23 Scott Ribe <scott_ribe@elevated-dev.com>
>>>>>> wrote:
>>>>>>
>>>>>>> > On Dec 19, 2023, at 7:12 AM, Rambabu V <ram.wissen@gmail.com>
>>>>>>> wrote:
>>>>>>> >
>>>>>>> > Hi Team,
>>>>>>> >
>>>>>>> > We have implemented postgresql HA with Patroni + Consul cluster on
>>>>>>> Docker based PostgreSQL Setup.
>>>>>>> >
>>>>>>> > We are seeing the issue below.
>>>>>>> >
>>>>>>> > our consul cluster built with 3 nodes, if consul cluster
>>>>>>> completely down, Patroni triggering failover.
>>>>>>> > Is there any option to prevent this failure even if the consul
>>>>>>> cluster is down also?
>>>>>>> >
>>>>>>> > and also any effective alternative for HA for docker based
>>>>>>> PostgreSQL setup?
>>>>>>>
>>>>>>> How do you expect to have working HA without working networking?
>>>>>>>
>>>>>>> --
>>>>> Thanks & Regards
>>>>> Karthik Yellapragada
>>>>> +1 860 830 5235
>>>>>
>>>>
^ permalink raw reply [nested|flat] 16+ messages in thread
* Re: Need inputs on postgresql HA with consul cluster
2023-12-19 14:12 Need inputs on postgresql HA with consul cluster Rambabu V <ram.wissen@gmail.com>
2023-12-19 14:22 ` Re: Need inputs on postgresql HA with consul cluster Scott Ribe <scott_ribe@elevated-dev.com>
2023-12-19 17:32 ` Re: Need inputs on postgresql HA with consul cluster Rambabu V <ram.wissen@gmail.com>
2023-12-19 19:05 ` Re: Need inputs on postgresql HA with consul cluster Karthik Yellapragada <karthik.yellapragada@gmail.com>
2023-12-20 01:52 ` Re: Need inputs on postgresql HA with consul cluster Rambabu V <ram.wissen@gmail.com>
2023-12-20 17:42 ` Re: Need inputs on postgresql HA with consul cluster kaido vaikla <kaido.vaikla@gmail.com>
2023-12-20 18:30 ` Re: Need inputs on postgresql HA with consul cluster kaido vaikla <kaido.vaikla@gmail.com>
2023-12-21 01:49 ` Re: Need inputs on postgresql HA with consul cluster Rambabu V <ram.wissen@gmail.com>
2023-12-23 06:11 ` Re: Need inputs on postgresql HA with consul cluster Rambabu V <ram.wissen@gmail.com>
@ 2023-12-23 06:11 ` Rambabu V <ram.wissen@gmail.com>
2 siblings, 0 replies; 16+ messages in thread
From: Rambabu V @ 2023-12-23 06:11 UTC (permalink / raw)
To: kaido vaikla <kaido.vaikla@gmail.com>; +Cc: Karthik Yellapragada <karthik.yellapragada@gmail.com>; Scott Ribe <scott_ribe@elevated-dev.com>; pgsql-admin@lists.postgresql.org
On Sat, Dec 23, 2023, 14:11 Rambabu V <ram.wissen@gmail.com> wrote:
> Hi Kaido,
>
> Using patroni 3+ version, even though enabled failsafe_mide, still if
> consul cluster down, master db going down. Replicas remaining same.
>
> On Thu, Dec 21, 2023, 09:49 Rambabu V <ram.wissen@gmail.com> wrote:
>
>> thanks Kaido, applied to the above option. getting good result.
>>
>> On Thu, Dec 21, 2023 at 2:30 AM kaido vaikla <kaido.vaikla@gmail.com>
>> wrote:
>>
>>> @Rambabu
>>> You can try this: DCS Failsafe Mode
>>> https://patroni.readthedocs.io/en/master/dcs_failsafe_mode.html#id2
>>> https://speakerdeck.com/cyberdemn/failsafe-patroni-3-dot-0
>>> br
>>> Kaido
>>>
>>>
>>> On Wed, 20 Dec 2023 at 19:42, kaido vaikla <kaido.vaikla@gmail.com>
>>> wrote:
>>>
>>>> Consul is DCS for patroni. If consul cluster is completely down, then
>>>> patroni is unaware of state of cluster.
>>>> And "In above case if consul down , db master node going down, replica
>>>> nodes remains recovery mode"
>>>> is expected. Actually this behave protects database from split brain
>>>>
>>>> br
>>>> Kaido
>>>>
>>>>
>>>> On Wed, 20 Dec 2023 at 03:52, Rambabu V <ram.wissen@gmail.com> wrote:
>>>>
>>>>> Hi Karthik,
>>>>>
>>>>> This is docker based Postgtresql, behavior is different than our
>>>>> normal one for failover and promotion.
>>>>>
>>>>> On Wed, Dec 20, 2023, 03:05 Karthik Yellapragada <
>>>>> karthik.yellapragada@gmail.com> wrote:
>>>>>
>>>>>> May be you can pg auto failover..
>>>>>>
>>>>>> On Tue, Dec 19, 2023 at 9:33 AM Rambabu V <ram.wissen@gmail.com>
>>>>>> wrote:
>>>>>>
>>>>>>> Thanks, any alternative solution for my requirement .
>>>>>>>
>>>>>>> In above case if consul down , db master node going down, replica
>>>>>>> nodes remains recovery mode.its complete downtime.
>>>>>>>
>>>>>>> On Tue, Dec 19, 2023, 22:23 Scott Ribe <scott_ribe@elevated-dev.com>
>>>>>>> wrote:
>>>>>>>
>>>>>>>> > On Dec 19, 2023, at 7:12 AM, Rambabu V <ram.wissen@gmail.com>
>>>>>>>> wrote:
>>>>>>>> >
>>>>>>>> > Hi Team,
>>>>>>>> >
>>>>>>>> > We have implemented postgresql HA with Patroni + Consul cluster
>>>>>>>> on Docker based PostgreSQL Setup.
>>>>>>>> >
>>>>>>>> > We are seeing the issue below.
>>>>>>>> >
>>>>>>>> > our consul cluster built with 3 nodes, if consul cluster
>>>>>>>> completely down, Patroni triggering failover.
>>>>>>>> > Is there any option to prevent this failure even if the consul
>>>>>>>> cluster is down also?
>>>>>>>> >
>>>>>>>> > and also any effective alternative for HA for docker based
>>>>>>>> PostgreSQL setup?
>>>>>>>>
>>>>>>>> How do you expect to have working HA without working networking?
>>>>>>>>
>>>>>>>> --
>>>>>> Thanks & Regards
>>>>>> Karthik Yellapragada
>>>>>> +1 860 830 5235
>>>>>>
>>>>>
^ permalink raw reply [nested|flat] 16+ messages in thread
* Re: Need inputs on postgresql HA with consul cluster
2023-12-19 14:12 Need inputs on postgresql HA with consul cluster Rambabu V <ram.wissen@gmail.com>
2023-12-19 14:22 ` Re: Need inputs on postgresql HA with consul cluster Scott Ribe <scott_ribe@elevated-dev.com>
2023-12-19 17:32 ` Re: Need inputs on postgresql HA with consul cluster Rambabu V <ram.wissen@gmail.com>
2023-12-19 19:05 ` Re: Need inputs on postgresql HA with consul cluster Karthik Yellapragada <karthik.yellapragada@gmail.com>
2023-12-20 01:52 ` Re: Need inputs on postgresql HA with consul cluster Rambabu V <ram.wissen@gmail.com>
2023-12-20 17:42 ` Re: Need inputs on postgresql HA with consul cluster kaido vaikla <kaido.vaikla@gmail.com>
2023-12-20 18:30 ` Re: Need inputs on postgresql HA with consul cluster kaido vaikla <kaido.vaikla@gmail.com>
2023-12-21 01:49 ` Re: Need inputs on postgresql HA with consul cluster Rambabu V <ram.wissen@gmail.com>
2023-12-23 06:11 ` Re: Need inputs on postgresql HA with consul cluster Rambabu V <ram.wissen@gmail.com>
@ 2023-12-23 06:13 ` Rambabu V <ram.wissen@gmail.com>
2023-12-24 14:00 ` Re: Need inputs on postgresql HA with consul cluster Scott Ribe <scott_ribe@elevated-dev.com>
2 siblings, 1 reply; 16+ messages in thread
From: Rambabu V @ 2023-12-23 06:13 UTC (permalink / raw)
To: kaido vaikla <kaido.vaikla@gmail.com>; +Cc: Karthik Yellapragada <karthik.yellapragada@gmail.com>; Scott Ribe <scott_ribe@elevated-dev.com>; pgsql-admin@lists.postgresql.org
Attachment for the same.
On Sat, Dec 23, 2023, 14:11 Rambabu V <ram.wissen@gmail.com> wrote:
> Hi Kaido,
>
> Using patroni 3+ version, even though enabled failsafe_mide, still if
> consul cluster down, master db going down. Replicas remaining same.
>
> On Thu, Dec 21, 2023, 09:49 Rambabu V <ram.wissen@gmail.com> wrote:
>
>> thanks Kaido, applied to the above option. getting good result.
>>
>> On Thu, Dec 21, 2023 at 2:30 AM kaido vaikla <kaido.vaikla@gmail.com>
>> wrote:
>>
>>> @Rambabu
>>> You can try this: DCS Failsafe Mode
>>> https://patroni.readthedocs.io/en/master/dcs_failsafe_mode.html#id2
>>> https://speakerdeck.com/cyberdemn/failsafe-patroni-3-dot-0
>>> br
>>> Kaido
>>>
>>>
>>> On Wed, 20 Dec 2023 at 19:42, kaido vaikla <kaido.vaikla@gmail.com>
>>> wrote:
>>>
>>>> Consul is DCS for patroni. If consul cluster is completely down, then
>>>> patroni is unaware of state of cluster.
>>>> And "In above case if consul down , db master node going down, replica
>>>> nodes remains recovery mode"
>>>> is expected. Actually this behave protects database from split brain
>>>>
>>>> br
>>>> Kaido
>>>>
>>>>
>>>> On Wed, 20 Dec 2023 at 03:52, Rambabu V <ram.wissen@gmail.com> wrote:
>>>>
>>>>> Hi Karthik,
>>>>>
>>>>> This is docker based Postgtresql, behavior is different than our
>>>>> normal one for failover and promotion.
>>>>>
>>>>> On Wed, Dec 20, 2023, 03:05 Karthik Yellapragada <
>>>>> karthik.yellapragada@gmail.com> wrote:
>>>>>
>>>>>> May be you can pg auto failover..
>>>>>>
>>>>>> On Tue, Dec 19, 2023 at 9:33 AM Rambabu V <ram.wissen@gmail.com>
>>>>>> wrote:
>>>>>>
>>>>>>> Thanks, any alternative solution for my requirement .
>>>>>>>
>>>>>>> In above case if consul down , db master node going down, replica
>>>>>>> nodes remains recovery mode.its complete downtime.
>>>>>>>
>>>>>>> On Tue, Dec 19, 2023, 22:23 Scott Ribe <scott_ribe@elevated-dev.com>
>>>>>>> wrote:
>>>>>>>
>>>>>>>> > On Dec 19, 2023, at 7:12 AM, Rambabu V <ram.wissen@gmail.com>
>>>>>>>> wrote:
>>>>>>>> >
>>>>>>>> > Hi Team,
>>>>>>>> >
>>>>>>>> > We have implemented postgresql HA with Patroni + Consul cluster
>>>>>>>> on Docker based PostgreSQL Setup.
>>>>>>>> >
>>>>>>>> > We are seeing the issue below.
>>>>>>>> >
>>>>>>>> > our consul cluster built with 3 nodes, if consul cluster
>>>>>>>> completely down, Patroni triggering failover.
>>>>>>>> > Is there any option to prevent this failure even if the consul
>>>>>>>> cluster is down also?
>>>>>>>> >
>>>>>>>> > and also any effective alternative for HA for docker based
>>>>>>>> PostgreSQL setup?
>>>>>>>>
>>>>>>>> How do you expect to have working HA without working networking?
>>>>>>>>
>>>>>>>> --
>>>>>> Thanks & Regards
>>>>>> Karthik Yellapragada
>>>>>> +1 860 830 5235
>>>>>>
>>>>>
Attachments:
[image/jpeg] IMG_20231223_141258.jpg (2.8M, ../../CADtiZxpkSKDq3+JDMRn_HPUAsbFZZFEYjwQPsAd5T-CdODCnQA@mail.gmail.com/3-IMG_20231223_141258.jpg)
download | view image
^ permalink raw reply [nested|flat] 16+ messages in thread
* Re: Need inputs on postgresql HA with consul cluster
2023-12-19 14:12 Need inputs on postgresql HA with consul cluster Rambabu V <ram.wissen@gmail.com>
2023-12-19 14:22 ` Re: Need inputs on postgresql HA with consul cluster Scott Ribe <scott_ribe@elevated-dev.com>
2023-12-19 17:32 ` Re: Need inputs on postgresql HA with consul cluster Rambabu V <ram.wissen@gmail.com>
2023-12-19 19:05 ` Re: Need inputs on postgresql HA with consul cluster Karthik Yellapragada <karthik.yellapragada@gmail.com>
2023-12-20 01:52 ` Re: Need inputs on postgresql HA with consul cluster Rambabu V <ram.wissen@gmail.com>
2023-12-20 17:42 ` Re: Need inputs on postgresql HA with consul cluster kaido vaikla <kaido.vaikla@gmail.com>
2023-12-20 18:30 ` Re: Need inputs on postgresql HA with consul cluster kaido vaikla <kaido.vaikla@gmail.com>
2023-12-21 01:49 ` Re: Need inputs on postgresql HA with consul cluster Rambabu V <ram.wissen@gmail.com>
2023-12-23 06:11 ` Re: Need inputs on postgresql HA with consul cluster Rambabu V <ram.wissen@gmail.com>
2023-12-23 06:13 ` Re: Need inputs on postgresql HA with consul cluster Rambabu V <ram.wissen@gmail.com>
@ 2023-12-24 14:00 ` Scott Ribe <scott_ribe@elevated-dev.com>
0 siblings, 0 replies; 16+ messages in thread
From: Scott Ribe @ 2023-12-24 14:00 UTC (permalink / raw)
To: Rambabu V <ram.wissen@gmail.com>; +Cc: Pgsql-admin <pgsql-admin@lists.postgresql.org>
> On Dec 22, 2023, at 11:13 PM, Rambabu V <ram.wissen@gmail.com> wrote:
>
> Attachment for the same.
So? You posted that before. As I quoted from the Patroni documentation about failsafe_mode, which you surely read, it only works if the Patroni instances can still communicate with each other over their REST APIs.
I am going to say this once more, then I will no longer participate in this thread: IF YOUR NETWORK (AND DCS) ARE NOT WORKING, YOU CANNOT HAVE RELIABLE HA.
^ permalink raw reply [nested|flat] 16+ messages in thread
* Re: Need inputs on postgresql HA with consul cluster
2023-12-19 14:12 Need inputs on postgresql HA with consul cluster Rambabu V <ram.wissen@gmail.com>
2023-12-19 14:22 ` Re: Need inputs on postgresql HA with consul cluster Scott Ribe <scott_ribe@elevated-dev.com>
2023-12-19 17:32 ` Re: Need inputs on postgresql HA with consul cluster Rambabu V <ram.wissen@gmail.com>
2023-12-19 19:05 ` Re: Need inputs on postgresql HA with consul cluster Karthik Yellapragada <karthik.yellapragada@gmail.com>
2023-12-20 01:52 ` Re: Need inputs on postgresql HA with consul cluster Rambabu V <ram.wissen@gmail.com>
2023-12-20 17:42 ` Re: Need inputs on postgresql HA with consul cluster kaido vaikla <kaido.vaikla@gmail.com>
2023-12-20 18:30 ` Re: Need inputs on postgresql HA with consul cluster kaido vaikla <kaido.vaikla@gmail.com>
2023-12-21 01:49 ` Re: Need inputs on postgresql HA with consul cluster Rambabu V <ram.wissen@gmail.com>
2023-12-23 06:11 ` Re: Need inputs on postgresql HA with consul cluster Rambabu V <ram.wissen@gmail.com>
@ 2023-12-23 13:29 ` Scott Ribe <scott_ribe@elevated-dev.com>
2023-12-23 13:33 ` Re: Need inputs on postgresql HA with consul cluster Rambabu V <ram.wissen@gmail.com>
2 siblings, 1 reply; 16+ messages in thread
From: Scott Ribe @ 2023-12-23 13:29 UTC (permalink / raw)
To: Rambabu V <ram.wissen@gmail.com>; +Cc: Pgsql-admin <pgsql-admin@lists.postgresql.org>
> On Dec 22, 2023, at 11:11 PM, Rambabu V <ram.wissen@gmail.com> wrote:
>
> Using patroni 3+ version, even though enabled failsafe_mide, still if consul cluster down, master db going down. Replicas remaining same.
If you don't have working network infrastructure, you cannot have reliable HA on Postgres--nor any other service.
^ permalink raw reply [nested|flat] 16+ messages in thread
* Re: Need inputs on postgresql HA with consul cluster
2023-12-19 14:12 Need inputs on postgresql HA with consul cluster Rambabu V <ram.wissen@gmail.com>
2023-12-19 14:22 ` Re: Need inputs on postgresql HA with consul cluster Scott Ribe <scott_ribe@elevated-dev.com>
2023-12-19 17:32 ` Re: Need inputs on postgresql HA with consul cluster Rambabu V <ram.wissen@gmail.com>
2023-12-19 19:05 ` Re: Need inputs on postgresql HA with consul cluster Karthik Yellapragada <karthik.yellapragada@gmail.com>
2023-12-20 01:52 ` Re: Need inputs on postgresql HA with consul cluster Rambabu V <ram.wissen@gmail.com>
2023-12-20 17:42 ` Re: Need inputs on postgresql HA with consul cluster kaido vaikla <kaido.vaikla@gmail.com>
2023-12-20 18:30 ` Re: Need inputs on postgresql HA with consul cluster kaido vaikla <kaido.vaikla@gmail.com>
2023-12-21 01:49 ` Re: Need inputs on postgresql HA with consul cluster Rambabu V <ram.wissen@gmail.com>
2023-12-23 06:11 ` Re: Need inputs on postgresql HA with consul cluster Rambabu V <ram.wissen@gmail.com>
2023-12-23 13:29 ` Re: Need inputs on postgresql HA with consul cluster Scott Ribe <scott_ribe@elevated-dev.com>
@ 2023-12-23 13:33 ` Rambabu V <ram.wissen@gmail.com>
2023-12-23 13:36 ` Re: Need inputs on postgresql HA with consul cluster Scott Ribe <scott_ribe@elevated-dev.com>
0 siblings, 1 reply; 16+ messages in thread
From: Rambabu V @ 2023-12-23 13:33 UTC (permalink / raw)
To: Scott Ribe <scott_ribe@elevated-dev.com>; +Cc: Pgsql-admin <pgsql-admin@lists.postgresql.org>
Hi Scott,
but as per the patroni documentation , if we enable failsafe_mode option,
incase of dcs down, cluster status should remain the same without any
action. but it is not happening.
On Sat, Dec 23, 2023 at 9:29 PM Scott Ribe <scott_ribe@elevated-dev.com>
wrote:
> > On Dec 22, 2023, at 11:11 PM, Rambabu V <ram.wissen@gmail.com> wrote:
> >
> > Using patroni 3+ version, even though enabled failsafe_mide, still if
> consul cluster down, master db going down. Replicas remaining same.
>
> If you don't have working network infrastructure, you cannot have reliable
> HA on Postgres--nor any other service.
^ permalink raw reply [nested|flat] 16+ messages in thread
* Re: Need inputs on postgresql HA with consul cluster
2023-12-19 14:12 Need inputs on postgresql HA with consul cluster Rambabu V <ram.wissen@gmail.com>
2023-12-19 14:22 ` Re: Need inputs on postgresql HA with consul cluster Scott Ribe <scott_ribe@elevated-dev.com>
2023-12-19 17:32 ` Re: Need inputs on postgresql HA with consul cluster Rambabu V <ram.wissen@gmail.com>
2023-12-19 19:05 ` Re: Need inputs on postgresql HA with consul cluster Karthik Yellapragada <karthik.yellapragada@gmail.com>
2023-12-20 01:52 ` Re: Need inputs on postgresql HA with consul cluster Rambabu V <ram.wissen@gmail.com>
2023-12-20 17:42 ` Re: Need inputs on postgresql HA with consul cluster kaido vaikla <kaido.vaikla@gmail.com>
2023-12-20 18:30 ` Re: Need inputs on postgresql HA with consul cluster kaido vaikla <kaido.vaikla@gmail.com>
2023-12-21 01:49 ` Re: Need inputs on postgresql HA with consul cluster Rambabu V <ram.wissen@gmail.com>
2023-12-23 06:11 ` Re: Need inputs on postgresql HA with consul cluster Rambabu V <ram.wissen@gmail.com>
2023-12-23 13:29 ` Re: Need inputs on postgresql HA with consul cluster Scott Ribe <scott_ribe@elevated-dev.com>
2023-12-23 13:33 ` Re: Need inputs on postgresql HA with consul cluster Rambabu V <ram.wissen@gmail.com>
@ 2023-12-23 13:36 ` Scott Ribe <scott_ribe@elevated-dev.com>
0 siblings, 0 replies; 16+ messages in thread
From: Scott Ribe @ 2023-12-23 13:36 UTC (permalink / raw)
To: Rambabu V <ram.wissen@gmail.com>; +Cc: Pgsql-admin <pgsql-admin@lists.postgresql.org>
> On Dec 23, 2023, at 6:33 AM, Rambabu V <ram.wissen@gmail.com> wrote:
>
> but as per the patroni documentation , if we enable failsafe_mode option, incase of dcs down, cluster status should remain the same without any action. but it is not happening.
"...if it can access all known members of the cluster via Patroni REST API."
Is that your problem?
Really, you're pissing away time poking at a symptom, when the underlying cause needs to be fixed.
^ permalink raw reply [nested|flat] 16+ messages in thread
end of thread, other threads:[~2023-12-24 14:00 UTC | newest]
Thread overview: 16+ messages (download: mbox mbox.gz follow: Atom feed)
-- links below jump to the message on this page --
2023-12-19 14:12 Need inputs on postgresql HA with consul cluster Rambabu V <ram.wissen@gmail.com>
2023-12-19 14:22 ` Scott Ribe <scott_ribe@elevated-dev.com>
2023-12-19 17:32 ` Rambabu V <ram.wissen@gmail.com>
2023-12-19 17:40 ` Ron Johnson <ronljohnsonjr@gmail.com>
2023-12-19 19:05 ` Karthik Yellapragada <karthik.yellapragada@gmail.com>
2023-12-20 01:52 ` Rambabu V <ram.wissen@gmail.com>
2023-12-20 17:42 ` kaido vaikla <kaido.vaikla@gmail.com>
2023-12-20 18:30 ` kaido vaikla <kaido.vaikla@gmail.com>
2023-12-21 01:49 ` Rambabu V <ram.wissen@gmail.com>
2023-12-23 06:11 ` Rambabu V <ram.wissen@gmail.com>
2023-12-23 06:11 ` Rambabu V <ram.wissen@gmail.com>
2023-12-23 06:13 ` Rambabu V <ram.wissen@gmail.com>
2023-12-24 14:00 ` Scott Ribe <scott_ribe@elevated-dev.com>
2023-12-23 13:29 ` Scott Ribe <scott_ribe@elevated-dev.com>
2023-12-23 13:33 ` Rambabu V <ram.wissen@gmail.com>
2023-12-23 13:36 ` Scott Ribe <scott_ribe@elevated-dev.com>
This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox