public inbox for [email protected]  
help / color / mirror / Atom feed
From: Jim Nasby <[email protected]>
To: Devrim Gündüz <[email protected]>
Cc: Greg Sabino Mullane <[email protected]>
Cc: Ashutosh Bapat <[email protected]>
Cc: Andrey Borodin <[email protected]>
Cc: Tom Lane <[email protected]>
Cc: Konstantin Osipov <[email protected]>
Cc: Nikolay Samokhvalov <[email protected]>
Cc: PostgreSQL Hackers <[email protected]>
Subject: Re: Built-in Raft replication
Date: Tue, 29 Apr 2025 15:16:07 -0500
Message-ID: <CAMFBP2oGM9N8Kty-3DzRmmgV0=ROB7ss7Rudw8Wida92t9O0+w@mail.gmail.com> (raw)
In-Reply-To: <[email protected]>
References: <Z_1Cq7JvabsFYjQo@ark>
	<CAKAnmmJxGHcQmzXqEQ-nppZjXyH7i5W_7Cz8JNMb2+6c5+D+og@mail.gmail.com>
	<CAM527d9+eGvdih1GxoPDJ2WYs6eitf39oNTxGxnCK1PgF=A8wg@mail.gmail.com>
	<[email protected]>
	<[email protected]>
	<CAExHW5udz081Unx5qcLZ89DnR4cp6OhW0TCoco3+AEkGw480uQ@mail.gmail.com>
	<[email protected]>
	<CAExHW5tq8ShEfboFa52wDMWmyaW+6kX_6x8MZ-0TP65tOhJ1wQ@mail.gmail.com>
	<CAKAnmm+QJnL_APyKhM3hjkOv9DXjWaqJxB2nFDuNH9JqVdTfXA@mail.gmail.com>
	<[email protected]>
	<[email protected]>

I've always assumed there'd have to be at least one global stream, if for
no other purpose than to be the source of truth about transaction commit
ordering (though, I was thinking of supporting multiple streams for one
database). Presumably the same could be used for shared objects. Or perhaps
shared objects just get their own stream. Either way, having a master
commit record that points at LSNs of various other streams is what I'd been
thinking.

On Wed, Apr 23, 2025 at 12:01 PM Devrim Gündüz <[email protected]> wrote:

> Hi,
>
> On Wed, 2025-04-23 at 11:48 -0500, Jim Nasby wrote:
> > unless we added multiple WAL streams. That would allow for splitting
> > WAL traffic across multiple devices as well as providing better
> > support for configurations that don’t replicate the entire cluster.
> > The current situation where delayed replication of a single table
> > mandates retention of all the WAL for the entire cluster is less than
> > ideal.
>
> I think the problem is handling the stream of global objects. Having
> separate stream for each database would be awesome as long as it can
> deal with the "global stream".
>
> Regards,
> --
> Devrim Gündüz
> Open Source Solution Architect, PostgreSQL Major Contributor
> BlueSky: @devrim.gunduz.org , @gunduz.org
>


view thread (33+ messages)  latest in thread

reply

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Reply to all the recipients using the --to and --cc options:
  reply via email

  To: [email protected]
  Cc: [email protected], [email protected], [email protected], [email protected], [email protected], [email protected], [email protected], [email protected], [email protected]
  Subject: Re: Built-in Raft replication
  In-Reply-To: <CAMFBP2oGM9N8Kty-3DzRmmgV0=ROB7ss7Rudw8Wida92t9O0+w@mail.gmail.com>

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

This inbox is served by agora; see mirroring instructions
for how to clone and mirror all data and code used for this inbox