Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_CBC_SHA384:256) (Exim 4.89) (envelope-from ) id 1etgCR-0006De-Ut for pgsql-admin@arkaria.postgresql.org; Wed, 07 Mar 2018 21:02:12 +0000 Received: from localhost ([127.0.0.1] helo=malur.postgresql.org) by malur.postgresql.org with esmtp (Exim 4.89) (envelope-from ) id 1etgCQ-0005VV-SU for pgsql-admin@arkaria.postgresql.org; Wed, 07 Mar 2018 21:02:10 +0000 Received: from magus.postgresql.org ([2a02:c0:301:0:ffff::29]) by malur.postgresql.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_CBC_SHA384:256) (Exim 4.89) (envelope-from ) id 1etgCQ-0005VE-L1 for pgsql-admin@lists.postgresql.org; Wed, 07 Mar 2018 21:02:10 +0000 Received: from cat-porwal-prod-mail1.catalyst.net.nz ([2404:130:4080::4]) by magus.postgresql.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_CBC_SHA384:256) (Exim 4.89) (envelope-from ) id 1etgCL-0001q8-Bj for pgsql-admin@lists.postgresql.org; Wed, 07 Mar 2018 21:02:09 +0000 Authentication-Results: auth=pass smtp.auth=mark.kirkwood@catalyst.net.nz smtp.mailfrom=mark.kirkwood@catalyst.net.nz Received: from [IPv6:2406:e001:eea:1:acdd:4381:7380:da0c] (unknown [IPv6:2406:e001:eea:1:acdd:4381:7380:da0c]) (Authenticated sender: mark.kirkwood@catalyst.net.nz) by cat-porwal-prod-mail1.catalyst.net.nz (Postfix) with ESMTPSA id 15EE580C77; Thu, 8 Mar 2018 10:01:54 +1300 (NZDT) Subject: Re: Reliable WAL file shipping over unreliable network From: Mark Kirkwood To: David Steele , Stephen Frost , Rui DeSousa Cc: pgsql-admin@lists.postgresql.org References: <988AB20C-9FDE-4197-BF3F-C54D80C2ED78@elevated-dev.com> <20180302180911.GO2416@tamriel.snowman.net> <20180304150640.GR2416@tamriel.snowman.net> <3D9CC2FB-57E1-45B2-B5FC-1B214F5DB068@icloud.com> <20180305111521.GV2416@tamriel.snowman.net> <20180305150218.GY2416@tamriel.snowman.net> <15F9D550-9909-40B3-A384-417AFCD745DF@icloud.com> <20180306190004.GQ2416@tamriel.snowman.net> <68099b52-3909-07e3-04ea-b5ba600b1767@pgmasters.net> <0bff7871-1f88-65a6-ac77-4bbba8f89889@catalyst.net.nz> Message-ID: <8aae595d-e748-f41d-e452-186fb5b00ce2@catalyst.net.nz> Date: Thu, 8 Mar 2018 10:01:53 +1300 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:52.0) Gecko/20100101 Thunderbird/52.6.0 MIME-Version: 1.0 In-Reply-To: <0bff7871-1f88-65a6-ac77-4bbba8f89889@catalyst.net.nz> Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 7bit Content-Language: en-US List-Id: List-Help: List-Subscribe: List-Post: List-Owner: List-Archive: Precedence: bulk On 07/03/18 16:18, Mark Kirkwood wrote: > > > The added (new) issue that there may be some unusual bug with rsync + > quotas and ZFS on BSD (at least) gives a bit more weight to this idea. > > > Looking at the progress of said bug (https://bugzilla.samba.org/show_bug.cgi?id=13317), it appears to be: - due interaction of ZFS and quotas - specific to Freebsd - patch has been developed However, code review of rsync shows it needs a patch too (not always checking success of writes). I'll keep an eye out for progress there. regards Mark