Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtps (TLS1.3:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1p7YfS-0002J6-Na for pgsql-hackers@arkaria.postgresql.org; Tue, 20 Dec 2022 09:12:10 +0000 Received: from localhost ([127.0.0.1] helo=malur.postgresql.org) by malur.postgresql.org with esmtp (Exim 4.92) (envelope-from ) id 1p7YfR-0004om-8W for pgsql-hackers@arkaria.postgresql.org; Tue, 20 Dec 2022 09:12:09 +0000 Received: from makus.postgresql.org ([2001:4800:3e1:1::229]) by malur.postgresql.org with esmtps (TLS1.3:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1p7YfQ-0004n7-Pn for pgsql-hackers@lists.postgresql.org; Tue, 20 Dec 2022 09:12:08 +0000 Received: from mail-yb1-xb2e.google.com ([2607:f8b0:4864:20::b2e]) by makus.postgresql.org with esmtps (TLS1.3:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.92) (envelope-from ) id 1p7YfN-0000sw-6i for pgsql-hackers@lists.postgresql.org; Tue, 20 Dec 2022 09:12:07 +0000 Received: by mail-yb1-xb2e.google.com with SMTP id t15so183781ybq.4 for ; Tue, 20 Dec 2022 01:12:05 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:from:to:cc:subject:date:message-id:reply-to; bh=F1Ycv2vQ0a+J/PYn3VTdBkzgY55X7n0YAIl3NgyqKvw=; b=hNAwBIuT421eHifAe/tojHoaws5K8DrM68N0IJPPVN1cdBMkMv2+8vLuoMCyhbAvxo gEivP6EBfUJWgHnn5081IhtHKEqwwtqSCVQHOCMCUh2vddJhBsFREeS2F1BC95T+q0MA 9seSxxSUTVtzSnRjpQRR9ehpRDwq4ZJnJx/DaFenUkGfSqW5J8XXqHtlzJUSnbTtaStA ZTPQXsSWHMy9qtJfzBwt7fAysnin1AXWnWARVBS7Rf0k8dIsLmZmZhY9KXn+OaFIuJkD ME8zSlRSxrkZ7hFA7HLfRDtGJqfkVhrUzxodsXzR/9hOzNFTjbxjpQgzlq0U8r1LX1sh t8qg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=F1Ycv2vQ0a+J/PYn3VTdBkzgY55X7n0YAIl3NgyqKvw=; b=2tkOf8KaGjeSxcjW0N9+GT6WM7nKJSMSE7paxBghcFb9VnLrWC58NY0bTEA7/cBGyD 2ntS6IJEWnEtLp3YNsA57wRaQyoEEjHUkgQmP8jlDhYqT9L05iY625HL6nQkOb65FfB5 kzHpDxw5Ix6RXZZvsofcBHYi/zd20SnSg/ywHz8Vm8GVcBAe1eLyA0wXSip4eF0R5ypn x9Wop+NgMtgaYhr7EAsYJ50B1jEMZSKepl+ViRQD1MzbLMTyB/Y61SDbhdwJwYePgDk+ 25tCV7o6dUk5Yp6J67FAOkYJckrarPDGuu+p4mGQ9o+ZZyW8YyDZpDSGFHapgMlKpFrR oEig== X-Gm-Message-State: ANoB5pmODPat/GRRVr8An6WN48ptIx2AUgwqadUA1RPYqLeYsBWPpQdh 6ZDovemXIbGN7Y61IBC3NzxZzxX/2kJ+H6HbOLw= X-Google-Smtp-Source: AA0mqf5nfCOseOgSSfXo9nw4xsL3gYn7AtJ9ZMnG5SBhFs9+BhDyIoDTwN3kwObRs+stvtfomWhSlQhfAsC24VQNY/A= X-Received: by 2002:a25:3203:0:b0:6fa:40a8:5952 with SMTP id y3-20020a253203000000b006fa40a85952mr40934029yby.594.1671527524173; Tue, 20 Dec 2022 01:12:04 -0800 (PST) MIME-Version: 1.0 References: In-Reply-To: From: Amit Kapila Date: Tue, 20 Dec 2022 14:41:52 +0530 Message-ID: Subject: Re: Perform streaming logical transactions by background workers and parallel apply To: "houzj.fnst@fujitsu.com" Cc: Masahiko Sawada , "wangw.fnst@fujitsu.com" , Peter Smith , Dilip Kumar , "shiy.fnst@fujitsu.com" , PostgreSQL Hackers Content-Type: multipart/mixed; boundary="000000000000504f4505f03ed477" List-Id: List-Help: List-Subscribe: List-Post: List-Owner: List-Archive: Archived-At: Precedence: bulk --000000000000504f4505f03ed477 Content-Type: text/plain; charset="UTF-8" On Mon, Dec 19, 2022 at 6:17 PM Amit Kapila wrote: > > On Sat, Dec 17, 2022 at 7:34 PM houzj.fnst@fujitsu.com > wrote: > > > > Agreed. I have addressed all the comments and did some cosmetic changes. > > Attach the new version patch set. > > > > Few comments: > ============ > Few more minor points: 1. -static inline void +void changes_filename(char *path, Oid subid, TransactionId xid) { This function seems to be used only in worker.c. So, what is the need to make it extern? 2. I have made a few changes in the comments. See attached. This is atop my yesterday's top-up patch. I think we should merge the 0001 and 0002 patches as they need to be committed together. -- With Regards, Amit Kapila. --000000000000504f4505f03ed477 Content-Type: application/octet-stream; name="changes_amit_2.patch" Content-Disposition: attachment; filename="changes_amit_2.patch" Content-Transfer-Encoding: base64 Content-ID: X-Attachment-Id: f_lbw0atn70 ZGlmZiAtLWdpdCBhL3NyYy9iYWNrZW5kL3JlcGxpY2F0aW9uL2xvZ2ljYWwvd29ya2VyLmMgYi9z cmMvYmFja2VuZC9yZXBsaWNhdGlvbi9sb2dpY2FsL3dvcmtlci5jCmluZGV4IGRmNjc4NTFhYzAu Ljc1MTE5MTgzZGEgMTAwNjQ0Ci0tLSBhL3NyYy9iYWNrZW5kL3JlcGxpY2F0aW9uL2xvZ2ljYWwv d29ya2VyLmMKKysrIGIvc3JjL2JhY2tlbmQvcmVwbGljYXRpb24vbG9naWNhbC93b3JrZXIuYwpA QCAtMTg4Miw3ICsxODgyLDYgQEAgYXBwbHlfaGFuZGxlX3N0cmVhbV9hYm9ydChTdHJpbmdJbmZv IHMpCiAJCQkJCXBhX3VubG9ja19zdHJlYW0oeGlkLCBBY2Nlc3NFeGNsdXNpdmVMb2NrKTsKIAkJ CQkJKHZvaWQpIHBhX2ZyZWVfd29ya2VyKHdpbmZvKTsKIAkJCQl9Ci0KIAkJCQlicmVhazsKIAkJ CX0KIApAQCAtMTkyNyw4ICsxOTI2LDggQEAgYXBwbHlfaGFuZGxlX3N0cmVhbV9hYm9ydChTdHJp bmdJbmZvIHMpCiAJCQkgKiBXZSBuZWVkIHRvIHdhaXQgYWZ0ZXIgcHJvY2Vzc2luZyByb2xsYmFj ayB0byBzYXZlcG9pbnQgZm9yIHRoZQogCQkJICogbmV4dCBzZXQgb2YgY2hhbmdlcy4KIAkJCSAq Ci0JCQkgKiBXZSBoYXZlIGEgcmFjZSBjb25kaXRpb24gaGVyZSB3aGVuIHdlIGNhbiBzdGFydCB3 YWl0aW5nIGhlcmUKLQkJCSAqIHdoZW4gdGhlcmUgYXJlIG1vcmUgY2h1bmsgb2Ygc3RyZWFtcyBp biB0aGUgcXVldWUuIFNlZQorCQkJICogV2UgaGF2ZSBhIHJhY2UgY29uZGl0aW9uIGhlcmUgZHVl IHRvIHdoaWNoIHdlIGNhbiBzdGFydCB3YWl0aW5nCisJCQkgKiBoZXJlIHdoZW4gdGhlcmUgYXJl IG1vcmUgY2h1bmsgb2Ygc3RyZWFtcyBpbiB0aGUgcXVldWUuIFNlZQogCQkJICogYXBwbHlfaGFu ZGxlX3N0cmVhbV9zdG9wLgogCQkJICovCiAJCQlpZiAoIXRvcGxldmVsX3hhY3QpCkBAIC00MjQy LDggKzQyNDEsOCBAQCBzdHJlYW1fd3JpdGVfY2hhbmdlKGNoYXIgYWN0aW9uLCBTdHJpbmdJbmZv IHMpCiAgKgkgIFNlcmlhbGl6ZSBhIG1lc3NhZ2UgdG8gYSBmaWxlIGZvciB0aGUgZ2l2ZW4gdHJh bnNhY3Rpb24uCiAgKgogICogVGhpcyBmdW5jdGlvbiBpcyBzaW1pbGFyIHRvIHN0cmVhbV93cml0 ZV9jaGFuZ2UgZXhjZXB0IHRoYXQgaXQgd2lsbCBvcGVuIHRoZQotICogdGFyZ2V0IGZpbGUgaWYg bm90IGFscmVhZHkgYmVmb3JlIHdyaXRpbmcgdGhlIG1lc3NhZ2UgYW5kIGNsb3NlIGZpbGUgYXQg dGhlCi0gKiBlbmQuCisgKiB0YXJnZXQgZmlsZSBpZiBub3QgYWxyZWFkeSBiZWZvcmUgd3JpdGlu ZyB0aGUgbWVzc2FnZSBhbmQgY2xvc2UgdGhlIGZpbGUgYXQKKyAqIHRoZSBlbmQuCiAgKi8KIHN0 YXRpYyB2b2lkCiBzdHJlYW1fb3Blbl9hbmRfd3JpdGVfY2hhbmdlKFRyYW5zYWN0aW9uSWQgeGlk LCBjaGFyIGFjdGlvbiwgU3RyaW5nSW5mbyBzKQpAQCAtNDkyNiwxMCArNDkyNSw5IEBAIHNldF9h cHBseV9lcnJvcl9jb250ZXh0X29yaWdpbihjaGFyICpvcmlnaW5uYW1lKQogfQogCiAvKgotICog UmV0dXJuIHRoZSBhY3Rpb24gdG8gdGFrZSBmb3IgdGhlIGdpdmVuIHRyYW5zYWN0aW9uLiAqd2lu Zm8gaXMgYXNzaWduZWQgdG8KLSAqIHRoZSBkZXN0aW5hdGlvbiBwYXJhbGxlbCB3b3JrZXIgaW5m byAoaWYgdGhlIGFjdGlvbiBpcwotICogVFJBTlNfTEVBREVSX1NFTkRfVE9fUEFSQUxMRUwgb3Ig VFJBTlNfTEVBREVSX1BBUlRJQUxfU0VSSUFMSVpFKSwgb3RoZXJ3aXNlCi0gKiAqd2luZm8gaXMg YXNzaWduZWQgTlVMTC4KKyAqIFJldHVybiB0aGUgYWN0aW9uIHRvIGJlIHRha2VuIGZvciB0aGUg Z2l2ZW4gdHJhbnNhY3Rpb24uICp3aW5mbyBpcworICogYXNzaWduZWQgdG8gdGhlIGRlc3RpbmF0 aW9uIHBhcmFsbGVsIHdvcmtlciBpbmZvIHdoZW4gdGhlIGdpdmVuCisgKiB0cmFuc2FjdGlvbiBp cyBiZWluZyBwcm9jZXNzZWQgdXNpbmcgYSBwYXJhbGxlbCBhcHBseSB3b3JrZXIuCiAgKi8KIHN0 YXRpYyBUcmFuc0FwcGx5QWN0aW9uCiBnZXRfdHJhbnNhY3Rpb25fYXBwbHlfYWN0aW9uKFRyYW5z YWN0aW9uSWQgeGlkLCBQYXJhbGxlbEFwcGx5V29ya2VySW5mbyAqKndpbmZvKQpkaWZmIC0tZ2l0 IGEvc3JjL2luY2x1ZGUvcmVwbGljYXRpb24vd29ya2VyX2ludGVybmFsLmggYi9zcmMvaW5jbHVk ZS9yZXBsaWNhdGlvbi93b3JrZXJfaW50ZXJuYWwuaAppbmRleCBhMzYyNjg4ZmRlLi4xYTc1Njg2 Yjc5IDEwMDY0NAotLS0gYS9zcmMvaW5jbHVkZS9yZXBsaWNhdGlvbi93b3JrZXJfaW50ZXJuYWwu aAorKysgYi9zcmMvaW5jbHVkZS9yZXBsaWNhdGlvbi93b3JrZXJfaW50ZXJuYWwuaApAQCAtNTgs MTAgKzU4LDEyIEBAIHR5cGVkZWYgc3RydWN0IExvZ2ljYWxSZXBXb3JrZXIKIAogCS8qCiAJICog VXNlZCB0byBjcmVhdGUgdGhlIGNoYW5nZXMgYW5kIHN1YnhhY3QgZmlsZXMgZm9yIHRoZSBzdHJl YW1pbmcKLQkgKiB0cmFuc2FjdGlvbnMuICBVcG9uIHRoZSBhcnJpdmFsIG9mIHRoZSBmaXJzdCBz dHJlYW1pbmcgdHJhbnNhY3Rpb24sIHRoZQotCSAqIGZpbGVzZXQgd2lsbCBiZSBpbml0aWFsaXpl ZCwgYW5kIGl0IHdpbGwgYmUgZGVsZXRlZCB3aGVuIHRoZSB3b3JrZXIKLQkgKiBleGl0cy4gIFVu ZGVyIHRoaXMsIHNlcGFyYXRlIGJ1ZmZpbGVzIHdvdWxkIGJlIGNyZWF0ZWQgZm9yIGVhY2gKLQkg KiB0cmFuc2FjdGlvbiB3aGljaCB3aWxsIGJlIGRlbGV0ZWQgYWZ0ZXIgdGhlIHRyYW5zYWN0aW9u IGlzIGZpbmlzaGVkLgorCSAqIHRyYW5zYWN0aW9ucy4gIFVwb24gdGhlIGFycml2YWwgb2YgdGhl IGZpcnN0IHN0cmVhbWluZyB0cmFuc2FjdGlvbiBvcgorCSAqIHdoZW4gdGhlIGZpcnN0LXRpbWUg bGVhZGVyIGFwcGx5IHdvcmtlciB0aW1lcyBvdXQgd2hpbGUgc2VuZGluZyBjaGFuZ2VzCisJICog dG8gdGhlIHBhcmFsbGVsIGFwcGx5IHdvcmtlciwgdGhlIGZpbGVzZXQgd2lsbCBiZSBpbml0aWFs aXplZCwgYW5kIGl0CisJICogd2lsbCBiZSBkZWxldGVkIHdoZW4gdGhlIHdvcmtlciBleGl0cy4g IFVuZGVyIHRoaXMsIHNlcGFyYXRlIGJ1ZmZpbGVzCisJICogd291bGQgYmUgY3JlYXRlZCBmb3Ig ZWFjaCB0cmFuc2FjdGlvbiB3aGljaCB3aWxsIGJlIGRlbGV0ZWQgYWZ0ZXIgdGhlCisJICogdHJh bnNhY3Rpb24gaXMgZmluaXNoZWQuCiAJICovCiAJRmlsZVNldCAgICAqc3RyZWFtX2ZpbGVzZXQ7 CiAKQEAgLTk2LDEyICs5OCwyMCBAQCB0eXBlZGVmIGVudW0gUGFyYWxsZWxUcmFuc1N0YXRlCiB9 IFBhcmFsbGVsVHJhbnNTdGF0ZTsKIAogLyoKLSAqIFN0YXRlIG9mIGZpbGVzZXQgaW4gbGVhZGVy IGFwcGx5IHdvcmtlci4KKyAqIFN0YXRlIG9mIGZpbGVzZXQgdXNlZCB0byBjb21tdW5pY2F0ZSBj aGFuZ2VzIGZyb20gbGVhZGVyIHRvIHBhcmFsbGVsCisgKiBhcHBseSB3b3JrZXIuCiAgKgotICog RlNfU0VSSUFMSVpFX0lOX1BST0dSRVNTIG1lYW5zIHRoYXQgdGhlIGxlYWRlciBpcyBzZXJpYWxp emluZyBjaGFuZ2VzIHRvIHRoZQotICogZmlsZS4gRlNfU0VSSUFMSVpFX0RPTkUgbWVhbnMgdGhh dCB0aGUgbGVhZGVyIGhhcyBzZXJpYWxpemVkIGFsbCBjaGFuZ2VzIHRvCi0gKiB0aGUgZmlsZS4g RlNfUkVBRFkgbWVhbnMgdGhhdCBpdCBpcyBub3cgb2sgZm9yIGEgcGFyYWxsZWwgYXBwbHkgd29y a2VyIHJlYWQKKyAqIEZTX0VNUFRZIGluZGljYXRlcyBhbiBpbml0aWFsIHN0YXRlIHdoZXJlIHRo ZSBsZWFkZXIgZG9lc24ndCBuZWVkIHRvIHVzZQorICogdGhlIGZpbGUgdG8gY29tbXVuaWNhdGUg d2l0aCB0aGUgcGFyYWxsZWwgYXBwbHkgd29ya2VyLgorICoKKyAqIEZTX1NFUklBTElaRV9JTl9Q Uk9HUkVTUyBpbmRpY2F0ZXMgdGhhdCB0aGUgbGVhZGVyIGlzIHNlcmlhbGl6aW5nIGNoYW5nZXMK KyAqIHRvIHRoZSBmaWxlLgorICoKKyAqIEZTX1NFUklBTElaRV9ET05FIGluZGljYXRlcyB0aGF0 IHRoZSBsZWFkZXIgaGFzIHNlcmlhbGl6ZWQgYWxsIGNoYW5nZXMgdG8KICAqIHRoZSBmaWxlLgor ICoKKyAqIEZTX1JFQURZIGluZGljYXRlcyB0aGF0IGl0IGlzIG5vdyBvayBmb3IgYSBwYXJhbGxl bCBhcHBseSB3b3JrZXIgdG8KKyAqIHJlYWQgdGhlIGZpbGUuCiAgKi8KIHR5cGVkZWYgZW51bSBQ YXJ0aWFsRmlsZVNldFN0YXRlCiB7Cg== --000000000000504f4505f03ed477--