Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_CBC_SHA1:256) (Exim 4.89) (envelope-from ) id 1iq1we-0006yG-0N for pgsql-hackers@arkaria.postgresql.org; Fri, 10 Jan 2020 21:35:52 +0000 Received: from localhost ([127.0.0.1] helo=malur.postgresql.org) by malur.postgresql.org with esmtp (Exim 4.89) (envelope-from ) id 1iq1wb-0001EK-Lr for pgsql-hackers@arkaria.postgresql.org; Fri, 10 Jan 2020 21:35:49 +0000 Received: from magus.postgresql.org ([2a02:c0:301:0:ffff::29]) by malur.postgresql.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_CBC_SHA1:256) (Exim 4.89) (envelope-from ) id 1iq1wb-0001ED-7S for pgsql-hackers@lists.postgresql.org; Fri, 10 Jan 2020 21:35:49 +0000 Received: from mail-qt1-x844.google.com ([2607:f8b0:4864:20::844]) by magus.postgresql.org with esmtps (TLS1.3:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.92) (envelope-from ) id 1iq1wX-0001Hw-Kv for pgsql-hackers@postgresql.org; Fri, 10 Jan 2020 21:35:48 +0000 Received: by mail-qt1-x844.google.com with SMTP id w30so3255317qtd.12 for ; Fri, 10 Jan 2020 13:35:45 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=2ndquadrant-com.20150623.gappssmtp.com; s=20150623; h=date:from:to:cc:subject:message-id:mime-version:content-disposition :content-transfer-encoding:in-reply-to:user-agent; bh=bgsGr8Ec8mkM4+yWgRi7VJpwPfll4wQ3Y9SwDl6OLZ8=; b=UWH1mEg6x4kVEF70EEbUOXdWyHmh9hfF8+T1Y2iVRW7ahoDgciEA7sI6alFJeGKt26 zo/WKPO+8elNuoYqVmp8hTYKcj3UUIDFXte3PBRZpDaZZUmz1D4Tmdezc8FlzH6DfCl+ hWkyBghpe4DwThdwIFu7zrQF+2/5i3wP3skBfQstHDGIJkLMTEi6kZ4nWIKPhcKUuJ7m 3Q2+xn093YaXtrENVjJa6OLxOFTXCATME6Qrlk47wOrfqfhQ8h1h2ulYfyh8KvFSsLay xbseCe9Jw/7Fat0DWbt+ARFnfkF1iRPd3hItE5KMvwsXlARhGTho2N9fiNjSaASPLJeS mhkw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:date:from:to:cc:subject:message-id:mime-version :content-disposition:content-transfer-encoding:in-reply-to :user-agent; bh=bgsGr8Ec8mkM4+yWgRi7VJpwPfll4wQ3Y9SwDl6OLZ8=; b=As60wv8s7tD2MRq5yBt+nDToBlmUKmqVhGvjntnfs/IwhIfz7WxlKwY0EjjfZ3qAS2 fL7kvuKyZrvtGgFLqOabyQvw7TrMAoMF+J4tz/tvbMEZ9NgwCxr5PLVjNXzFKOaf90x3 38l3WwgjLvgnp4pBXHNBZ95lKyAdIkowCg9zl+tmiLvDiOdvhJlFTYjbA6wIsd8fJF1u TIDEcHRbHfytE3NMWkLYsN7tGoPUP+OO7wiBCkvy2j/PrIbkFgYz8TxucqZZxVtfXHQS 299mMa26SzoYv0aWvqEfri30oWcmQEGgvKcoYeDCHPJAKs3ZXYXF2//hFm78WaAZl8Uq kLNQ== X-Gm-Message-State: APjAAAVMgN4X8GGrpAzjfWX8JZ6l7MJL2bWFDq7G3p9zGVZ/In1jM7oO OY9olhoIZU8D9QbcWYIBmxz1GQ== X-Google-Smtp-Source: APXvYqzgAtePr0AcvBIHIgYYoitvuVsw6jcSJ9brktEkqxjpR25748XR3NGgenBIxV1udDOTUp4KUQ== X-Received: by 2002:aed:3b6e:: with SMTP id q43mr4191612qte.57.1578692143778; Fri, 10 Jan 2020 13:35:43 -0800 (PST) Received: from nimloth.alvh.no-ip.org ([179.56.30.174]) by smtp.gmail.com with ESMTPSA id l62sm1477636qke.12.2020.01.10.13.35.43 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Fri, 10 Jan 2020 13:35:43 -0800 (PST) Received: by nimloth.alvh.no-ip.org (Postfix, from userid 1000) id 344DF30082D; Fri, 10 Jan 2020 18:35:41 -0300 (-03) Date: Fri, 10 Jan 2020 18:35:41 -0300 From: Alvaro Herrera To: Dilip Kumar Cc: Amit Kapila , Michael Paquier , Tomas Vondra , Peter Eisentraut , PostgreSQL Hackers Subject: Re: PATCH: logical_work_mem and logical streaming of large in-progress transactions Message-ID: <20200110213541.GA30138@alvherre.pgsql> MIME-Version: 1.0 Content-Type: text/plain; charset=iso-8859-1 Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: User-Agent: Mutt/1.10.1 (2018-07-13) List-Id: List-Help: List-Subscribe: List-Post: List-Owner: List-Archive: Precedence: bulk Here's a rebase of this patch series. I didn't change anything except 1. disregard what was 0005, since I already pushed it. 2. roll 0003 into 0002. 3. rebase 0007 (now 0005) to account for the reorderbuffer changes. (I did notice that 0005 adds a new boolean any_data_sent, which is silly -- it should be another txn_flags bit.) However, tests don't pass for me; notably, test_decoding crashes. OTOH I noticed that the streamed transaction support in test_decoding writes the XID to the output, which is going to make it useless for regression testing. It probably should not emit the numerical values. -- Álvaro Herrera https://www.2ndQuadrant.com/ PostgreSQL Development, 24x7 Support, Remote DBA, Training & Services