Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtps (TLS1.3:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1kNpxo-0002eK-9F for pgsql-hackers@arkaria.postgresql.org; Thu, 01 Oct 2020 04:13:04 +0000 Received: from localhost ([127.0.0.1] helo=malur.postgresql.org) by malur.postgresql.org with esmtp (Exim 4.92) (envelope-from ) id 1kNpxn-0005MU-6S for pgsql-hackers@arkaria.postgresql.org; Thu, 01 Oct 2020 04:13:03 +0000 Received: from makus.postgresql.org ([2001:4800:3e1:1::229]) by malur.postgresql.org with esmtps (TLS1.3:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1kNpxm-0005MM-VX for pgsql-hackers@lists.postgresql.org; Thu, 01 Oct 2020 04:13:02 +0000 Received: from wout5-smtp.messagingengine.com ([64.147.123.21]) by makus.postgresql.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1kNpxk-0001Gb-U5 for pgsql-hackers@postgresql.org; Thu, 01 Oct 2020 04:13:02 +0000 Received: from compute1.internal (compute1.nyi.internal [10.202.2.41]) by mailout.west.internal (Postfix) with ESMTP id 770773CA; Thu, 1 Oct 2020 00:12:59 -0400 (EDT) Received: from mailfrontend1 ([10.202.2.162]) by compute1.internal (MEProxy); Thu, 01 Oct 2020 00:12:59 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=paquier.xyz; h= date:from:to:cc:subject:message-id:references:mime-version :content-type:in-reply-to; s=fm2; bh=+4N7ZIdS/QCDfqijxJaD0FrzQ2O GER1vH5NYgSRsOlw=; b=Zrl70oFfdII9UrfQntAnfFugByZn4GoMRoserMTk5UZ 9KQ1T1wIPR4O3VBCnLunrbG1tZ/OJ21c4mnnvlRB8q1bXi84IA86k69EbkX/bGyO mH/LEN4Aeq7FmUFQCmYA1fWy7r64pwFomr+SBZc4JoCB6vCM/N+eeOPD3k4egejn Z4+20wj1JtBPsEQlKmly+c4qBl1aS0pQZiz2PY+CEgg27hly6CFt69nZq5KS7x/a FXjZP7oZXqZS82h4mscDM2u1+R4JHfpQ0F4rTkMJF8zVLvMoQX4SvSQoOSNnrV9q tQKH/36cZzYFy8GWCjt+JHKdGbheTagbI6FQeIkWSIQ== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=cc:content-type:date:from:in-reply-to :message-id:mime-version:references:subject:to:x-me-proxy :x-me-proxy:x-me-sender:x-me-sender:x-sasl-enc; s=fm3; bh=+4N7ZI dS/QCDfqijxJaD0FrzQ2OGER1vH5NYgSRsOlw=; b=W6fDUmBqhozjHgqJi6vv4Y rPNIpXHz3W2ff72DN4RxIOC018LfZSESzKRp5Twgjqi9f4uYR5CmtJZ80ad2wyFZ RSCOVJ1HdY5gNDTE2SBbQ22RIrG4TgMkvIz4QwWY/0HJxZgSFv9kB21FiW+YFT+S x31IuI2hLopVx0LtkmrQ6suCvOScb6PmigPhHbSDs2kz8u/xvOMuL+IzhffnySpE MLcazpPSRNZEaRSWmJ/RdSM1e6y0j9XJMmMZX3aI9db4GoC+eADhPxxnU6fqg87c rNbg9tKDFemN+qe3vQn9O4ZXSEMJ5uOztI1MO4JBtjUfilW2E0rv8tCMJpClSVvg == X-ME-Sender: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgedujedrfeefgdekfecutefuodetggdotefrodftvf curfhrohhfihhlvgemucfhrghsthforghilhdpqfgfvfdpuffrtefokffrpgfnqfghnecu uegrihhlohhuthemuceftddtnecusecvtfgvtghiphhivghnthhsucdlqddutddtmdenfg hrlhcuvffnffculdejtddmnecujfgurhepfffhvffukfhfgggtuggjsehgtderredttddv necuhfhrohhmpefoihgthhgrvghlucfrrghquhhivghruceomhhitghhrggvlhesphgrqh huihgvrhdrgiihiieqnecuggftrfgrthhtvghrnhepvdegudeuhfdtueeltedtveejheeh ieevueeigeelteegleejleeiueeiheegvefhnecukfhppeduuddurddutddvrddukedtrd dukeehnecuvehluhhsthgvrhfuihiivgeptdenucfrrghrrghmpehmrghilhhfrhhomhep mhhitghhrggvlhesphgrqhhuihgvrhdrgiihii X-ME-Proxy: Received: from paquier.xyz (ee0822lan1.rev.em-net.ne.jp [111.102.180.185]) by mail.messagingengine.com (Postfix) with ESMTPA id 1057B3280060; Thu, 1 Oct 2020 00:12:56 -0400 (EDT) Date: Thu, 1 Oct 2020 13:12:54 +0900 From: Michael Paquier To: Tomas Vondra Cc: "Andrey V. Lepikhov" , pgsql-hackers@postgresql.org Subject: Re: POC: postgres_fdw insert batching Message-ID: <20201001041254.GF8130@paquier.xyz> References: <20200628151002.7x5laxwpgvkyiu3q@development> <0300d7df-854b-6f72-1e93-dfbf98f3fc8a@postgrespro.ru> <20200712001101.x65f3hvsanvamtgj@development> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha512; protocol="application/pgp-signature"; boundary="TeJTyD9hb8KJN2Jy" Content-Disposition: inline In-Reply-To: <20200712001101.x65f3hvsanvamtgj@development> List-Id: List-Help: List-Subscribe: List-Post: List-Owner: List-Archive: Precedence: bulk --TeJTyD9hb8KJN2Jy Content-Type: text/plain; charset=us-ascii Content-Disposition: inline On Sun, Jul 12, 2020 at 02:11:01AM +0200, Tomas Vondra wrote: > Because I was focused on speeding-up inserts, and that is not using > CopyMultiInsertBuffer I think. I agree the way the tuples are stored > may be improved, of course. The CF bot is telling that the regression tests of postgres_fdw are crashing. Could you look at that? -- Michael --TeJTyD9hb8KJN2Jy Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQIzBAABCgAdFiEEG72nH6vTowiyblFKnvQgOdbyQH0FAl91V0YACgkQnvQgOdby QH1sRQ/7B4/OGLkeq8M/AQuFgFEuhgOxFWJQ8/dH0u2meKGI2412tkiO3ubg83L8 RgUcD9VEVlDvFHvenZujx22HDvngMqxwMPs7zVQFuegBcWKBOUU2AqJ06fEsOzQT l39S2rymwY8f+6id5YeR7md2xDgi4LMOPme7jOAabpYLPuMWl9Hd32PKTcKcVTUJ SnJNAjrw9sX2HwjanTxO2GbDutpywbq0J127ybuh34xZDVJiS6b9wHaNjaTBFXnQ 8etIBV5f1vEJv8pgDlFVOxQJs5xcIXdDC/N1DVntolKM54kgon4vubx+eN5AQmak cWgT5HneQHfXcSAUvAT7NyU7UqohbXbb7Ctrv7Sq5lKa79q6l8UaNX4p4bKcZtUK y9k6YgW2WnjcANWIqHuPr485RQP4Osw0Msfcp0GvhBMjrTCKmxcECfGcO7p8p9kW MgyphfKqzZekvE1Yk06ewgv0O2Rv2nRCweu5nPd3nQnsZhIGac+c1xt2IsK/gv76 R8bdrVt05ok6sUVnWryLqFh8+EuZG3UcMc/OHa8qHVD6whiZjXKU82cTA3FsWdfe BgxPGhzQmaNesNTxTsZ3OP9bCmNzQFtCjXd+aplY9sDOMPEFVGqxfDtEtSvU+2Xn Ml89bgFkf4rB7qH7+zO8uY8TBD4/YFVrAmmRUiL+VR8yfMYmfFg= =R2Bg -----END PGP SIGNATURE----- --TeJTyD9hb8KJN2Jy--