Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtps (TLS1.3:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1mHF18-0002rg-0E for pgsql-hackers@arkaria.postgresql.org; Sat, 21 Aug 2021 00:37:46 +0000 Received: from localhost ([127.0.0.1] helo=malur.postgresql.org) by malur.postgresql.org with esmtp (Exim 4.92) (envelope-from ) id 1mHF15-0001bC-Vl for pgsql-hackers@arkaria.postgresql.org; Sat, 21 Aug 2021 00:37:43 +0000 Received: from makus.postgresql.org ([2001:4800:3e1:1::229]) by malur.postgresql.org with esmtps (TLS1.3:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1mHF14-0001aY-Ik for pgsql-hackers@lists.postgresql.org; Sat, 21 Aug 2021 00:37:43 +0000 Received: from out3-smtp.messagingengine.com ([66.111.4.27]) by makus.postgresql.org with esmtps (TLS1.3:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1mHF0x-0002mw-Go for pgsql-hackers@lists.postgresql.org; Sat, 21 Aug 2021 00:37:41 +0000 Received: from compute1.internal (compute1.nyi.internal [10.202.2.41]) by mailout.nyi.internal (Postfix) with ESMTP id 43BE45C00A3; Fri, 20 Aug 2021 20:37:34 -0400 (EDT) Received: from mailfrontend1 ([10.202.2.162]) by compute1.internal (MEProxy); Fri, 20 Aug 2021 20:37:34 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=paquier.xyz; h= date:from:to:cc:subject:message-id:references:mime-version :content-type:in-reply-to; s=fm2; bh=TXiQlPmX8hb7Ssm1l9BLK6x1XiX P4OYUmS+6ob7197k=; b=VE/GRB2TRAdhxhmhlB5QpCNoLRY9LoRPbQZcydv0O0u BbGKr1bZrV87d4JdPbMsmmkc0KKd+9lpOrXXTNX/twgIiIL4yQ/x5TiHFensZsfZ e4NvTrTVriYwX8ZmRjw5M44Rz8P/KqNUYpoxiYgWPNUK4eqvRpA3OamBzEvkRgYk 9Lsw62MLVbaTmk8rUldgRTi8iAzRXPw1RZ6sZMVHhZWH2tyQ1VVFWOOcHNwCOaHc KvJ/V73EZHIEyNPxGwy7ypjT43iSS8fq1cVwo160iZgC0fwAXsAkLQnwroJtOj1y HcuJDgx1DsRTctyNL+pJiEz7CBFGjnPvdjZjarPbVhQ== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=cc:content-type:date:from:in-reply-to :message-id:mime-version:references:subject:to:x-me-proxy :x-me-proxy:x-me-sender:x-me-sender:x-sasl-enc; s=fm3; bh=TXiQlP mX8hb7Ssm1l9BLK6x1XiXP4OYUmS+6ob7197k=; b=tPEXBViyTMgNwLSZhABsMm h1gLklpwOj6fjIaGae8zJ1tIGnXoTD1Y1mwjk17uX2iLhhMNxYHZFaDgwCeXE5MB Y+ckY7Icbt5HKUozUz0XQLNQTyvpiVBC7slGXduIpaTTRfOy8X4uxypiTchIBXj4 bO+Dyd9Jusc1q8N+FqaGvw5Qc9ekOBNL+MwjzP1eKgNHKcjZrvOnoFF9qvURXJ84 DY8q1dx3c1vEurQ2e5GTGfOLkmQZL9bN2TAMF8qpeDkZPyNps5DNgJlCvLnYL/4K rEDzDROTMwZVjBvv2yIJMvB6mHQPoyKP+4QK1srmUazgecmkT3u56Jm53j+KgxlQ == X-ME-Sender: X-ME-Received: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgedvtddruddttddgfeehucetufdoteggodetrfdotf fvucfrrhhofhhilhgvmecuhfgrshhtofgrihhlpdfqfgfvpdfurfetoffkrfgpnffqhgen uceurghilhhouhhtmecufedttdenucesvcftvggtihhpihgvnhhtshculddquddttddmne gfrhhlucfvnfffucdlfeehmdenucfjughrpeffhffvuffkfhggtggujgesghdtreertddt vdenucfhrhhomhepofhitghhrggvlhcurfgrqhhuihgvrhcuoehmihgthhgrvghlsehprg hquhhivghrrdighiiiqeenucggtffrrghtthgvrhhnpeetudfgteeuleethfdtfeeihffg tdetffekieelieeijeejteethfejtdetfeefkeenucffohhmrghinhepghhithhhuhgsrd gtohhmnecuvehluhhsthgvrhfuihiivgeptdenucfrrghrrghmpehmrghilhhfrhhomhep mhhitghhrggvlhesphgrqhhuihgvrhdrgiihii X-ME-Proxy: Received: by mail.messagingengine.com (Postfix) with ESMTPA; Fri, 20 Aug 2021 20:37:31 -0400 (EDT) Date: Sat, 21 Aug 2021 09:37:26 +0900 From: Michael Paquier To: Ronan Dunklau Cc: Magnus Hagander , pgsql-hackers@lists.postgresql.org, Alvaro Herrera Subject: Re: Proposal: More structured logging Message-ID: References: <202108191450.7vik45yrlwle@alvherre.pgsql> <6062364.BDNAq9uPBk@aivenronan> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha512; protocol="application/pgp-signature"; boundary="vazQhqT0DeHGnteT" Content-Disposition: inline In-Reply-To: <6062364.BDNAq9uPBk@aivenronan> List-Id: List-Help: List-Subscribe: List-Post: List-Owner: List-Archive: Archived-At: Precedence: bulk --vazQhqT0DeHGnteT Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Fri, Aug 20, 2021 at 11:35:29AM +0200, Ronan Dunklau wrote: > Michael, your jsonlog module already fullfills this need. Is it something= that=20 > should be merged into our tree ? Yes, there is nothing technically preventing to have this stuff in core, of course, and that would even take care of the issues in detecting if the piping protocol should be used or not. Now, the last time this was proposed, there was a lot of drawback because the presence of the JSON keys increases significantly the size of the logs compared to CSV, and usually users care a lot about the size of the log files. I would support the presence of JSON format for the logs in core, FWIW. The module is here, for reference: https://github.com/michaelpq/pg_plugins/tree/master/jsonlog -- Michael --vazQhqT0DeHGnteT Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQIzBAABCgAdFiEEG72nH6vTowiyblFKnvQgOdbyQH0FAmEgSsYACgkQnvQgOdby QH35/A//d8Gxg0CZ9r5cP8E+N5IX7luqFKaUg6BFYN6aH75P05NYbo3q3nfMKiYl Ug1+0rAMxGx07KJkZOL+pA38vgjxm9Zz2p05S0MGWPOrgfIQorAb98j1Kp/vE5mh BzLS8kndA7+U006KOfcXGziXGFitXTsL82lCV6+866Pou+o1FqLGS76RMtY+0yXm ozC+33wHuWO2rTfXvfc5bIVpC56lIY0G6UXrFoT7h8CYUOWY3oWufMzT5IC1GKZN Y+ucUgXwfZX4kzAOmFB5+cn+1Pq0vVYz/lLQRyTaLkeSG41CmmLLXtzi64pUee8a ge30LLWuviOCL6C39Gu8b4kZjSs5kGBQ4Adtvd0yLvC00KSJlVe0WutEhhsrh3H5 tNeyKZozL+lyy+KkFIVcB5yvP8thMglyv2IKlxGlth2lEzBfZnjC0X4tpL/1VL9X 6GgAbLfWEhzaIFqxJ5SQnadkzMOwUB1/5VH1a7Q5kwOPfrOoBfZbTiKBm+XaCe9G O36db3Tz3rhNUfRId6QKKRncOvuNFnH0Vw66Ucvi2n+gSCjasXifMTfClYvu4HGb vz/tCY/bbFNH7GwQfWCSqXmM6hokIQK9CxYCTCYOtEBC3p5ks1tIlgR0teTsswFZ IQsB3krCt+pGIYZDVgctD+7m4pfAzMLDjmbFhSEoDHdrhJimnZk= =hIBw -----END PGP SIGNATURE----- --vazQhqT0DeHGnteT--