Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_CBC_SHA1:256) (Exim 4.89) (envelope-from ) id 1h2Oca-0002l7-Gq for pgsql-admin@arkaria.postgresql.org; Fri, 08 Mar 2019 23:09:44 +0000 Received: from localhost ([127.0.0.1] helo=malur.postgresql.org) by malur.postgresql.org with esmtp (Exim 4.89) (envelope-from ) id 1h2OcZ-0006tB-9v for pgsql-admin@arkaria.postgresql.org; Fri, 08 Mar 2019 23:09:43 +0000 Received: from magus.postgresql.org ([2a02:c0:301:0:ffff::29]) by malur.postgresql.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_CBC_SHA1:256) (Exim 4.89) (envelope-from ) id 1h2OcZ-0006t4-27 for pgsql-admin@lists.postgresql.org; Fri, 08 Mar 2019 23:09:43 +0000 Received: from sss.pgh.pa.us ([66.207.139.130]) by magus.postgresql.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_CBC_SHA1:256) (Exim 4.89) (envelope-from ) id 1h2OcW-00051Q-I1 for pgsql-admin@postgresql.org; Fri, 08 Mar 2019 23:09:42 +0000 Received: from sss1.sss.pgh.pa.us (localhost [127.0.0.1]) by sss.pgh.pa.us (8.14.4/8.14.4) with ESMTP id x28N9b1u022235; Fri, 8 Mar 2019 18:09:37 -0500 From: Tom Lane To: Mark Steben cc: pgsql-admin Subject: Re: sysout error log being truncated In-reply-to: References: Comments: In-reply-to Mark Steben message dated "Fri, 08 Mar 2019 17:22:16 -0500" MIME-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-ID: <22233.1552086577.1@sss.pgh.pa.us> Date: Fri, 08 Mar 2019 18:09:37 -0500 Message-ID: <22234.1552086577@sss.pgh.pa.us> List-Id: List-Help: List-Subscribe: List-Post: List-Owner: List-Archive: Precedence: bulk Mark Steben writes: > One of our transactions is a queue processor that generates a ton of insert > statements per run of this transaction - as many as 1000 per run. > What has happened in new datacenter is that these transactions - while > running correctly and completely - do not write all the insert statements > to our sysout log - only some. Most, if not all, implementations of syslog will drop messages under sufficient load; I think they consider that a feature. It's not Postgres' fault and there's nothing we can do about it. Use a different logging mechanism if you can't afford to lose any messages. regards, tom lane