Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtp (Exim 4.80) (envelope-from ) id 1aWno1-0007tY-7j for pgsql-admin@arkaria.postgresql.org; Fri, 19 Feb 2016 16:21:21 +0000 Received: from localhost ([127.0.0.1] helo=postgresql.org) by malur.postgresql.org with smtp (Exim 4.84) (envelope-from ) id 1aWno0-0001qT-NJ for pgsql-admin@arkaria.postgresql.org; Fri, 19 Feb 2016 16:21:20 +0000 Received: from magus.postgresql.org ([2a02:c0:301:0:ffff::29]) by malur.postgresql.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_CBC_SHA384:256) (Exim 4.84) (envelope-from ) id 1aWnmK-0006g2-0q for pgsql-admin@postgresql.org; Fri, 19 Feb 2016 16:19:36 +0000 Received: from buckeye.comp.uvic.ca ([142.104.177.230]) by magus.postgresql.org with esmtps (TLS1.0:DHE_RSA_AES_256_CBC_SHA1:256) (Exim 4.84) (envelope-from ) id 1aWnmD-0006mV-5e for pgsql-admin@postgresql.org; Fri, 19 Feb 2016 16:19:32 +0000 Received: from strike.comp.uvic.ca (strike.comp.uvic.ca [142.104.191.252]) by buckeye.comp.uvic.ca (8.14.4/8.14.3) with ESMTP id u1JGJLsa014606 for ; Fri, 19 Feb 2016 08:19:22 -0800 Subject: Re: 9.5 new setting "cluster name" and logging References: <1377186808.57546.YahooMailNeo@web193505.mail.sg3.yahoo.com> <1377494614.9111.YahooMailNeo@web193506.mail.sg3.yahoo.com> <56AC5601.5040208@uvic.ca> <20160218214202.GA30326@momjian.us> <27145.1455832381@sss.pgh.pa.us> <56C64017.7050303@uvic.ca> <56C73A39.7010609@uvic.ca> Cc: "pgsql-admin@postgresql.org" From: Evan Rempel Message-ID: <56C74081.2090605@uvic.ca> Date: Fri, 19 Feb 2016 08:19:13 -0800 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:38.0) Gecko/20100101 Thunderbird/38.4.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 7bit X-UVic-Virus-Scanned: OK - Passed virus scan by ClamAV (clamd) on buckeye X-UVic-Virus-Scanned: OK - Passed virus scan by Sophos (sophie) on buckeye X-UVic-Scan: buckeye.comp.uvic.ca filter_version 3.7.9 X-Scanned-By: MIMEDefang 2.67 on 192.168.8.82 X-Pg-Spam-Score: -3.2 (---) List-Archive: List-Help: List-ID: List-Owner: List-Post: List-Subscribe: List-Unsubscribe: X-Mailing-List: pgsql-admin Precedence: bulk Sender: pgsql-admin-owner@postgresql.org On 02/19/2016 08:10 AM, Fujii Masao wrote: > On Sat, Feb 20, 2016 at 12:52 AM, Evan Rempel wrote: >> On 02/19/2016 05:56 AM, Fujii Masao wrote: >>> On Fri, Feb 19, 2016 at 7:05 AM, Evan Rempel wrote: >>>> On 02/18/2016 01:53 PM, Tom Lane wrote: >>>>> Bruce Momjian writes: >>>>>> On Fri, Jan 29, 2016 at 10:19:45PM -0800, Evan Rempel wrote: >>>>>>> Now that there is a setting to give a cluster a "name", it would be >>>>>>> nice to have an escape sequence in the log_line_prefix setting that >>>>>>> could reference the cluster_name. >>>>>> Uh, wouldn't the cluster name be the same on every line? Is that >>>>>> useful? >>>>> I guess if you were running multiple clusters and having them all log >>>>> to the same syslog daemon, there might be multiple clusters' output >>>>> in the same log ... but we already have ways to disambiguate that case, >>>>> ie, syslog_ident. Likewise for Windows' event log. I don't think we >>>>> should consider it supported for multiple clusters to be logging into >>>>> the same plain files. So yeah, the use case for this seems unclear. >>>>> >>>>> regards, tom lane >>>> >>>> The use case is for logging to syslog. >>>> >>>> Using the syslog_ident effectively changes the "program name" to >>>> something >>>> other than postgres. This would break any type of SIEM system that would >>>> be >>>> looking for events from the program postgres. This means that if you want >>>> to >>>> have a cluster specific contextual identifier, it needs to be in the log >>>> message content, which for the purposes of postgresql means placing it >>>> into >>>> the log_line_prefix. >>>> >>>> It could be hard coded as part of the log_line_prefix such as >>>> >>>> log_line_prefix = 'cluster-db1:%d:%u:%h ' >>>> >>>> That would work, but that means that my cluster name needs to be in the >>>> configuration file twice and that opens up the error scenario of not >>>> making >>>> them exactly the same. >>>> >>>> Allowing for the cluster_name to be referenced by an escape sequence >>>> would >>>> make manual and automated configuration management easier. >>> What if log_destination is set to csvlog? The same cluster_name is >>> output in every lines, and there is no way to disable it because >>> something like csv_line_prefix has not been supported yet? >>> >>> Regards, >>> >> I would think that in the case of using a csvlog that you would configure >> the log_line_prefix to not include the escape sequence of the cluster_name. >> The administrator would tune all of the logging components to work together, >> or am I missing something here? > log_line_prefix is only for stderr and syslog, not for csvlog. > It cannot control what to output in csvlog, for now. > > Regards, In that case, my request for a new escape sequence for the log_line_prefix will have no impact on csvlog output because it would only affect uses cases where log_line_prefix is used AND where the administrator has added the cluster name into the log_line_prefix. -- Evan -- Sent via pgsql-admin mailing list (pgsql-admin@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-admin