Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtp (Exim 4.84_2) (envelope-from ) id 1d2rx0-0007Tw-0u for pgsql-performance@arkaria.postgresql.org; Tue, 25 Apr 2017 04:19:42 +0000 Received: from localhost ([127.0.0.1] helo=postgresql.org) by malur.postgresql.org with smtp (Exim 4.84_2) (envelope-from ) id 1d2rwz-0002hc-8T for pgsql-performance@arkaria.postgresql.org; Tue, 25 Apr 2017 04:19:41 +0000 Received: from magus.postgresql.org ([2a02:c0:301:0:ffff::29]) by malur.postgresql.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_CBC_SHA384:256) (Exim 4.84_2) (envelope-from ) id 1d2rvA-0004zw-Uf; Tue, 25 Apr 2017 04:17:48 +0000 Received: from out4-smtp.messagingengine.com ([66.111.4.28]) by magus.postgresql.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_CBC_SHA384:256) (Exim 4.84_2) (envelope-from ) id 1d2rv8-0003C9-Nc; Tue, 25 Apr 2017 04:17:48 +0000 Received: from compute5.internal (compute5.nyi.internal [10.202.2.45]) by mailout.nyi.internal (Postfix) with ESMTP id 6788520B23; Tue, 25 Apr 2017 00:17:45 -0400 (EDT) Received: from frontend2 ([10.202.2.161]) by compute5.internal (MEProxy); Tue, 25 Apr 2017 00:17:45 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=content-type:date:from:message-id :mime-version:subject:to:x-me-sender:x-me-sender:x-sasl-enc :x-sasl-enc; s=fm1; bh=c5vi6VDTG/yDY9b5donlyIiwM1HUOXzNru0sJLWbA WM=; b=K15rrDTL4qLYhQsx95s+IUyLPmt4NX/s0dhdGqS6Fw1felOKfJwHXliV2 Kv8bRZFuJZFP/lcFVm+TNWO0MG37F2gEQ1OdGi75+MlBjzH420n8sOCZELFPdhV4 4JLq8AwBNVgHeSDJ4aiEO0KQgL5N49msSEFje38ZQx9T+mGJixNhf0Ij4bkKGEAU jGeCmuY4ycXEFyTMRQ2FIOExIZb/YvfkYprUo/V80L6+xd+66AHT6hMUHeiZfSU1 1rZf0a00F/L9FfpoYqHBx6qWbLfBKZomQ0QXGNrvJ2fi9SZAP3UxDWmKRHXpGfOw 2ZEU4ZEpK/brN9q7vD+t1+1S3Aoqg== X-ME-Sender: X-Sasl-enc: lgefW1cJbO3EXqh0TAHdpydhe4h5/LY3rQfh2HDnn725 1493093865 Received: from intern.anarazel.de (unknown [136.24.76.72]) by mail.messagingengine.com (Postfix) with ESMTPA id 24342241E1; Tue, 25 Apr 2017 00:17:45 -0400 (EDT) Date: Mon, 24 Apr 2017 21:17:43 -0700 From: Andres Freund To: pgsql-general@postgresql.org, pgsql-performance@postgresql.org Subject: Questionaire: Common WAL write rates on busy servers. Message-ID: <20170425041743.ddabv2mwevcmtx5a@alap3.anarazel.de> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline X-Pg-Spam-Score: -2.6 (--) List-Archive: List-Help: List-ID: List-Owner: List-Post: List-Subscribe: List-Unsubscribe: X-Mailing-List: pgsql-performance Precedence: bulk Sender: pgsql-performance-owner@postgresql.org Hi, I've lately seen more and more installations where the generation of write-ahead-log (WAL) is one of the primary bottlenecks. I'm curious whether that's primarily a "sampling error" of mine, or whether that's indeed more common. The primary reason I'm curious is that I'm pondering a few potential optimizations, and would like to have some guidance which are more and which are less important. Questions (answer as many you can comfortably answer): - How many MB/s, segments/s do you see on busier servers? - What generates the bulk of WAL on your servers (9.5+ can use pg_xlogdump --stats to compute that)? - Are you seeing WAL writes being a bottleneck?OA - What kind of backup methods are you using and is the WAL volume a problem? - What kind of replication are you using and is the WAL volume a problem? - What are your settings for wal_compression, max_wal_size (9.5+) / checkpoint_segments (< 9.5), checkpoint_timeout and wal_buffers? - Could you quickly describe your workload? Feel free to add any information you think is pertinent ;) Greetings, Andres Freund -- Sent via pgsql-performance mailing list (pgsql-performance@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-performance