Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtp (Exim 4.84_2) (envelope-from ) id 1d4GS7-0000YA-RZ for pgsql-performance@arkaria.postgresql.org; Sat, 29 Apr 2017 00:41:36 +0000 Received: from localhost ([127.0.0.1] helo=postgresql.org) by malur.postgresql.org with smtp (Exim 4.84_2) (envelope-from ) id 1d4GS6-0007Ge-1C for pgsql-performance@arkaria.postgresql.org; Sat, 29 Apr 2017 00:41:34 +0000 Received: from magus.postgresql.org ([2a02:c0:301:0:ffff::29]) by malur.postgresql.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_CBC_SHA384:256) (Exim 4.84_2) (envelope-from ) id 1d4GS5-0007GJ-HI for pgsql-performance@postgresql.org; Sat, 29 Apr 2017 00:41:33 +0000 Received: from mail-wr0-x235.google.com ([2a00:1450:400c:c0c::235]) by magus.postgresql.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_CBC_SHA1:256) (Exim 4.84_2) (envelope-from ) id 1d4GRw-0002f8-AR for pgsql-performance@postgresql.org; Sat, 29 Apr 2017 00:41:31 +0000 Received: by mail-wr0-x235.google.com with SMTP id l50so41077495wrc.3 for ; Fri, 28 Apr 2017 17:41:24 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=2ndquadrant-com.20150623.gappssmtp.com; s=20150623; h=subject:to:references:cc:from:message-id:date:user-agent :mime-version:in-reply-to:content-transfer-encoding; bh=52TCqoP4/5lzFOxqxtAYOJIfcCuI1QDC3/jtjTrQ6N8=; b=ui9dLxxHvKRdqO3VEmE0rAig2holx0eDh7JLiqq8OIb6L37ifTf8wOG4RV01dscf1I 85UmCVzCx8MrbXdIw+SWs1cwViHsIAKWLzXSRVI307hZHNEwILwTx912fUu8SNZ5N+Ei eH+JHwAjRyjv//DAxkpJT+iyV9rCNnkNCU25/cF3Nt5yWxxkP2+IGgLyt2mSf0nN9x0D 8Vob3Cjyvov9/3rYl+QYxrn/1GVUED6AXbofAeYUaX3o0E5ONRuio5XdoGHMCMTdIkz8 fJlbKRICxirbtf4Jew8vn4h4NDuSFvSKTC83hDcepm7PSLmKJUJdtt3DcYxJ/IYFeEkA vmSQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:subject:to:references:cc:from:message-id:date :user-agent:mime-version:in-reply-to:content-transfer-encoding; bh=52TCqoP4/5lzFOxqxtAYOJIfcCuI1QDC3/jtjTrQ6N8=; b=iPjuO+TZJfDFmKcdSbba/j1aA+lh/mFY8rDCNIJ0myT2Wl1yz+hOpo0H22TK2AWLWz ui1HTYHFynVrXH9ZA5pYyz20fFR8u83mB7y2kIleSZIrYVfp1KMlaHalxy7TUKH1eizz GYDelA4S2Qs3lVKcTxYgtwJbT5ilGZIDHzlJoRI18TFCZQmLdovF2q/FW1tGlX0NSG36 l1pXyuK+SMXk/aodrUI5Hkp9x34ktH/WwW3fNDzDnVKzILpYKiLs9biHlNflN51VB7WX reF5Pup5N+l1CpJMd0dwO6eJzVeCqZGVSRqfuV9V9qJ+oDR6JQPn7H2ckU2Fes1UwOxA ZfUw== X-Gm-Message-State: AN3rC/7SBhIdy1hIpX1VYbpomARQzm7fgYbYbtAoxaOjL9RzgggDuEut PyHN8a6JWVm3FqPDLyQXIBShgQTYXOprx+qE2z9c1MTDj4GbJ397zQKRLVxsSlsN/I0KM8ljVOO gEpWBi6qOBJrJaHfqmn2neT0YKDbTAapR33Kt93QmQ42hNvk1tRJ3XVzoZYAkuNY4VeidGoPTYr smOA== X-Received: by 10.223.149.68 with SMTP id 62mr5466742wrs.7.1493426483370; Fri, 28 Apr 2017 17:41:23 -0700 (PDT) Received: from [10.137.2.17] (ip-89-177-46-65.net.upcbroadband.cz. [89.177.46.65]) by smtp.gmail.com with ESMTPSA id g90sm9372490wrd.11.2017.04.28.17.41.22 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Fri, 28 Apr 2017 17:41:22 -0700 (PDT) Subject: Re: Questionaire: Common WAL write rates on busy servers. To: Andres Freund References: <20170425041743.ddabv2mwevcmtx5a@alap3.anarazel.de> <20170427155906.uudovtd62x56brmx@alap3.anarazel.de> <20170427163407.dtqi6v57bj4tiu5c@alap3.anarazel.de> <80f280c1-910f-7eae-33a2-fd0cfc9ee8c9@commandprompt.com> <20170427173540.fqaucmclpowfy5n7@alap3.anarazel.de> <20170427233433.eg5vwlvbqyc2nruh@alap3.anarazel.de> Cc: "Joshua D. Drake" , pgsql-general@postgresql.org, pgsql-performance@postgresql.org From: Tomas Vondra Message-ID: <48afdba3-3429-de92-6fa8-36e2ebe5fd03@2ndquadrant.com> Date: Sat, 29 Apr 2017 02:41:19 +0200 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:45.0) Gecko/20100101 Thunderbird/45.4.0 MIME-Version: 1.0 In-Reply-To: <20170427233433.eg5vwlvbqyc2nruh@alap3.anarazel.de> Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit X-Pg-Spam-Score: -1.9 (-) List-Archive: List-Help: List-ID: List-Owner: List-Post: List-Subscribe: List-Unsubscribe: X-Mailing-List: pgsql-performance Precedence: bulk Sender: pgsql-performance-owner@postgresql.org On 04/28/2017 01:34 AM, Andres Freund wrote: > On 2017-04-28 01:29:14 +0200, Tomas Vondra wrote: >> I can confirm this observation. I bought the Intel 750 NVMe SSD last year, >> the device has 1GB DDR3 cache on it (power-loss protected), can do ~1GB/s of >> sustained O_DIRECT sequential writes. But when running pgbench, I can't push >> more than ~300MB/s of WAL to it, no matter what I do because of >> WALWriteLock. > > Hm, interesting. Even if you up wal_buffers to 128MB, use > synchronous_commit = off, and play with wal_writer_delay/flush_after? > I think I've tried things like that, but let me do some proper testing. I'll report the numbers in a few days. regards -- Tomas Vondra http://www.2ndQuadrant.com PostgreSQL Development, 24x7 Support, Remote DBA, Training & Services -- Sent via pgsql-performance mailing list (pgsql-performance@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-performance