Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtp (Exim 4.84_2) (envelope-from ) id 1cW5xC-00021a-Vo for pgsql-hackers@arkaria.postgresql.org; Tue, 24 Jan 2017 18:36:27 +0000 Received: from localhost ([127.0.0.1] helo=postgresql.org) by malur.postgresql.org with smtp (Exim 4.84_2) (envelope-from ) id 1cW5xC-0004LR-6H for pgsql-hackers@arkaria.postgresql.org; Tue, 24 Jan 2017 18:36:26 +0000 Received: from makus.postgresql.org ([2001:4800:1501:1::229]) by malur.postgresql.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_CBC_SHA384:256) (Exim 4.84_2) (envelope-from ) id 1cW5xB-0004LK-6b for pgsql-hackers@postgresql.org; Tue, 24 Jan 2017 18:36:25 +0000 Received: from mail-ua0-x234.google.com ([2607:f8b0:400c:c08::234]) by makus.postgresql.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_CBC_SHA1:256) (Exim 4.84_2) (envelope-from ) id 1cW5x7-0005aD-Vz for pgsql-hackers@postgresql.org; Tue, 24 Jan 2017 18:36:23 +0000 Received: by mail-ua0-x234.google.com with SMTP id 35so140678622uak.1 for ; Tue, 24 Jan 2017 10:36:21 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=2ndquadrant-com.20150623.gappssmtp.com; s=20150623; h=date:from:to:cc:subject:message-id:mime-version:content-disposition :content-transfer-encoding:in-reply-to:user-agent; bh=4DFjRznPST5DriYFzC4q8JnflSxWuaU0x2dF5wnAdek=; b=nk5CnsSpS1fZL2RvCaeNmIqcIzInRmx+fv03/NO4bX1u22QW7f9XasR+1wosIvtPe2 DSrHCLadBFVuFz7t8kWwh6wCPEgWOnudy6tmSFDU8p71anHcgwsz6vBjawYekbBavB1U zt5uo1JXgoe5+CadqtaPT2NcmnUMfYPhhXpAzoM9cLw5cUGq7A/Gzq9j+MfYF7Gphjol ndcWBJAhUFKEWD/ev5Hwog+pRI1MYTPOX2ofGkP5jqkT10LhlkyTgWhjCtXCoATEygJI aEdXthuIhDgGSdL2tztz6qA2Gg1Cxss8rResORVldcjrdbWghiHhIUguz6+KjKry2mqk s4tQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:date:from:to:cc:subject:message-id:mime-version :content-disposition:content-transfer-encoding:in-reply-to :user-agent; bh=4DFjRznPST5DriYFzC4q8JnflSxWuaU0x2dF5wnAdek=; b=dqLosV3KSuMHDoN3dh1CZhdV/RvFglaXkcElOmXGaHY6GIpF8f/C9HAFC6LxU8mOK6 NYJ5EvkfqRX2oZxHE/BT7x5de3BHy3uPAL9bTGQNGicx5szeROPxHnjjVqC3uHVhA0pc oBGwa9lo4Oy6qHAmxECapLwoXkw9jwd7Nnn0YiZJouG3QJo3i6E1rG8ESxRMASxIQ0gy lcvEOSjp4mSCpL7yeLL/oaGH3f6S30LyuFo3kRHQ7iCtjlVLdv51smirQ/fW6oqbnhsK EZdmf24M0pKOB7UFLeTvRNNQ1RhOYmt9CG/Kk+1nXCSA+sxsIi8XBeCnJ9PqxdFocmzU 8hwQ== X-Gm-Message-State: AIkVDXIK3Bs419m5sY0/LMdIBr0zJK8FloXi4kmpY39y4KjvdcWRvYcHyDDMAcFIwLsR5YlK X-Received: by 10.159.36.39 with SMTP id 36mr18945487uaq.146.1485282980681; Tue, 24 Jan 2017 10:36:20 -0800 (PST) Received: from alvin.alvh.no-ip.org ([186.9.129.53]) by smtp.gmail.com with ESMTPSA id z79sm8012952vkd.12.2017.01.24.10.36.20 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Tue, 24 Jan 2017 10:36:20 -0800 (PST) Received: by alvin.alvh.no-ip.org (Postfix, from userid 1000) id EE3E5E13; Tue, 24 Jan 2017 15:36:13 -0300 (CLST) Date: Tue, 24 Jan 2017 15:36:13 -0300 From: Alvaro Herrera To: Tobias Oberstein Cc: Andres Freund , pgsql-hackers@postgresql.org Subject: Re: lseek/read/write overhead becomes visible at scale .. Message-ID: <20170124183613.cbb47nqbvso4rvjb@alvherre.pgsql> MIME-Version: 1.0 Content-Type: text/plain; charset=iso-8859-1 Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: User-Agent: NeoMutt/20170113 (1.7.2) X-Pg-Spam-Score: -1.9 (-) List-Archive: List-Help: List-ID: List-Owner: List-Post: List-Subscribe: List-Unsubscribe: X-Mailing-List: pgsql-hackers Precedence: bulk Sender: pgsql-hackers-owner@postgresql.org Tobias Oberstein wrote: > I am benchmarking IOPS, and while doing so, it becomes apparent that at > these scales it does matter _how_ IO is done. > > The most efficient way is libaio. I get 9.7 million/sec IOPS with low CPU > load. Using any synchronous IO engine is slower and produces higher load. > > I do understand that switching to libaio isn't going to fly for PG > (completely different approach). Maybe it is possible to write a new f_smgr implementation (parallel to md.c) that uses libaio. There is no "seek" in that interface, at least, though the interface does assume that the implementation is blocking. -- Álvaro Herrera https://www.2ndQuadrant.com/ PostgreSQL Development, 24x7 Support, Remote DBA, Training & Services -- Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-hackers