Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtp (Exim 4.80) (envelope-from ) id 1WpIYA-0002a5-Vv for pgsql-performance@arkaria.postgresql.org; Tue, 27 May 2014 14:40:23 +0000 Received: from localhost ([127.0.0.1] helo=postgresql.org) by malur.postgresql.org with smtp (Exim 4.80) (envelope-from ) id 1WpIY9-0000gm-PR for pgsql-performance@arkaria.postgresql.org; Tue, 27 May 2014 14:40:21 +0000 Received: from magus.postgresql.org ([2a02:c0:301:0:ffff::29]) by malur.postgresql.org with esmtps (TLS1.2:DHE_RSA_AES_256_CBC_SHA256:256) (Exim 4.80) (envelope-from ) id 1WpIY6-0000bH-Pm for pgsql-performance@postgresql.org; Tue, 27 May 2014 14:40:18 +0000 Received: from tamriel.snowman.net ([2001:4830:167b::11]) by magus.postgresql.org with esmtp (Exim 4.80) (envelope-from ) id 1WpIY2-0006pf-NF for pgsql-performance@postgresql.org; Tue, 27 May 2014 14:40:17 +0000 Received: by tamriel.snowman.net (Postfix, from userid 1000) id CAE4E5F7A4; Tue, 27 May 2014 10:40:13 -0400 (EDT) Date: Tue, 27 May 2014 10:40:13 -0400 From: Stephen Frost To: Heikki Linnakangas Cc: Albe Laurenz , "pgsql-performance@postgresql.org" Subject: Re: NFS, file system cache and shared_buffers Message-ID: <20140527144013.GL2556@tamriel.snowman.net> References: <53848490.6060001@vmware.com> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="wGWNoIaOw0YJ68hZ" Content-Disposition: inline In-Reply-To: <53848490.6060001@vmware.com> X-Editor: Vim http://www.vim.org/ X-Info: http://www.snowman.net X-Operating-System: Linux/3.11.0-19-generic (x86_64) X-Uptime: 10:37:29 up 49 days, 56 min, 7 users, load average: 0.14, 0.14, 0.08 User-Agent: Mutt/1.5.21 (2010-09-15) X-Pg-Spam-Score: -2.6 (--) List-Archive: List-Help: List-ID: List-Owner: List-Post: List-Subscribe: List-Unsubscribe: X-Mailing-List: pgsql-performance Precedence: bulk Sender: pgsql-performance-owner@postgresql.org --wGWNoIaOw0YJ68hZ Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable * Heikki Linnakangas (hlinnakangas@vmware.com) wrote: > On 05/27/2014 02:06 PM, Albe Laurenz wrote: > >I just learned that NFS does not use a file system cache on the client s= ide. > > > >On the other hand, PostgreSQL relies on the file system cache for perfor= mance, > >because beyond a certain amount of shared_buffers performance will suffe= r. > > > >Together these things seem to indicate that you cannot get good performa= nce > >with a large database over NFS since you can leverage memory speed. > > > >Now I wonder if there are any remedies (CacheFS?) and what experiences > >people have made with the performance of large databases over NFS. >=20 > I have no personal experience with NFS, but sounds like a > higher-than-usual shared_buffers value would be good. It would certainly be worthwhile to test it. In the end you would, hopefully, end up with a situation where you're maximizing RAM usage- the NFS server is certainly caching in *its* filesystem cache, while on the PG server you're getting the benefit of shared_buffers without the drawback of double-buffering (since you couldn't ever use the NFS server's memory for shared_buffers anyway). All that said, there has always been a recommendation of caution around using NFS as a backing store for PG, or any RDBMS.. Thanks, Stephen --wGWNoIaOw0YJ68hZ Content-Type: application/pgp-signature; name="signature.asc" Content-Description: Digital signature -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.14 (GNU/Linux) iQIcBAEBAgAGBQJThKPNAAoJEO1sijiDR2RVt3gQAJcj1hsqm0QqyTzWfLKvSvdW cXN9OKBofXe3+pCmuzp3DTvjXNj9fes/8Ce582jKiYADOFeCnIMIe8OKTnYqgpUp YlbJA8ehD1aA0WvnIneyTWjzmEe4/tYjnaqKUxgUccdSRYzcQHfhiH2yfUoP37Dh wfks6EKsGQOMC4Iiui+wP58/62Y3FiRa78ONBXdQTCYOWTMwOj15hB2La1TVBaLd SCoZBOabWl5LDPny76BqQF114vFrl+xXYOvYjfqut711V5FhFEVorNXYp/SsgiMG 5jYMbHBSa9VVrXFsUC4a4ZawY5Y7MrOphV7dWwM2xIYUuHfg7KlP5CP4CGcWStgA RoI3tTVokqPZ/h8BWkGbIRUDo4wGp8RUkmw6BzHfkEGw6ljLs8SwI3cY5AEU/rTw sB6mvUiEOkQAR9hhpXbrsRYOGwQhCjvI9uT/Zbp9XFgLx2PWIg6RDBxXSauSB66r tmtLg/Hj0Gwwj92M3bIzMFmRJ/REhWAAA3/KV6vcxXeqmH1eQV9XRTwYTFN42yjb SdSghc3UXJUph4tOxiuUyKEj12XWfR4fkZrYG+GMOilJkOLb07L4Mwmnue0CGq7v I1xd8cp4jROwJHFeu31wI9bFskcfkw0SzNHdGD7/ipruR9P4qcxNlUxVoh83+rhq YIXuQycZfSA8jRuaKe9N =3Lrb -----END PGP SIGNATURE----- --wGWNoIaOw0YJ68hZ--