Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtps (TLS1.3:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1jO0YA-0008Pm-33 for pgsql-performance@arkaria.postgresql.org; Mon, 13 Apr 2020 14:59:02 +0000 Received: from localhost ([127.0.0.1] helo=malur.postgresql.org) by malur.postgresql.org with esmtp (Exim 4.92) (envelope-from ) id 1jO0Y9-0003bo-0K for pgsql-performance@arkaria.postgresql.org; Mon, 13 Apr 2020 14:59:01 +0000 Received: from makus.postgresql.org ([2001:4800:3e1:1::229]) by malur.postgresql.org with esmtps (TLS1.3:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1jO0Y8-0003bh-PX for pgsql-performance@lists.postgresql.org; Mon, 13 Apr 2020 14:59:00 +0000 Received: from mail-qt1-x842.google.com ([2607:f8b0:4864:20::842]) by makus.postgresql.org with esmtps (TLS1.3:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.92) (envelope-from ) id 1jO0Y6-0005bj-F1 for pgsql-performance@lists.postgresql.org; Mon, 13 Apr 2020 14:58:59 +0000 Received: by mail-qt1-x842.google.com with SMTP id c16so1563506qtv.1 for ; Mon, 13 Apr 2020 07:58:56 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=telsasoft-com.20150623.gappssmtp.com; s=20150623; h=date:from:to:cc:subject:message-id:references:mime-version :content-disposition:in-reply-to:user-agent; bh=kDjZLpnoiUMOBGzHUrg3rxlszkKr82++9mvRvt9Gt9g=; b=yOfCZjB2FpUNm/kauJx04PdMc7YaBZ56KlWkHiuRyQ4qj/qNfEyXDUMprmEcsCzR5W CIc4rZNEH2sLD/xbWzgqhbAXmcC8xJnPnBh8pASBeNdrmMGxhwxwzSrF37TfSUShfwAZ iboxC5d06vAQ2CDwbtO6TiUztxQqqnOyjY3G70LWO2ixfsUrl2/5XeosAGnM3kiL5K44 g1T9FEyqg4acH86VCddq2re2QKIsG8UcxzFwxmYLeVcholaxSNso7yw9o0AvpdEXUud7 oimp7pXwl5Ihlw/6q40qG9+5Qq83/o0E7bZCCradcLq2BMvp1W1rTMe/ZRQUuw6/5Lhs F4Rw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:date:from:to:cc:subject:message-id:references :mime-version:content-disposition:in-reply-to:user-agent; bh=kDjZLpnoiUMOBGzHUrg3rxlszkKr82++9mvRvt9Gt9g=; b=WRkxvOZcH7L6GUujzftmdycXDvcL1OqyCO7BsD7RL1R3rtFsl9KGn2fuJYZQk1N8YV wrUlbxZ0prekFfZM4GO+T030qvQkHzpzCx+WfgFTAbI1mYyb92TykjrY/c14zfuRirbg 8o4b7DTbI8Mle/U/B1Kc5bi52FDdCqbo+155RWrjKHBIP7UQcg6AwOxh2dBM/gY2QoDC mzLDVihb8Nn3UJXmoJzfAiNeiRApYylO/fmIjba/UWLjfkQvObx5GRgRG1/6p8VC33F2 L+Vsi9a9sL/mWLMbMdDS+wIvGuYnV4GbaAb7aCKSDXrcV/z7r17HTua5eppo1cxsqBSl EOYA== X-Gm-Message-State: AGi0PuafFz+gfuknB8+VkDCQ/0lh7N6xSyweYhBcyBTvb0T2rxJeOv2x wVIyF3xRyapyYb7w4Gw5EZqzKpM9VxQ= X-Google-Smtp-Source: APiQypK9jdkOdOCsJ9sahw63TBfqcI2RhupWCrA532xrlnSQGh/Vp8xEFSqWrcD3EAME3BS4injhWg== X-Received: by 2002:ac8:82f:: with SMTP id u44mr11504617qth.198.1586789935060; Mon, 13 Apr 2020 07:58:55 -0700 (PDT) Received: from pryzbyj (charmander.telsasoft.com. [50.244.222.1]) by smtp.gmail.com with ESMTPSA id d188sm7563099qkg.59.2020.04.13.07.58.54 (version=TLS1_2 cipher=ECDHE-ECDSA-AES128-GCM-SHA256 bits=128/128); Mon, 13 Apr 2020 07:58:54 -0700 (PDT) Received: by pryzbyj (Postfix, from userid 1000) id CF8C0800897; Mon, 13 Apr 2020 09:58:52 -0500 (CDT) Date: Mon, 13 Apr 2020 09:58:52 -0500 From: Justin Pryzby To: Don Seiler Cc: pgsql-performance@lists.postgresql.org Subject: Re: High kswapd Message-ID: <20200413145852.GT2228@telsasoft.com> References: <20200413144254.GS2228@telsasoft.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.9.4 (2018-02-28) List-Id: List-Help: List-Subscribe: List-Post: List-Owner: List-Archive: Precedence: bulk On Mon, Apr 13, 2020 at 09:46:22AM -0500, Don Seiler wrote: > ==> /sys/kernel/mm/ksm/run <== > 0 Was it off to begin with ? If not, you can set it to "2" to "unshare" pages. > ==> /sys/kernel/mm/transparent_hugepage/khugepaged/defrag <== > 1 So I'd suggest trying with this disabled. I don't know if I ever fully understood the problem, but it sounds like at least in your case it's related to large shared_buffers, and hugepages, which cannot be swapped out. -- Justin