Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtps (TLS1.3:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1lNCsw-0007ze-F1 for pgsql-hackers@arkaria.postgresql.org; Fri, 19 Mar 2021 11:01:42 +0000 Received: from localhost ([127.0.0.1] helo=malur.postgresql.org) by malur.postgresql.org with esmtp (Exim 4.92) (envelope-from ) id 1lNCsu-0001C0-7v for pgsql-hackers@arkaria.postgresql.org; Fri, 19 Mar 2021 11:01:40 +0000 Received: from makus.postgresql.org ([2001:4800:3e1:1::229]) by malur.postgresql.org with esmtps (TLS1.3:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1lNCst-0001Bt-Rq for pgsql-hackers@lists.postgresql.org; Fri, 19 Mar 2021 11:01:40 +0000 Received: from mail-il1-x134.google.com ([2607:f8b0:4864:20::134]) by makus.postgresql.org with esmtps (TLS1.3:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.92) (envelope-from ) id 1lNCsr-0001AA-AA for pgsql-hackers@postgresql.org; Fri, 19 Mar 2021 11:01:38 +0000 Received: by mail-il1-x134.google.com with SMTP id v3so7613739ilj.12 for ; Fri, 19 Mar 2021 04:01:37 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=telsasoft-com.20150623.gappssmtp.com; s=20150623; h=date:from:to:cc:subject:message-id:references:mime-version :content-disposition:in-reply-to:user-agent; bh=ph4Rkk/TFkHtTgeMUD78JUmuBfH4Jrx87acj1G9RrT0=; b=J+dxhOynXobYYsvUbVX+9Z5SXIG8c0auJqGXWrlO+sevusvmOIU3smi5WygZUd8TII +8OfB2Jb3lCcoyljhJztwqZDAULRqIcKV2LRjSygRjZvu0cmaXMAEUKY6AF2/jjPk6XK qX9MVFZ6fQGPNU9o7SsLnCAI0bbLkM3tgs8R6Hi2wWRC7P4Uhk4GRoJpK0CR1IsaDdDI 956Oq0T9nh/2IF74mNw1Ke1ZJ5TF4vg36A8lkZAYbwZd/9o0ZxwoZXQg+82PsZJHm9xE xn8kEg4sKa6er9wVtSQjCaqrTBFdyR6ML0V6Jcd6lGfMeuywfX0fL+bIIIXF+cBCavaf 4Gog== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:date:from:to:cc:subject:message-id:references :mime-version:content-disposition:in-reply-to:user-agent; bh=ph4Rkk/TFkHtTgeMUD78JUmuBfH4Jrx87acj1G9RrT0=; b=L6yH9dL5wLfTLY8wAXhBnq/VX7VPmzIoFN3KkTcGXhQaykqpCm3HNr9qMuYZJD3AHu KIRPoPFQjXMr5kUUWUsSg1r2C8WaytLhWwzQQCojiWxccaDIzKWCb9SJJcJUqFLyYIqY Jt+V/u+4nZV9jHcM5qq2W8t5JppdPlCwY3+F4YRRjCZ+u/MbTa3w62nNM/czfs3Gi00k HAkU0Zn6VjLv7uhUIeFeg6rO4xBAj6GEsFu/L6rhcsZCZ9FqIp57aIN4iHCWYymcBTcC TCJmgumaHub8Grh7YiCxVvVxSQ0GO06ZCXnwb9JReERsjlacuIm+vM4a4vLVTNd/Q4MW Uk6A== X-Gm-Message-State: AOAM530lBkR8V7Z/cKTRDdoBtY0F2XrRS7KEim5SGh+bQl4rBEQs/YXF LE4XcHHYbU9vaxRUjzgS5UMVAw== X-Google-Smtp-Source: ABdhPJz2tPxmGoR4cgwhP/l1od94eQSBhRTsVizq9Rbl19GtXoAYZ61CXRPKsspZkqmB15mqNshkIw== X-Received: by 2002:a05:6e02:1d95:: with SMTP id h21mr2206735ila.276.1616151696489; Fri, 19 Mar 2021 04:01:36 -0700 (PDT) Received: from pryzbyj.telsasoft (charmander.telsasoft.com. [50.244.222.1]) by smtp.gmail.com with ESMTPSA id r3sm2414746ilq.42.2021.03.19.04.01.35 (version=TLS1_2 cipher=ECDHE-ECDSA-AES128-GCM-SHA256 bits=128/128); Fri, 19 Mar 2021 04:01:35 -0700 (PDT) Received: by pryzbyj.telsasoft (Postfix, from userid 1000) id D93AE801407; Fri, 19 Mar 2021 06:01:34 -0500 (CDT) Date: Fri, 19 Mar 2021 06:01:34 -0500 From: Justin Pryzby To: Thomas Munro Cc: Fujii Masao , Bruce Momjian , Paul Guo , Tom Lane , Michael Brown , pgsql-hackers@postgresql.org Subject: Re: fdatasync performance problem with large number of DB files Message-ID: <20210319110134.GJ11765@telsasoft.com> References: <4CB921E5-772B-42F9-B14D-D310E709E8F2@vmware.com> <20210318135411.GB8529@momjian.us> <20210318140352.GC8529@momjian.us> <3d1086bd-0881-e0a3-9f4f-bda608f07fdb@oss.nttdata.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.9.4 (2018-02-28) List-Id: List-Help: List-Subscribe: List-Post: List-Owner: List-Archive: Archived-At: Precedence: bulk On Fri, Mar 19, 2021 at 06:28:46PM +1300, Thomas Munro wrote: > +++ b/doc/src/sgml/config.sgml > + PostgreSQL will recursively open and fsync > + all files in the data directory before crash recovery begins. This Maybe it should say "data, tablespace, and WAL directories", or just "critical directories". > + { > + {"recovery_init_sync_method", PGC_POSTMASTER, ERROR_HANDLING_OPTIONS, > + gettext_noop("Sets the method for synchronizing the data directory before crash recovery."), > + }, "and tablespaces and WAL" -- Justin