Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_CBC_SHA1:256) (Exim 4.89) (envelope-from ) id 1hUMVI-0006AC-C3 for pgsql-hackers@arkaria.postgresql.org; Sat, 25 May 2019 02:33:48 +0000 Received: from localhost ([127.0.0.1] helo=malur.postgresql.org) by malur.postgresql.org with esmtp (Exim 4.89) (envelope-from ) id 1hUMVE-0003LO-W8 for pgsql-hackers@arkaria.postgresql.org; Sat, 25 May 2019 02:33:44 +0000 Received: from makus.postgresql.org ([2001:4800:3e1:1::229]) by malur.postgresql.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_CBC_SHA1:256) (Exim 4.89) (envelope-from ) id 1hUMVE-0003LF-C1 for pgsql-hackers@lists.postgresql.org; Sat, 25 May 2019 02:33:44 +0000 Received: from mail-pf1-x442.google.com ([2607:f8b0:4864:20::442]) by makus.postgresql.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_CBC_SHA1:256) (Exim 4.89) (envelope-from ) id 1hUMV7-00008o-5j for pgsql-hackers@postgresql.org; Sat, 25 May 2019 02:33:42 +0000 Received: by mail-pf1-x442.google.com with SMTP id z26so6348288pfg.6 for ; Fri, 24 May 2019 19:33:36 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=leadboat.com; s=google; h=date:from:to:cc:subject:message-id:references:mime-version :content-disposition:in-reply-to:user-agent; bh=twOqcLQyJ7a7rVntiQ3hXzRVyOb2w3BNJEsFx32uhlw=; b=fjkK2bEAPq4MLFTRryI6tf9IKbH9J/cAmrX7rbnLUI5KwRyp28+B4sfexlf+v9qI9V 2Tf606uCLHWj8iztCxY6DeOse1zCeCK2t+m9X++3/bmu4PHJ2lVbNKLxjGbe8tgdxB1n CQ8KfV99em14DUtVZP7820QHSnioZuD+Syxfo= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:date:from:to:cc:subject:message-id:references :mime-version:content-disposition:in-reply-to:user-agent; bh=twOqcLQyJ7a7rVntiQ3hXzRVyOb2w3BNJEsFx32uhlw=; b=TnwI0fEG9LmWZMzPHWQ3cqcLWgCdnWoJrnKfwrNxokvbsyveQi7uTrKVlg9dorcSaq p8FHyzcl5EVDjli17Ut75dnOJnKeFMfUpjINCGWH8MPGzLtZZyXCOargvv7KcJn/GLzn naDv9cJWx3xOYUhSVcgdU9MMG3zPRosURjF1rGrbtTlfSxsrHrUVC3PT7PPM4VwQnchA JvFNos7SDOLZeoFn/l7AtepXime6hNF84XMNKhOnSlCLod4N92His9xKP7Ey3v3n4w2f Re3cTstkGKjxYR7UuxalAmC4ZHWrQn60LbX02lAMoXLMjHEvHBeTdlacAyY+r8v4T3cn KxqA== X-Gm-Message-State: APjAAAVurjltvFUw9FC8xrVNr7CvOcKu8RTXSf9Vlixj3ATHPKdMbk9X mucDQLkV8rr4kIpLHaM0Sq7BtQ== X-Google-Smtp-Source: APXvYqyyItJdsMztZ+IrVN/opdJUa2ffWqqVwfcJKljc1MMUVvgZDSIQym863JpeVXQb1x7n1nablg== X-Received: by 2002:a65:64d5:: with SMTP id t21mr35877333pgv.310.1558751615772; Fri, 24 May 2019 19:33:35 -0700 (PDT) Received: from rfd.leadboat.com (108-233-125-46.lightspeed.sntcca.sbcglobal.net. [108.233.125.46]) by smtp.gmail.com with ESMTPSA id y10sm4175911pfm.68.2019.05.24.19.33.33 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Fri, 24 May 2019 19:33:34 -0700 (PDT) Date: Fri, 24 May 2019 19:33:32 -0700 From: Noah Misch To: Kyotaro HORIGUCHI Cc: pgsql-hackers@postgresql.org, 9erthalion6@gmail.com, andrew.dunstan@2ndquadrant.com, hlinnaka@iki.fi, robertmhaas@gmail.com, michael@paquier.xyz Subject: Re: [HACKERS] WAL logging problem in 9.4.3? Message-ID: <20190525023332.GE1624191@rfd.leadboat.com> References: <20190514.135910.258194307.horiguchi.kyotaro@lab.ntt.co.jp> <20190517065050.GA1298884@rfd.leadboat.com> <20190520.155430.215084510.horiguchi.kyotaro@lab.ntt.co.jp> <20190521.212948.34357392.horiguchi.kyotaro@lab.ntt.co.jp> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20190521.212948.34357392.horiguchi.kyotaro@lab.ntt.co.jp> User-Agent: Mutt/1.5.24 (2015-08-30) List-Id: List-Help: List-Subscribe: List-Post: List-Owner: List-Archive: Precedence: bulk On Mon, May 20, 2019 at 03:54:30PM +0900, Kyotaro HORIGUCHI wrote: > Following this direction, the attached PoC works *at least for* > the wal_optimization TAP tests, but doing pending flush not in > smgr but in relcache. This task, syncing files created in the current transaction, is not the kind of task normally assigned to a cache. We already have a module, storage.c, that maintains state about files created in the current transaction. Why did you use relcache instead of storage.c? On Tue, May 21, 2019 at 09:29:48PM +0900, Kyotaro HORIGUCHI wrote: > This is a tidier version of the patch. > - Move the substantial work to table/index AMs. > > Each AM can decide whether to support WAL skip or not. > Currently heap and nbtree support it. Why would an AM find it important to disable WAL skip?