Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtps (TLS1.3:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1k3dQV-0000vw-3L for pgsql-hackers@arkaria.postgresql.org; Thu, 06 Aug 2020 10:47:11 +0000 Received: from localhost ([127.0.0.1] helo=malur.postgresql.org) by malur.postgresql.org with esmtp (Exim 4.92) (envelope-from ) id 1k3dQU-0001gF-2X for pgsql-hackers@arkaria.postgresql.org; Thu, 06 Aug 2020 10:47:10 +0000 Received: from makus.postgresql.org ([2001:4800:3e1:1::229]) by malur.postgresql.org with esmtps (TLS1.3:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1k3dQT-0001fm-NY for pgsql-hackers@lists.postgresql.org; Thu, 06 Aug 2020 10:47:09 +0000 Received: from mail-wr1-x442.google.com ([2a00:1450:4864:20::442]) by makus.postgresql.org with esmtps (TLS1.3:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.92) (envelope-from ) id 1k3dQQ-0004JC-WA for pgsql-hackers@postgresql.org; Thu, 06 Aug 2020 10:47:08 +0000 Received: by mail-wr1-x442.google.com with SMTP id f7so43556118wrw.1 for ; Thu, 06 Aug 2020 03:47:06 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=2ndquadrant-com.20150623.gappssmtp.com; s=20150623; h=date:from:to:cc:subject:message-id:references:mime-version :content-disposition:in-reply-to; bh=iRekFVGmfm5s+h3ao7vN+m9YmehHEjQjTVr9qvPvSeY=; b=Xur0jDbnFC4USp4/JxJBvwlN1xXVnczHvOgafZ0X9mDKFEqKrYI58h7bFwaxgLOd/a 4qG40vxOCDvof88Dtlj13WYSK3XmWg00rlSeVlZSY41zmrUpsp+wmnMvZSDUpNBcZ1cn Qn+Qzj7U7ZvjgNZVcFBn7vLDDC3xmRKjG5vjuA7PrdrTB/5nVGnWvPrlQlFc2H383HzX Gz5YnGMpm7qXsq+k3Q5x9i5yM+mQlZyZf7kCTDH6Kr77mf2WFwyBCdKK7kJIB4jBahet IkeCEohuWBFxGOfodYC3IrvUbYwKWTIVyPITbKecG1WtUGoYKSIoCwtYLDzggDxfVzP/ 6EZg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:date:from:to:cc:subject:message-id:references :mime-version:content-disposition:in-reply-to; bh=iRekFVGmfm5s+h3ao7vN+m9YmehHEjQjTVr9qvPvSeY=; b=id2fvqSXxVX0p0hADcQs9tBJXWT/IOq1y2k0yCAQND9h9iwr22ruSmlf29pIPb2jV7 Pg46hE3q7G+u9PcJYOfgVHeGefJunVoGme9G21U0cf7hLoOy795XYj5uCcFNlvZz/tzf kANGcfI+TaHDae75RL0/Enj6AekOoVKZYSDZzq5RJyQNZTiRaO7ru6P7r8b+uflZdW9e Sl3SHP391/Z9Hp5kaXgTVCjPX7RwxWcf0reBxiih1KIgpw/x3jeuabnR7LoVyDHN+5wQ CSBwzWF3D5ChSeXeMnlnme8MH1e8Rg2pYTf5XdOjMIKRW9sXesxIOtPe9PIybikL5Ddm 2PMQ== X-Gm-Message-State: AOAM533h8xB1Ys4vmzm3YqY5IWLfpqplxqqt5ajd7xqhK/ZTY3jhwQvl i404+dwTg9wL18Bdoj2FYQEBtg== X-Google-Smtp-Source: ABdhPJy7EQI7l7OS9XCeTZlVONI6SPx8mvGgqVdpacfmeh2ZY+oMNWULMR1qcBcJrmBlfJEmsxamIA== X-Received: by 2002:adf:ed88:: with SMTP id c8mr6446506wro.233.1596710824762; Thu, 06 Aug 2020 03:47:04 -0700 (PDT) Received: from localhost (ip-86-49-253-141.net.upcbroadband.cz. [86.49.253.141]) by smtp.gmail.com with ESMTPSA id n5sm5881505wrx.22.2020.08.06.03.47.03 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Thu, 06 Aug 2020 03:47:03 -0700 (PDT) Date: Thu, 6 Aug 2020 12:47:01 +0200 From: Tomas Vondra To: Thomas Munro Cc: Stephen Frost , Dmitry Dolgov <9erthalion6@gmail.com>, David Steele , Andres Freund , Alvaro Herrera , pgsql-hackers Subject: Re: WIP: WAL prefetch (another approach) Message-ID: <20200806104701.j3xnkczd6qelfnhj@development> References: <20200419114820.h62ryte7uwu46e2x@localhost> <20200425191935.4p6qxzzu5bklodwk@localhost> <20200502151423.yf52i63u232fdfrg@localhost> <20200605223422.r76a5rpl2zg2xo34@development> <20200606003632.GS6680@tamriel.snowman.net> <20200803154659.nzf5qzuozts5dujp@development> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii; format=flowed Content-Disposition: inline In-Reply-To: List-Id: List-Help: List-Subscribe: List-Post: List-Owner: List-Archive: Precedence: bulk On Thu, Aug 06, 2020 at 02:58:44PM +1200, Thomas Munro wrote: >On Tue, Aug 4, 2020 at 3:47 AM Tomas Vondra > wrote: >> On Thu, Jul 02, 2020 at 03:09:29PM +1200, Thomas Munro wrote: >> >FYI I am still trying to reproduce and understand the problem Tomas >> >reported; more soon. >> >> Any luck trying to reproduce thigs? Should I try again and collect some >> additional debug info? > >No luck. I'm working on it now, and also trying to reduce the >overheads so that we're not doing extra work when it doesn't help. > OK, I'll see if I can still reproduce it. >By the way, I also looked into recovery I/O stalls *other* than >relation buffer cache misses, and created >https://commitfest.postgresql.org/29/2669/ to fix what I found. If >you avoid both kinds of stalls then crash recovery is finally CPU >bound (to go faster after that we'll need parallel replay). Yeah, I noticed. I'll take a look and do some testing in the next CF. regards -- Tomas Vondra http://www.2ndQuadrant.com PostgreSQL Development, 24x7 Support, Remote DBA, Training & Services