Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtps (TLS1.3:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1kOAag-0007Hf-Ey for pgsql-hackers@arkaria.postgresql.org; Fri, 02 Oct 2020 02:14:34 +0000 Received: from localhost ([127.0.0.1] helo=malur.postgresql.org) by malur.postgresql.org with esmtp (Exim 4.92) (envelope-from ) id 1kOAaf-0002uM-Ca for pgsql-hackers@arkaria.postgresql.org; Fri, 02 Oct 2020 02:14:33 +0000 Received: from makus.postgresql.org ([2001:4800:3e1:1::229]) by malur.postgresql.org with esmtps (TLS1.3:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1kOAae-0002rx-W3 for pgsql-hackers@lists.postgresql.org; Fri, 02 Oct 2020 02:14:33 +0000 Received: from mail-pj1-x1036.google.com ([2607:f8b0:4864:20::1036]) by makus.postgresql.org with esmtps (TLS1.3:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.92) (envelope-from ) id 1kOAaY-0003Zc-3j for pgsql-hackers@postgresql.org; Fri, 02 Oct 2020 02:14:31 +0000 Received: by mail-pj1-x1036.google.com with SMTP id b17so139825pji.1 for ; Thu, 01 Oct 2020 19:14:25 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=2ndquadrant-com.20150623.gappssmtp.com; s=20150623; h=from:subject:to:cc:references:message-id:date:user-agent :mime-version:in-reply-to:content-language:content-transfer-encoding; bh=gEIUs2xJA58JDXqhtR6D4kiHZ3EcDtBamqm7Yk5jhDE=; b=AlAFz2Bgvjs7Y7aHYcoNJPRuiS4Pz/DyrXK5CRjeG9J83PkdyUUnKJ7jz7gIkxfjQZ OukG+2WD6WJtCgJjLPfHnC4hXU2DN5i4WEl/tMblWVpsaxlrgUOEBpi15puLfyTjq0gl tkZD6uDugE+jV0nHKTuOMPmIof+qnltm3OaqjyPMeZxJJn6XTd/sSc85vXkc6+m8Eu+w xXbIq4YawZEYsXtDdvJDeWXJQzm97iwMp+Dm9lubvoz/VAK5/dPWFXqV6gT3BuaS9Zvp mFNEt6WPX/ePt9Um4ZRFweG3Hfn0VknMQQe+dYVr02UQNQaJICyLd3hGJdEK2McyX5Ao TpJg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:subject:to:cc:references:message-id:date :user-agent:mime-version:in-reply-to:content-language :content-transfer-encoding; bh=gEIUs2xJA58JDXqhtR6D4kiHZ3EcDtBamqm7Yk5jhDE=; b=oOyhoRSDHsHKaPQ0yhF64erUVWlY8CmCSEVeq3hQkDPjzZ2Q0NgaqpWsME8NmMQWU6 JEO9nAJ63mvUuH7dJkY5TAXejLeoEG3DIHU5IAsA8fzUMMGozc0fUaj2SV034YuVvGDW CVcZgyeBwOt10jR5vsXW0Uua1wBAYLDGqhSW7o3pXK15J6tSaTgB/JreLnDkPE6Ir+A6 Td/BUI+k+tKEi9gePrIuSziE3JK0sLP4cyTotnTO4pHD8MUBu+9o9P3iK+plQKwz00P2 uEXtdtF9Q3aSsyY3SIQV0BdyXjoA8/SHr89s0X5aQcNEYnml4eONdlqXLNsrpWiFKaae to2Q== X-Gm-Message-State: AOAM531up0HFzPW689StQrGfM2d2uh0KWOG/ihIuOFPQSk5CzioxexAx VYqPQMZ6IasomTRZyaDMKrBzrQ== X-Google-Smtp-Source: ABdhPJxSB6ATwB2wIihRISsD1bRicNvvadJwjTlKvHoi9LAE+nSx3W2PgIw6LIBTlREhhwyj6YjabA== X-Received: by 2002:a17:90a:69e3:: with SMTP id s90mr237026pjj.130.1601604864852; Thu, 01 Oct 2020 19:14:24 -0700 (PDT) Received: from osaka.octopusnet (p13186-ipngn8201marunouchi.tokyo.ocn.ne.jp. [153.214.140.186]) by smtp.gmail.com with ESMTPSA id j20sm7725173pfh.146.2020.10.01.19.14.21 (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Thu, 01 Oct 2020 19:14:24 -0700 (PDT) From: Ian Barwick Subject: Re: Improving connection scalability: GetSnapshotData() To: Andres Freund , andrew@dunslane.net Cc: Michael Paquier , Tom Lane , Robert Haas , Thomas Munro , Alvaro Herrera , Daniel Gustafsson , "Jonathan S. Katz" , Alexander Korotkov , PostgreSQL Hackers , Peter Geoghegan , Bruce Momjian , David Rowley References: <20200816205258.pjvmoljrk7ntqb3n@alap3.anarazel.de> <20200816211146.nodohy6ck6mzfjwi@alap3.anarazel.de> <20200816212657.3vyijoddr2yvgjjc@alap3.anarazel.de> <20200903081554.GB8559@paquier.xyz> <61291ffe-d611-f889-68b5-c298da9fb18f@2ndquadrant.com> <20200908041114.5woxns33iv765fgh@alap3.anarazel.de> <0006ffe6-6f76-c074-3e58-2801cee1c05f@2ndquadrant.com> <20200914231718.gg7v77fx7nvvprjy@alap3.anarazel.de> <20200930224317.xuvsoptjg6b2ydxx@alap3.anarazel.de> <20201001182630.7kh2tiubf2lp3tzt@alap3.anarazel.de> Message-ID: <99cc07c2-6eb2-b93e-858c-d9291a346155@2ndquadrant.com> Date: Fri, 2 Oct 2020 11:14:19 +0900 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:68.0) Gecko/20100101 Thunderbird/68.12.0 MIME-Version: 1.0 In-Reply-To: <20201001182630.7kh2tiubf2lp3tzt@alap3.anarazel.de> Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-US Content-Transfer-Encoding: 7bit List-Id: List-Help: List-Subscribe: List-Post: List-Owner: List-Archive: Precedence: bulk On 2020/10/02 3:26, Andres Freund wrote: > Hi Ian, Andrew, All, > > On 2020-09-30 15:43:17 -0700, Andres Freund wrote: >> Attached is an updated version of the test (better utility function, >> stricter regexes, bailing out instead of failing just the current when >> psql times out). I'm leaving it in this test for now, but it's fairly >> easy to use this way, in my opinion, so it may be worth moving to >> PostgresNode at some point. > > I pushed this yesterday. Ian, thanks again for finding this and helping > with fixing & testing. Thanks! Apologies for not getting back to your earlier responses, have been distracted by Various Other Things. The tests I run which originally triggered the issue now run just fine. Regards Ian Barwick -- Ian Barwick https://www.2ndQuadrant.com/ PostgreSQL Development, 24x7 Support, Training & Services