Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtp (Exim 4.92) (envelope-from ) id 1jIgnZ-0002D4-2y for pgsql-hackers@arkaria.postgresql.org; Sun, 29 Mar 2020 22:52:57 +0000 Received: from localhost ([127.0.0.1] helo=malur.postgresql.org) by malur.postgresql.org with esmtp (Exim 4.92) (envelope-from ) id 1jIgnX-0000Ux-Qn for pgsql-hackers@arkaria.postgresql.org; Sun, 29 Mar 2020 22:52:55 +0000 Received: from makus.postgresql.org ([2001:4800:3e1:1::229]) by malur.postgresql.org with esmtps (TLS1.3:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1jIgnX-0000Se-FF for pgsql-hackers@lists.postgresql.org; Sun, 29 Mar 2020 22:52:55 +0000 Received: from mail-wr1-x443.google.com ([2a00:1450:4864:20::443]) by makus.postgresql.org with esmtps (TLS1.3:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.92) (envelope-from ) id 1jIgnQ-0006pm-Oi for pgsql-hackers@postgresql.org; Sun, 29 Mar 2020 22:52:54 +0000 Received: by mail-wr1-x443.google.com with SMTP id h15so19043029wrx.9 for ; Sun, 29 Mar 2020 15:52:48 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=2ndquadrant-com.20150623.gappssmtp.com; s=20150623; h=date:from:to:cc:subject:message-id:references:mime-version :content-disposition:in-reply-to; bh=2oCwxed3z8gWk4Xr1/UAkrILgRRxwlTZj+HQOGeRfEQ=; b=Wi5A8hi/QxOF6AbyceHpMdNmqluVnP+fn+9+8mTQCyp61xHuLB8NVEaErz9/wFwLDB 1TMrw6HY0rI8uYVseGn7JNxkQCEan3uWhW91GWj0DujziCtRYgZpy1sV7HrVs52Iz9qH 2sG+GDe13akYbLyZNmQHI6QIxQxHJiCbU5ls30CcDvPWPMHUQtboQ36PZ847TvpOGGUC cft5XjbVRtfcRWCm+PytlR8X5i4cq7aCeuhi3pRLfO9XsbDn+P7dWS6gWKr0EYzR1F/t uXoVpOGnUvF3iuArEBeDy+aScSPiM8e8aleSd0hOhkkXphZx0TGu94he7qsdmvKuesuj Vu5A== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:date:from:to:cc:subject:message-id:references :mime-version:content-disposition:in-reply-to; bh=2oCwxed3z8gWk4Xr1/UAkrILgRRxwlTZj+HQOGeRfEQ=; b=TIC1Jau3B9PY8nR6lxKl9ivZKsP4IhXFVU8XpBQc9JdZz10nFJV+bMuR1rtMA03QdT DOPoU7zHMY1hN5rMIY2G5gdIkH30wNZ2YCQiqRgOBlp/OFlHbB6Pc/x6JWFxiArn9IHR aYWXoIcEjoD9Eb8YFEyHeUC9C7pO6+9xDHKASkNCM+t4+QxWfSN+xH8IfB1sk1pLvGxC bXyGqHQnwA38tKUaNFLgpz/QdBP7xG3w/xtD2YmnEtQfzJ5Cbo6skK1OXvRhqKML8T6W 2JBxCJYimfh6Udvs44bTEsw4/9W06cZgq+jJd31oleR4GIOdr5gF5AepzgnxQ4ykV1Ny sKBQ== X-Gm-Message-State: ANhLgQ35sDTCMO16wxi6GUOki1HVZYnZBeNVLUFlSBbiT8nAA3qORIHZ iUxu5ma7klqRVxA3/jrbOZhXpg== X-Google-Smtp-Source: ADFU+vvvcNw8qGGu9V8eiTsMXmgUXNlNHhqfWZCz5uJeyh6/EYMQGgJhvqeToco2S8batm2VucAN8A== X-Received: by 2002:adf:dc4f:: with SMTP id m15mr12561363wrj.219.1585522366585; Sun, 29 Mar 2020 15:52:46 -0700 (PDT) Received: from localhost (ip-86-49-253-141.net.upcbroadband.cz. [86.49.253.141]) by smtp.gmail.com with ESMTPSA id h10sm19669858wrq.33.2020.03.29.15.52.45 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Sun, 29 Mar 2020 15:52:45 -0700 (PDT) Date: Mon, 30 Mar 2020 00:52:43 +0200 From: Tomas Vondra To: Andres Freund Cc: Alexander Korotkov , Peter Geoghegan , PostgreSQL Hackers Subject: Re: Improving connection scalability: GetSnapshotData() Message-ID: <20200329225243.hogrvgs3jwpvrjxv@development> References: <20200301083601.ews6hz5dduc3w2se@alap3.anarazel.de> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii; format=flowed Content-Disposition: inline In-Reply-To: List-Id: List-Help: List-Subscribe: List-Post: List-Owner: List-Archive: Precedence: bulk On Sun, Mar 29, 2020 at 11:50:10AM -0700, Andres Freund wrote: >Hi, > >On March 29, 2020 11:24:32 AM PDT, Alexander Korotkov > wrote: >> clearly a big win on majority >>of workloads, I think we still need to investigate different workloads >>on different hardware to ensure there is no regression. > >Definitely. Which workloads are you thinking of? I can think of those >affected facets: snapshot speed, commit speed with writes, connection >establishment, prepared transaction speed. All in the small and large >connection count cases. > >I did measurements on all of those but prepared xacts, fwiw. That >definitely needs to be measured, due to the locking changes around >procarrayaddd/remove. > >I don't think regressions besides perhaps 2pc are likely - there's >nothing really getting more expensive but procarray add/remove. > If I get some instructions what tests to do, I can run a bunch of tests on my machinees (not the largest boxes, but at least something). I don't have the bandwidth to come up with tests on my own, at the moment. regards -- Tomas Vondra http://www.2ndQuadrant.com PostgreSQL Development, 24x7 Support, Remote DBA, Training & Services