pg.ddx.io pgsql-hackers@postgresql.org mailing list archive help / color / mirror / Atom feed From: Tomas Vondra <tomas.vondra@2ndquadrant.com>
To: Amit Kapila <amit.kapila16@gmail.com>
Cc: Robert Haas <robertmhaas@gmail.com>
Cc: Jim Nasby <Jim.Nasby@bluetreble.com>
Cc: Dilip Kumar <dilipbalaut@gmail.com>
Cc: Andres Freund <andres@anarazel.de>
Cc: pgsql-hackers <pgsql-hackers@postgresql.org>
Subject: Re: Speed up Clog Access by increasing CLOG buffers
Date: Thu, 22 Dec 2016 14:29:13 +0100
Message-ID: <84c22fbb-b9c4-a02f-384b-b4feb2c67193@2ndquadrant.com> (raw )
In-Reply-To: <04e39ac9-af28-0fda-8f72-7268197d281f@2ndquadrant.com >
References: <CAA4eK1+8=X9mSNeVeHg_NqMsOR-XKsjuqrYzQf=iCsdh3U4EOA@mail.gmail.com >
<acf46406-cf6d-41fe-4118-4e1c960b4790@2ndquadrant.com >
<CAFiTN-tCqDucbikxue0x0dwNOAa6yzjMxJNgXGQm90jVVRSj0Q@mail.gmail.com >
<CAFiTN-t15PjFTFQH0fBfM5jVSv6rfm5J_8vj=RGuKeFpdLgSoQ@mail.gmail.com >
<CAA4eK1LyR2A+m=RBSZ6rcPEwJ=rVi1ADPSndXHZdjn56yqO6Vg@mail.gmail.com >
<4a52a34f-57fa-7bcf-d34c-c15db40f0361@2ndquadrant.com >
<CAA4eK1KTbNbZSDo=6k4YgaJh_FM20zJCKu2Yt0bxaFMv9QcSXQ@mail.gmail.com >
<b3586234-6c80-5b64-1261-871e0e852bbb@2ndquadrant.com >
<956b695d-f6c5-d652-bf0c-cea95981547c@BlueTreble.com >
<f769dd83-6288-2c37-4958-b7ddad0bc974@2ndquadrant.com >
<5275bf49-545e-e189-48c5-17b5defc45a2@2ndquadrant.com >
<CA+TgmobmDLM1dzFvN_tJoBunarMpz+cehx1cVfv-QMKk4rZLPQ@mail.gmail.com >
<ca714e28-81a2-440c-bd92-79fe1fa0fc15@2ndquadrant.com >
<CAA4eK1JjatUZu0+HCi=5VM1q-hFgN_OhegPAwEUJqxf-7pESbg@mail.gmail.com >
<04e39ac9-af28-0fda-8f72-7268197d281f@2ndquadrant.com >
List-Unsubscribe: <mailto:majordomo@postgresql.org?body=unsub%20pgsql-hackers>
Hi,
> The attached results show that:
>
> (a) master shows the same zig-zag behavior - No idea why this wasn't
> observed on the previous runs.
>
> (b) group_update actually seems to improve the situation, because the
> performance keeps stable up to 72 clients, while on master the
> fluctuation starts way earlier.
>
> I'll redo the tests with a newer kernel - this was on 3.10.x which is
> what Red Hat 7.2 uses, I'll try on 4.8.6. Then I'll try with the patches
> you submitted, if the 4.8.6 kernel does not help.
>
> Overall, I'm convinced this issue is unrelated to the patches.
I've been unable to rerun the tests on this hardware with a newer
kernel, so nothing new on the x86 front.
But as discussed with Amit in Tokyo at pgconf.asia, I got access to a
Power8e machine (IBM 8247-22L to be precise). It's a much smaller
machine compared to the x86 one, though - it only has 24 cores in 2
sockets, 128GB of RAM and less powerful storage, for example.
I've repeated a subset of x86 tests and pushed them to
https://bitbucket.org/tvondra/power8-results-2
The new results are prefixed with "power-" and I've tried to put them
right next to the "same" x86 tests.
In all cases the patches significantly reduce the contention on
CLogControlLock, just like on x86. Which is good and expected.
Otherwise the results are rather boring - no major regressions compared
to master, and all the patches perform almost exactly the same. Compare
for example this:
* http://tvondra.bitbucket.org/#dilip-300-unlogged-sync
* http://tvondra.bitbucket.org/#power-dilip-300-unlogged-sync
So the results seem much smoother compared to x86, and the performance
difference is roughly 3x, which matches the 24 vs. 72 cores.
For pgbench, the difference is much more significant, though:
* http://tvondra.bitbucket.org/#pgbench-300-unlogged-sync-skip
* http://tvondra.bitbucket.org/#power-pgbench-300-unlogged-sync-skip
So, we're doing ~40k on Power8, but 220k on x86 (which is ~6x more, so
double per-core throughput). My first guess was that this is due to the
x86 machine having better I/O subsystem, so I've reran the tests with
data directory in tmpfs, but that produced almost the same results.
Of course, this observation is unrelated to this patch.
regards
--
Tomas Vondra http://www.2ndQuadrant.com
PostgreSQL Development, 24x7 Support, Remote DBA, Training & Services
--
Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-hackers
view thread (248+ messages) latest in thread
Message-ID: <84c22fbb-b9c4-a02f-384b-b4feb2c67193@2ndquadrant.com>
Permalink: ../84c22fbb-b9c4-a02f-384b-b4feb2c67193@2ndquadrant.com/
Also on: postgresql.org/message-id/84c22fbb-b9c4-a02f-384b-b4feb2c67193@2ndquadrant.com
copy link · copy postgr.es
reply Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Reply to all the recipients using the --to and --cc options:
reply via email
To: pgsql-hackers@postgresql.org
Cc: tomas.vondra@2ndquadrant.com, amit.kapila16@gmail.com, robertmhaas@gmail.com, Jim.Nasby@bluetreble.com, dilipbalaut@gmail.com, andres@anarazel.de
Subject: Re: Speed up Clog Access by increasing CLOG buffers
In-Reply-To: <84c22fbb-b9c4-a02f-384b-b4feb2c67193@2ndquadrant.com>
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox