Content-Type: multipart/alternative;
 boundary="------------3WpZrrO69FHaj6QqGl0mF7a0"
Message-ID: <f7d63dc7-71e5-588e-97b5-dd56df618d67@gmail.com>
Date: Wed, 17 May 2023 13:00:00 +0300
MIME-Version: 1.0
User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:102.0) Gecko/20100101
 Thunderbird/102.4.2
Subject: Re: benchmark results comparing versions 15.2 and 16
Content-Language: en-US
To: Michael Paquier <michael@paquier.xyz>
Cc: Andres Freund <andres@anarazel.de>, MARK CALLAGHAN <mdcallag@gmail.com>,
 pgsql-hackers@lists.postgresql.org
References: <CAFbpF8N4bVFZ+eyWFj_+fZXZFSayk2kJVtZnouUVKGHudiDrSw@mail.gmail.com>
 <b32bed1b-0746-9b20-1472-4bdc9ca66d52@gmail.com>
 <20230508191117.v6475ip6hxpwukss@awork3.anarazel.de>
 <20230509164824.wtfn5aoggj4rcz67@awork3.anarazel.de>
 <ZFxu+IWkQpJhZkB3@paquier.xyz> <ZGHBGE45jKW8FEpe@paquier.xyz>
 <62b9850a-4c95-26c2-0aeb-d1d00434a13b@gmail.com>
 <ZGQs8Ipaec0x+5yR@paquier.xyz>
From: Alexander Lakhin <exclusion@gmail.com>
In-Reply-To: <ZGQs8Ipaec0x+5yR@paquier.xyz>
Archived-At: <https://www.postgresql.org/message-id/f7d63dc7-71e5-588e-97b5-dd56df618d67%40gmail.com>
Precedence: bulk

This is a multi-part message in MIME format.
--------------3WpZrrO69FHaj6QqGl0mF7a0
Content-Type: text/plain; charset=UTF-8; format=flowed
Content-Transfer-Encoding: 7bit

17.05.2023 04:25, Michael Paquier wrote:
> The numbers between f193883fc~1 and HEAD+patch are close to each
> other.  It does not seem to make the whole difference with 15.3, but
> most of it.  The difference can also be explained with some noise,
> based on the number patterns of the third runs?
>
> I have now applied the revert, ready for beta1.  Thanks for the
> feedback!
>

Thank you for paying attention to it!

Yes, I ran the benchmark on my workstation, so numbers could vary due parallel
activity. Now I've compared 15.3 (8382864eb) with d8c3106bb and 1d369c9e9,
this time with the CPU boost mode disabled:
1d369c9e9:
10007.130326, 10047.722122, 9920.612426, 10016.053846, 10060.606408
d8c3106bb:
10492.100485, 10505.326827, 10535.918137, 10625.904871, 10573.608859
15.3:
10458.752330, 10308.677192, 10366.496526, 10489.395275, 10319.458041

Best "1d369c9e9" worse than "15.3" by 4.1 percents (10060.61 < 10489.40)
Average "1d369c9e9" worse than "15.3" by 3.6 percents (10010.43 < 10388.56)

Best "d8c3106bb" better than "15.3" by 1.3 percents (10625.90 > 10489.40)
Average "d8c3106bb" better than "15.3" by 1.5 percents (10546.57 > 10388.56)

So it seems that there is nothing left on this plate.

Best regards,
Alexander
--------------3WpZrrO69FHaj6QqGl0mF7a0
Content-Type: text/html; charset=UTF-8
Content-Transfer-Encoding: 7bit

<html>
  <head>
    <meta http-equiv="Content-Type" content="text/html; charset=UTF-8">
  </head>
  <body>
    <div class="moz-cite-prefix">17.05.2023 04:25, Michael Paquier
      wrote:<br>
    </div>
    <blockquote type="cite" cite="mid:ZGQs8Ipaec0x+5yR@paquier.xyz">
      <pre class="moz-quote-pre" wrap="">The numbers between f193883fc~1 and HEAD+patch are close to each
other.  It does not seem to make the whole difference with 15.3, but
most of it.  The difference can also be explained with some noise,
based on the number patterns of the third runs?

I have now applied the revert, ready for beta1.  Thanks for the
feedback!

</pre>
    </blockquote>
    <br>
    Thank you for paying attention to it!<br>
    <br>
    Yes, I ran the benchmark on my workstation, so numbers could vary
    due parallel<br>
    activity. Now I've compared 15.3 (8382864eb) with d8c3106bb and
    1d369c9e9,<br>
    this time with the CPU boost mode disabled:<br>
    1d369c9e9:<br>
    10007.130326, 10047.722122, 9920.612426, 10016.053846, 10060.606408<br>
    d8c3106bb:<br>
    10492.100485, 10505.326827, 10535.918137, 10625.904871, 10573.608859<br>
    15.3:<br>
    10458.752330, 10308.677192, 10366.496526, 10489.395275, 10319.458041<br>
    <br>
    Best "1d369c9e9" worse than "15.3" by 4.1 percents (10060.61 &lt;
    10489.40)<br>
    Average "1d369c9e9" worse than "15.3" by 3.6 percents (10010.43 &lt;
    10388.56)<br>
    <br>
    Best "d8c3106bb" better than "15.3" by 1.3 percents (10625.90 &gt;
    10489.40)<br>
    Average "d8c3106bb" better than "15.3" by 1.5 percents (10546.57
    &gt; 10388.56)<br>
    <br>
    So it seems that there is nothing left on this plate.<br>
    <br>
    Best regards,<br>
    Alexander<span style="font-family:monospace"><br>
    </span>
  </body>
</html>

--------------3WpZrrO69FHaj6QqGl0mF7a0--