From: Mark Kirkwood <mark.kirkwood@catalyst.net.nz>
To: Josh Berkus <josh@agliodbs.com>
To: pgsql-performance@postgresql.org
Cc: Graeme B. Bell <grb@skogoglandskap.no>
Subject: Re: Turn off Hyperthreading! WAS: 60 core performance with 9.3
Date: Thu, 21 Aug 2014 11:14:46 +1200
Message-ID: <53F52BE6.6080006@catalyst.net.nz> (raw)
In-Reply-To: <53F4F36E.6050003@agliodbs.com>
References: <53ACB190.2030206@catalyst.net.nz>
<WM!d3faee1472c3c4b0fa7a14ce4fee2175ef92f1e0d7e7edb62fe3bcc6fa7e486c99870994a65fa43cc61df990ae549575!@asav-2.01.com>
<53ECFD75.3060408@agliodbs.com>
<53ED371D.109@catalyst.net.nz>
<WM!14a45a34c8080927967621cff2751e173aba58b17a2748a7a628c8fd3be56f3c9596f20e774ed5df15c6863316278466!@asav-2.01.com>
<53F4F36E.6050003@agliodbs.com>
List-Unsubscribe: <mailto:majordomo@postgresql.org?body=unsub%20pgsql-performance>
On 21/08/14 07:13, Josh Berkus wrote:
> Mark, all:
>
> So, this is pretty damming:
>
> Read-only test with HT ON:
>
> [pgtest@db ~]$ pgbench -c 20 -j 4 -T 600 -S bench
> starting vacuum...end.
> transaction type: SELECT only
> scaling factor: 30
> query mode: simple
> number of clients: 20
> number of threads: 4
> duration: 600 s
> number of transactions actually processed: 47167533
> tps = 78612.471802 (including connections establishing)
> tps = 78614.604352 (excluding connections establishing)
>
> Read-only test with HT Off:
>
> [pgtest@db ~]$ pgbench -c 20 -j 4 -T 600 -S bench
> starting vacuum...end.
> transaction type: SELECT only
> scaling factor: 30
> query mode: simple
> number of clients: 20
> number of threads: 4
> duration: 600 s
> number of transactions actually processed: 82457739
> tps = 137429.508196 (including connections establishing)
> tps = 137432.893796 (excluding connections establishing)
>
>
> On a read-write test, it's 10% faster with HT off as well.
>
> Further, from their production machine we've seen that having HT on
> causes the machine to slow down by 5X whenever you get more than 40
> cores (as in 100% of real cores or 50% of HT cores) worth of activity.
>
> So we're definitely back to "If you're using PostgreSQL, turn off
> Hyperthreading".
>
Hmm - that is interesting - I don't think we compared read only scaling
for hyperthreading on and off (only read write). You didn't mention what
cpu this is for (or how many sockets etc), would be useful to know.
Notwithstanding the above results, my workmate Matt made an interesting
observation: the scaling graph for (our) 60 core box (HT off), looks
just like the one for our 32 core box with HT *on*.
We are wondering if a lot of the previous analysis of HT performance
regressions should actually be reevaluated in the light of ...err is it
just that we have a lot more cores...? [1]
Regards
Mark
[1] Particularly as in *some* cases (single socket i7 for instance) HT
on seems to scale fine.
--
Sent via pgsql-performance mailing list (pgsql-performance@postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-performance
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Reply to all the recipients using the --to and --cc options:
reply via email
To: pgsql-performance@postgresql.org
Cc: mark.kirkwood@catalyst.net.nz, josh@agliodbs.com, grb@skogoglandskap.no
Subject: Re: Turn off Hyperthreading! WAS: 60 core performance with 9.3
In-Reply-To: <53F52BE6.6080006@catalyst.net.nz>
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox