pg.ddx.io pgsql-admin@postgresql.org mailing list archive
help / color / mirror / Atom feedPerformance difference between servers
9+ messages / 5 participants
[nested] [flat]
* Performance difference between servers
@ 2017-11-15 17:06 kpi6288@gmail.com
0 siblings, 1 reply; 9+ messages in thread
From: kpi6288@gmail.com @ 2017-11-15 17:06 UTC (permalink / raw)
To: pgsql-admin
We have 3 different servers, one (the oldest) ist significantly faster at
certain operations and I can't find out the reason:
(table created in monospace font)
Server Processor RAM CrystalDiskMark pgbench CREATE DATABASE OS
#1 i7-2600 8GB 495 / 473 26.000 4.5 . 6 s W/
Server 2008 R2 on Hyper V Server 2008
#2 E3-1245 16GB 797 / 514 50.000 13 . 19 s W/
Server 2016 Std. on Hyper V Server 2016
#3 E3-1270 12GB 933 / 334 40.000 13 . 20 s W/
Server 2008 Essentials on Hyper V Server 2016
CrystalDiskMark: "Seq Q32T1"
Pgbench:
pgbench -i -s 200 -U postgres pgbench
pgbench -c 40 -j 10 -T 150 -U postgres -S -P 5 pgbench
CREATE DATABASE:
create database test with template myTemplate
All running PostgreSQL 9.6 x64 with similar configuration. All running as
virtual machines, no other virtual machines creating any load. Using the
same template database on all machines.
Although the indicative numbers of pgbench and CrystalDiskMark show better
values for server #2 and #3, server #1 creates a new database considerably
faster.
All servers have SSDs. Server #1 has two single SSDs (a system disk and a
data disk). Servers #2 and #3 have only one logical disk for system and
data, and this is two SSDs running as RAID 1. This may be slower but if it
is, I would excpect this also to show up in the pgbench results.
The reason behind this exercise is that a test application was also reported
to be slower on server #2 and 3.
Any idea how to track down the performance difference?
Thank you
Klaus
^ permalink raw reply [nested|flat] 9+ messages in thread
* Re: Performance difference between servers
@ 2017-11-15 17:11 Scott Whitney <scott@journyx.com>
parent: kpi6288@gmail.com
0 siblings, 2 replies; 9+ messages in thread
From: Scott Whitney @ 2017-11-15 17:11 UTC (permalink / raw)
To: kpi6288@gmail.com <kpi6288@gmail.com>; pgsql-admin
Are you saying that each of these servers is a virtual HyperV machine running under a hardware host?
________________________________
From: pgsql-admin-owner@postgresql.org <pgsql-admin-owner@postgresql.org> on behalf of kpi6288@gmail.com <kpi6288@gmail.com>
Sent: Wednesday, November 15, 2017 11:06 AM
To: pgsql-admin@postgresql.org
Subject: [ADMIN] Performance difference between servers
We have 3 different servers, one (the oldest) ist significantly faster at certain operations and I can’t find out the reason:
(table created in monospace font)
Server Processor RAM CrystalDiskMark pgbench CREATE DATABASE OS
#1 i7-2600 8GB 495 / 473 26.000 4.5 … 6 s W/ Server 2008 R2 on Hyper V Server 2008
#2 E3-1245 16GB 797 / 514 50.000 13 … 19 s W/ Server 2016 Std. on Hyper V Server 2016
#3 E3-1270 12GB 933 / 334 40.000 13 … 20 s W/ Server 2008 Essentials on Hyper V Server 2016
CrystalDiskMark: „Seq Q32T1“
Pgbench:
pgbench -i -s 200 -U postgres pgbench
pgbench -c 40 -j 10 -T 150 -U postgres -S -P 5 pgbench
CREATE DATABASE:
create database test with template myTemplate
All running PostgreSQL 9.6 x64 with similar configuration. All running as virtual machines, no other virtual machines creating any load. Using the same template database on all machines.
Although the indicative numbers of pgbench and CrystalDiskMark show better values for server #2 and #3, server #1 creates a new database considerably faster.
All servers have SSDs. Server #1 has two single SSDs (a system disk and a data disk). Servers #2 and #3 have only one logical disk for system and data, and this is two SSDs running as RAID 1. This may be slower but if it is, I would excpect this also to show up in the pgbench results.
The reason behind this exercise is that a test application was also reported to be slower on server #2 and 3.
Any idea how to track down the performance difference?
Thank you
Klaus
Journyx, Inc.
7600 Burnet Road #300
Austin, TX 78757
www.journyx.com
p 512.834.8888
f 512-834-8858
Do you receive our promotional emails? Click here <http://journyx.com/communication-preferences; or visit http://journyx.com/communication-preferences to unsubscribe.
^ permalink raw reply [nested|flat] 9+ messages in thread
* Re: Performance difference between servers
@ 2017-11-15 17:17 kpi6288@gmail.com
parent: Scott Whitney <scott@journyx.com>
1 sibling, 0 replies; 9+ messages in thread
From: kpi6288@gmail.com @ 2017-11-15 17:17 UTC (permalink / raw)
To: pgsql-admin
Yes, exactly:
Three different (hardware) machines, each having a hyper-V host and the
Windows Servers as Hyper-V guests.
Von: Scott Whitney [mailto:scott@journyx.com]
Gesendet: Mittwoch, 15. November 2017 18:11
An: kpi6288@gmail.com; pgsql-admin@postgresql.org
Betreff: Re: [ADMIN] Performance difference between servers
Are you saying that each of these servers is a virtual HyperV machine
running under a hardware host?
_____
From: pgsql-admin-owner@postgresql.org
<mailto:pgsql-admin-owner@postgresql.org> <pgsql-admin-owner@postgresql.org
<mailto:pgsql-admin-owner@postgresql.org> > on behalf of kpi6288@gmail.com
<mailto:kpi6288@gmail.com> <kpi6288@gmail.com <mailto:kpi6288@gmail.com> >
Sent: Wednesday, November 15, 2017 11:06 AM
To: pgsql-admin@postgresql.org <mailto:pgsql-admin@postgresql.org>
Subject: [ADMIN] Performance difference between servers
We have 3 different servers, one (the oldest) ist significantly faster at
certain operations and I can't find out the reason:
(table created in monospace font)
Server Processor RAM CrystalDiskMark pgbench CREATE DATABASE OS
#1 i7-2600 8GB 495 / 473 26.000 4.5 . 6 s W/
Server 2008 R2 on Hyper V Server 2008
#2 E3-1245 16GB 797 / 514 50.000 13 . 19 s W/
Server 2016 Std. on Hyper V Server 2016
#3 E3-1270 12GB 933 / 334 40.000 13 . 20 s W/
Server 2008 Essentials on Hyper V Server 2016
CrystalDiskMark: "Seq Q32T1"
Pgbench:
pgbench -i -s 200 -U postgres pgbench
pgbench -c 40 -j 10 -T 150 -U postgres -S -P 5 pgbench
CREATE DATABASE:
create database test with template myTemplate
All running PostgreSQL 9.6 x64 with similar configuration. All running as
virtual machines, no other virtual machines creating any load. Using the
same template database on all machines.
Although the indicative numbers of pgbench and CrystalDiskMark show better
values for server #2 and #3, server #1 creates a new database considerably
faster.
All servers have SSDs. Server #1 has two single SSDs (a system disk and a
data disk). Servers #2 and #3 have only one logical disk for system and
data, and this is two SSDs running as RAID 1. This may be slower but if it
is, I would excpect this also to show up in the pgbench results.
The reason behind this exercise is that a test application was also reported
to be slower on server #2 and 3.
Any idea how to track down the performance difference?
Thank you
Klaus
Journyx, Inc.
7600 Burnet Road #300
Austin, TX 78757
www.journyx.com <http://www.journyx.com;
p 512.834.8888
f 512-834-8858
Do you receive our promotional emails? Click here
<http://journyx.com/communication-preferences; or visit
http://journyx.com/communication-preferences to unsubscribe.
^ permalink raw reply [nested|flat] 9+ messages in thread
* Re: Performance difference between servers
@ 2017-11-15 17:43 kpi6288@gmail.com
parent: Scott Whitney <scott@journyx.com>
1 sibling, 2 replies; 9+ messages in thread
From: kpi6288@gmail.com @ 2017-11-15 17:43 UTC (permalink / raw)
To: pgsql-admin
Trying as best as a can:
#1 HP 8200 Elite microtower, i7-2600, 16GB RAM, 1 SSD 480 GB, 1 SSD 900 GB,
Hyper-V 2012 R2 (not 2008 R2 as written in my original question)
#2 Lenovo TS 150, E3-1245 V5, 40GB RAM, 2 SSD 850GB as RAID 1 (BIOS level),
2 HDDs 1TB as RAID 1 (BIOS level)
#3 model unknown, E3-1270 V3, 32GB RAM, 2 SSD 480GB as RAID 1 (BIOS level)
Server #1 is more a PC than a server.
Server #1 runs in total 4 virtual guests. 8GB and 6 "cores" dedicated to the
server running PostgreSQL and 3GB to other machines which are almost 100%
idle.
Server #2 has currently on the one guets running PostgreSQL with 16GB RAM
and 6 "cores" dedicated.
Server #3 runs 2 virtual guests. 12GB and 4 cores dedicated tot he guest
runnning PostgreSQL. 4 GB and 3 cores decicated to another guest with is
practically idle.
Servers #2 and #3 have still plenty of free disk space while server #1 is
using approx. 70% oft he disks.
Server #1 has much older SSDs than #2. Not sure about #3.
Von: Scott Whitney [mailto:scott@journyx.com]
Gesendet: Mittwoch, 15. November 2017 18:19
An: kpi6288@gmail.com
Betreff: Re: [ADMIN] Performance difference between servers
Can you post the hardware host specs for #1, #2 and #3? If those ARE the
hardware specs (for example, you list SSDs), can you list the resources
assigned to the guests?
_____
From: kpi6288@gmail.com <mailto:kpi6288@gmail.com> <kpi6288@gmail.com
<mailto:kpi6288@gmail.com> >
Sent: Wednesday, November 15, 2017 11:15 AM
To: Scott Whitney
Subject: AW: [ADMIN] Performance difference between servers
Yes, exactly:
Three different (hardware) machines, each having a hyper-V host and the
Windows Servers as Hyper-V guests.
Von: Scott Whitney [mailto:scott@journyx.com]
Gesendet: Mittwoch, 15. November 2017 18:11
An: kpi6288@gmail.com <mailto:kpi6288@gmail.com> ;
pgsql-admin@postgresql.org <mailto:pgsql-admin@postgresql.org>
Betreff: Re: [ADMIN] Performance difference between servers
Are you saying that each of these servers is a virtual HyperV machine
running under a hardware host?
_____
From: pgsql-admin-owner@postgresql.org
<mailto:pgsql-admin-owner@postgresql.org> <pgsql-admin-owner@postgresql.org
<mailto:pgsql-admin-owner@postgresql.org> > on behalf of kpi6288@gmail.com
<mailto:kpi6288@gmail.com> <kpi6288@gmail.com <mailto:kpi6288@gmail.com> >
Sent: Wednesday, November 15, 2017 11:06 AM
To: pgsql-admin@postgresql.org <mailto:pgsql-admin@postgresql.org>
Subject: [ADMIN] Performance difference between servers
We have 3 different servers, one (the oldest) ist significantly faster at
certain operations and I can't find out the reason:
(table created in monospace font)
Server Processor RAM CrystalDiskMark pgbench CREATE DATABASE OS
#1 i7-2600 8GB 495 / 473 26.000 4.5 . 6 s W/
Server 2008 R2 on Hyper V Server 2008
#2 E3-1245 16GB 797 / 514 50.000 13 . 19 s W/
Server 2016 Std. on Hyper V Server 2016
#3 E3-1270 12GB 933 / 334 40.000 13 . 20 s W/
Server 2008 Essentials on Hyper V Server 2016
CrystalDiskMark: "Seq Q32T1"
Pgbench:
pgbench -i -s 200 -U postgres pgbench
pgbench -c 40 -j 10 -T 150 -U postgres -S -P 5 pgbench
CREATE DATABASE:
create database test with template myTemplate
All running PostgreSQL 9.6 x64 with similar configuration. All running as
virtual machines, no other virtual machines creating any load. Using the
same template database on all machines.
Although the indicative numbers of pgbench and CrystalDiskMark show better
values for server #2 and #3, server #1 creates a new database considerably
faster.
All servers have SSDs. Server #1 has two single SSDs (a system disk and a
data disk). Servers #2 and #3 have only one logical disk for system and
data, and this is two SSDs running as RAID 1. This may be slower but if it
is, I would excpect this also to show up in the pgbench results.
The reason behind this exercise is that a test application was also reported
to be slower on server #2 and 3.
Any idea how to track down the performance difference?
Thank you
Klaus
Journyx, Inc.
7600 Burnet Road #300
Austin, TX 78757
www.journyx.com <http://www.journyx.com;
p 512.834.8888
f 512-834-8858
Do you receive our promotional emails? Click here
<http://journyx.com/communication-preferences; or visit
http://journyx.com/communication-preferences to unsubscribe.
^ permalink raw reply [nested|flat] 9+ messages in thread
* Re: Performance difference between servers
@ 2017-11-15 17:59 Scott Whitney <scott@journyx.com>
parent: kpi6288@gmail.com
1 sibling, 1 reply; 9+ messages in thread
From: Scott Whitney @ 2017-11-15 17:59 UTC (permalink / raw)
To: kpi6288@gmail.com <kpi6288@gmail.com>; pgsql-admin
Well, you've got me stumped a bit on this. I prefer the easy ones. 😉
The only thing I see here that is suspect is the 2 1TB spindle drives, but if that were the situation, you would just see server #2 as the outlier which is not what you're seeing.
A few things I would check:
1) postgresql.conf on all 3 servers. What are the differences if any?
2) Logging on all systems from the host OS to the guest OS to pg (in the conf file).
3) Are these commands running local to the server or remote from another host?
4) Check the free RAM on the host OSes. Make sure you're not paging in the host. Whether the guests are idle or not, it won't matter if the host OS is swapping. I doubt it based on the specs you sent.
Comparing #1 and #3 (leaving 2 out for the moment) gives you pretty much a 1:1 hardware comparison.
If I read this correctly, running the same create db statement on #3 as #1 take minimum twice the amount of time? That ain't right.
________________________________
From: pgsql-admin-owner@postgresql.org <pgsql-admin-owner@postgresql.org> on behalf of kpi6288@gmail.com <kpi6288@gmail.com>
Sent: Wednesday, November 15, 2017 11:43 AM
To: pgsql-admin@postgresql.org
Subject: Re: [ADMIN] Performance difference between servers
Trying as best as a can:
#1 HP 8200 Elite microtower, i7-2600, 16GB RAM, 1 SSD 480 GB, 1 SSD 900 GB, Hyper-V 2012 R2 (not 2008 R2 as written in my original question)
#2 Lenovo TS 150, E3-1245 V5, 40GB RAM, 2 SSD 850GB as RAID 1 (BIOS level), 2 HDDs 1TB as RAID 1 (BIOS level)
#3 model unknown, E3-1270 V3, 32GB RAM, 2 SSD 480GB as RAID 1 (BIOS level)
Server #1 is more a PC than a server.
Server #1 runs in total 4 virtual guests. 8GB and 6 „cores“ dedicated to the server running PostgreSQL and 3GB to other machines which are almost 100% idle.
Server #2 has currently on the one guets running PostgreSQL with 16GB RAM and 6 „cores“ dedicated.
Server #3 runs 2 virtual guests. 12GB and 4 cores dedicated tot he guest runnning PostgreSQL. 4 GB and 3 cores decicated to another guest with is practically idle.
Servers #2 and #3 have still plenty of free disk space while server #1 is using approx. 70% oft he disks.
Server #1 has much older SSDs than #2. Not sure about #3.
Von: Scott Whitney [mailto:scott@journyx.com]
Gesendet: Mittwoch, 15. November 2017 18:19
An: kpi6288@gmail.com
Betreff: Re: [ADMIN] Performance difference between servers
Can you post the hardware host specs for #1, #2 and #3? If those ARE the hardware specs (for example, you list SSDs), can you list the resources assigned to the guests?
________________________________
From: kpi6288@gmail.com<mailto:kpi6288@gmail.com> <kpi6288@gmail.com<mailto:kpi6288@gmail.com>>
Sent: Wednesday, November 15, 2017 11:15 AM
To: Scott Whitney
Subject: AW: [ADMIN] Performance difference between servers
Yes, exactly:
Three different (hardware) machines, each having a hyper-V host and the Windows Servers as Hyper-V guests.
Von: Scott Whitney [mailto:scott@journyx.com]
Gesendet: Mittwoch, 15. November 2017 18:11
An: kpi6288@gmail.com<mailto:kpi6288@gmail.com>; pgsql-admin@postgresql.org<mailto:pgsql-admin@postgresql.org>
Betreff: Re: [ADMIN] Performance difference between servers
Are you saying that each of these servers is a virtual HyperV machine running under a hardware host?
________________________________
From: pgsql-admin-owner@postgresql.org<mailto:pgsql-admin-owner@postgresql.org> <pgsql-admin-owner@postgresql.org<mailto:pgsql-admin-owner@postgresql.org>> on behalf of kpi6288@gmail.com<mailto:kpi6288@gmail.com> <kpi6288@gmail.com<mailto:kpi6288@gmail.com>>
Sent: Wednesday, November 15, 2017 11:06 AM
To: pgsql-admin@postgresql.org<mailto:pgsql-admin@postgresql.org>
Subject: [ADMIN] Performance difference between servers
We have 3 different servers, one (the oldest) ist significantly faster at certain operations and I can’t find out the reason:
(table created in monospace font)
Server Processor RAM CrystalDiskMark pgbench CREATE DATABASE OS
#1 i7-2600 8GB 495 / 473 26.000 4.5 … 6 s W/ Server 2008 R2 on Hyper V Server 2008
#2 E3-1245 16GB 797 / 514 50.000 13 … 19 s W/ Server 2016 Std. on Hyper V Server 2016
#3 E3-1270 12GB 933 / 334 40.000 13 … 20 s W/ Server 2008 Essentials on Hyper V Server 2016
CrystalDiskMark: „Seq Q32T1“
Pgbench:
pgbench -i -s 200 -U postgres pgbench
pgbench -c 40 -j 10 -T 150 -U postgres -S -P 5 pgbench
CREATE DATABASE:
create database test with template myTemplate
All running PostgreSQL 9.6 x64 with similar configuration. All running as virtual machines, no other virtual machines creating any load. Using the same template database on all machines.
Although the indicative numbers of pgbench and CrystalDiskMark show better values for server #2 and #3, server #1 creates a new database considerably faster.
All servers have SSDs. Server #1 has two single SSDs (a system disk and a data disk). Servers #2 and #3 have only one logical disk for system and data, and this is two SSDs running as RAID 1. This may be slower but if it is, I would excpect this also to show up in the pgbench results.
The reason behind this exercise is that a test application was also reported to be slower on server #2 and 3.
Any idea how to track down the performance difference?
Thank you
Klaus
Journyx, Inc.
7600 Burnet Road #300
Austin, TX 78757
www.journyx.com<http://www.journyx.com;
p 512.834.8888
f 512-834-8858
Do you receive our promotional emails? Click here <http://journyx.com/communication-preferences; or visit http://journyx.com/communication-preferences to unsubscribe.
^ permalink raw reply [nested|flat] 9+ messages in thread
* Re: Performance difference between servers
@ 2017-11-15 18:21 Evan Rempel <erempel@uvic.ca>
parent: Scott Whitney <scott@journyx.com>
0 siblings, 1 reply; 9+ messages in thread
From: Evan Rempel @ 2017-11-15 18:21 UTC (permalink / raw)
To: pgsql-admin
I would expect any heavy write task to take 100% longer on a RAID 1
system. Unless you have a higher end RAID controller, the RAID 1 will
write data to one drive, and then write the same data to the second
drive. If you can test this, break the RAID 1 mirror and retry your test.
Evan.
On 11/15/2017 09:59 AM, Scott Whitney wrote:
>
> Well, you've got me stumped a bit on this. I prefer the easy ones. 😉
>
>
> The only thing I see here that is suspect is the 2 1TB spindle drives,
> but if that were the situation, you would just see server #2 as the
> outlier which is not what you're seeing.
>
>
> A few things I would check:
>
>
> 1) postgresql.conf on all 3 servers. What are the differences if any?
>
> 2) Logging on all systems from the host OS to the guest OS to pg (in
> the conf file).
>
> 3) Are these commands running local to the server or remote from
> another host?
>
> 4) Check the free RAM on the host OSes. Make sure you're not paging in
> the host. Whether the guests are idle or not, it won't matter if the
> host OS is swapping. I doubt it based on the specs you sent.
>
>
> Comparing #1 and #3 (leaving 2 out for the moment) gives you pretty
> much a 1:1 hardware comparison.
>
>
> If I read this correctly, running the same create db statement on #3
> as #1 take minimum twice the amount of time? That ain't right.
>
>
>
>
> ------------------------------------------------------------------------
> *From:* pgsql-admin-owner@postgresql.org
> <pgsql-admin-owner@postgresql.org> on behalf of kpi6288@gmail.com
> <kpi6288@gmail.com>
> *Sent:* Wednesday, November 15, 2017 11:43 AM
> *To:* pgsql-admin@postgresql.org
> *Subject:* Re: [ADMIN] Performance difference between servers
>
> Trying as best as a can:
>
> #1 HP 8200 Elite microtower, i7-2600, 16GB RAM, 1 SSD 480 GB, 1 SSD
> 900 GB, Hyper-V 2012 R2 (not 2008 R2 as written in my original question)
>
> #2 Lenovo TS 150, E3-1245 V5, 40GB RAM, 2 SSD 850GB as RAID 1 (BIOS
> level), 2 HDDs 1TB as RAID 1 (BIOS level)
>
> #3 model unknown, E3-1270 V3, 32GB RAM, 2 SSD 480GB as RAID 1 (BIOS level)
>
> Server #1 is more a PC than a server.
>
> Server #1 runs in total 4 virtual guests. 8GB and 6 „cores“ dedicated
> to the server running PostgreSQL and 3GB to other machines which are
> almost 100% idle.
>
> Server #2 has currently on the one guets running PostgreSQL with 16GB
> RAM and 6 „cores“ dedicated.
>
> Server #3 runs 2 virtual guests. 12GB and 4 cores dedicated tot he
> guest runnning PostgreSQL. 4 GB and 3 cores decicated to another guest
> with is practically idle.
>
> Servers #2 and #3 have still plenty of free disk space while server #1
> is using approx. 70% oft he disks.
>
> Server #1 has much older SSDs than #2. Not sure about #3.
>
> *Von:* Scott Whitney [mailto:scott@journyx.com]
> *Gesendet:* Mittwoch, 15. November 2017 18:19
> *An:* kpi6288@gmail.com
> *Betreff:* Re: [ADMIN] Performance difference between servers
>
> Can you post the hardware host specs for #1, #2 and #3? If those ARE
> the hardware specs (for example, you list SSDs), can you list the
> resources assigned to the guests?
>
> ------------------------------------------------------------------------
>
> *From:*kpi6288@gmail.com <mailto:kpi6288@gmail.com> <kpi6288@gmail.com
> <mailto:kpi6288@gmail.com>>
> *Sent:* Wednesday, November 15, 2017 11:15 AM
> *To:* Scott Whitney
> *Subject:* AW: [ADMIN] Performance difference between servers
>
> Yes, exactly:
>
> Three different (hardware) machines, each having a hyper-V host and
> the Windows Servers as Hyper-V guests.
>
> *Von:*Scott Whitney [mailto:scott@journyx.com]
> *Gesendet:* Mittwoch, 15. November 2017 18:11
> *An:* kpi6288@gmail.com <mailto:kpi6288@gmail.com>;
> pgsql-admin@postgresql.org <mailto:pgsql-admin@postgresql.org>
> *Betreff:* Re: [ADMIN] Performance difference between servers
>
> Are you saying that each of these servers is a virtual HyperV machine
> running under a hardware host?
>
> ------------------------------------------------------------------------
>
> *From:*pgsql-admin-owner@postgresql.org
> <mailto:pgsql-admin-owner@postgresql.org>
> <pgsql-admin-owner@postgresql.org
> <mailto:pgsql-admin-owner@postgresql.org>> on behalf of
> kpi6288@gmail.com <mailto:kpi6288@gmail.com> <kpi6288@gmail.com
> <mailto:kpi6288@gmail.com>>
> *Sent:* Wednesday, November 15, 2017 11:06 AM
> *To:* pgsql-admin@postgresql.org <mailto:pgsql-admin@postgresql.org>
> *Subject:* [ADMIN] Performance difference between servers
>
> We have 3 different servers, one (the oldest) ist significantly faster
> at certain operations and I can’t find out the reason:
>
> (table created in monospace font)
>
> Server Processor RAM CrystalDiskMark pgbench CREATE DATABASE OS
>
> #1 i7-2600 8GB 495 / 473 26.000 4.5 … 6 s W/
> Server 2008 R2 on Hyper V Server 2008
>
> #2 E3-1245 16GB 797 / 514 50.000 13 … 19 s W/
> Server 2016 Std. on Hyper V Server 2016
>
> #3 E3-1270 12GB 933 / 334 40.000 13 … 20 s W/
> Server 2008 Essentials on Hyper V Server 2016
>
> CrystalDiskMark: „Seq Q32T1“
>
> Pgbench:
>
> pgbench -i -s 200 -U postgres pgbench
>
> pgbench -c 40 -j 10 -T 150 -U postgres -S -P 5 pgbench
>
> CREATE DATABASE:
>
> create database test with template myTemplate
>
> All running PostgreSQL 9.6 x64 with similar configuration. All running
> as virtual machines, no other virtual machines creating any load.
> Using the same template database on all machines.
>
> Although the indicative numbers of pgbench and CrystalDiskMark show
> better values for server #2 and #3, server #1 creates a new database
> considerably faster.
>
> All servers have SSDs. Server #1 has two single SSDs (a system disk
> and a data disk). Servers #2 and #3 have only one logical disk for
> system and data, and this is two SSDs running as RAID 1. This may be
> slower but if it is, I would excpect this also to show up in the
> pgbench results.
>
> The reason behind this exercise is that a test application was also
> reported to be slower on server #2 and 3.
>
> Any idea how to track down the performance difference?
>
> Thank you
>
> Klaus
>
> Journyx, Inc.
>
> 7600 Burnet Road #300
> Austin, TX 78757
> www.journyx.com <http://www.journyx.com;
>
> p 512.834.8888
>
> f 512-834-8858
>
> Do you receive our promotional emails? Click here
> <http://journyx.com/communication-preferences>or visit
> http://journyx.com/communication-preferences to unsubscribe.
>
^ permalink raw reply [nested|flat] 9+ messages in thread
* Re: Performance difference between servers
@ 2017-11-15 18:25 Scott Whitney <scott@journyx.com>
parent: Evan Rempel <erempel@uvic.ca>
0 siblings, 1 reply; 9+ messages in thread
From: Scott Whitney @ 2017-11-15 18:25 UTC (permalink / raw)
To: Evan Rempel <erempel@uvic.ca>; pgsql-admin
That's a very valid point, Evan, which slipped my mind entirely. Klaus said that they're BIOS RAID. I would expect a performance hit there, yes.
________________________________
From: pgsql-admin-owner@postgresql.org <pgsql-admin-owner@postgresql.org> on behalf of Evan Rempel <erempel@uvic.ca>
Sent: Wednesday, November 15, 2017 12:21 PM
To: pgsql-admin@postgresql.org
Subject: Re: [ADMIN] Performance difference between servers
I would expect any heavy write task to take 100% longer on a RAID 1 system. Unless you have a higher end RAID controller, the RAID 1 will write data to one drive, and then write the same data to the second drive. If you can test this, break the RAID 1 mirror and retry your test.
Evan.
On 11/15/2017 09:59 AM, Scott Whitney wrote:
Well, you've got me stumped a bit on this. I prefer the easy ones. 😉
The only thing I see here that is suspect is the 2 1TB spindle drives, but if that were the situation, you would just see server #2 as the outlier which is not what you're seeing.
A few things I would check:
1) postgresql.conf on all 3 servers. What are the differences if any?
2) Logging on all systems from the host OS to the guest OS to pg (in the conf file).
3) Are these commands running local to the server or remote from another host?
4) Check the free RAM on the host OSes. Make sure you're not paging in the host. Whether the guests are idle or not, it won't matter if the host OS is swapping. I doubt it based on the specs you sent.
Comparing #1 and #3 (leaving 2 out for the moment) gives you pretty much a 1:1 hardware comparison.
If I read this correctly, running the same create db statement on #3 as #1 take minimum twice the amount of time? That ain't right.
________________________________
From: pgsql-admin-owner@postgresql.org<mailto:pgsql-admin-owner@postgresql.org> <pgsql-admin-owner@postgresql.org><mailto:pgsql-admin-owner@postgresql.org> on behalf of kpi6288@gmail.com<mailto:kpi6288@gmail.com> <kpi6288@gmail.com><mailto:kpi6288@gmail.com>
Sent: Wednesday, November 15, 2017 11:43 AM
To: pgsql-admin@postgresql.org<mailto:pgsql-admin@postgresql.org>
Subject: Re: [ADMIN] Performance difference between servers
Trying as best as a can:
#1 HP 8200 Elite microtower, i7-2600, 16GB RAM, 1 SSD 480 GB, 1 SSD 900 GB, Hyper-V 2012 R2 (not 2008 R2 as written in my original question)
#2 Lenovo TS 150, E3-1245 V5, 40GB RAM, 2 SSD 850GB as RAID 1 (BIOS level), 2 HDDs 1TB as RAID 1 (BIOS level)
#3 model unknown, E3-1270 V3, 32GB RAM, 2 SSD 480GB as RAID 1 (BIOS level)
Server #1 is more a PC than a server.
Server #1 runs in total 4 virtual guests. 8GB and 6 „cores“ dedicated to the server running PostgreSQL and 3GB to other machines which are almost 100% idle.
Server #2 has currently on the one guets running PostgreSQL with 16GB RAM and 6 „cores“ dedicated.
Server #3 runs 2 virtual guests. 12GB and 4 cores dedicated tot he guest runnning PostgreSQL. 4 GB and 3 cores decicated to another guest with is practically idle.
Servers #2 and #3 have still plenty of free disk space while server #1 is using approx. 70% oft he disks.
Server #1 has much older SSDs than #2. Not sure about #3.
Von: Scott Whitney [mailto:scott@journyx.com]
Gesendet: Mittwoch, 15. November 2017 18:19
An: kpi6288@gmail.com<mailto:kpi6288@gmail.com>
Betreff: Re: [ADMIN] Performance difference between servers
Can you post the hardware host specs for #1, #2 and #3? If those ARE the hardware specs (for example, you list SSDs), can you list the resources assigned to the guests?
________________________________
From: kpi6288@gmail.com<mailto:kpi6288@gmail.com> <kpi6288@gmail.com<mailto:kpi6288@gmail.com>>
Sent: Wednesday, November 15, 2017 11:15 AM
To: Scott Whitney
Subject: AW: [ADMIN] Performance difference between servers
Yes, exactly:
Three different (hardware) machines, each having a hyper-V host and the Windows Servers as Hyper-V guests.
Von: Scott Whitney [mailto:scott@journyx.com]
Gesendet: Mittwoch, 15. November 2017 18:11
An: kpi6288@gmail.com<mailto:kpi6288@gmail.com>; pgsql-admin@postgresql.org<mailto:pgsql-admin@postgresql.org>
Betreff: Re: [ADMIN] Performance difference between servers
Are you saying that each of these servers is a virtual HyperV machine running under a hardware host?
________________________________
From: pgsql-admin-owner@postgresql.org<mailto:pgsql-admin-owner@postgresql.org> <pgsql-admin-owner@postgresql.org<mailto:pgsql-admin-owner@postgresql.org>> on behalf of kpi6288@gmail.com<mailto:kpi6288@gmail.com> <kpi6288@gmail.com<mailto:kpi6288@gmail.com>>
Sent: Wednesday, November 15, 2017 11:06 AM
To: pgsql-admin@postgresql.org<mailto:pgsql-admin@postgresql.org>
Subject: [ADMIN] Performance difference between servers
We have 3 different servers, one (the oldest) ist significantly faster at certain operations and I can’t find out the reason:
(table created in monospace font)
Server Processor RAM CrystalDiskMark pgbench CREATE DATABASE OS
#1 i7-2600 8GB 495 / 473 26.000 4.5 … 6 s W/ Server 2008 R2 on Hyper V Server 2008
#2 E3-1245 16GB 797 / 514 50.000 13 … 19 s W/ Server 2016 Std. on Hyper V Server 2016
#3 E3-1270 12GB 933 / 334 40.000 13 … 20 s W/ Server 2008 Essentials on Hyper V Server 2016
CrystalDiskMark: „Seq Q32T1“
Pgbench:
pgbench -i -s 200 -U postgres pgbench
pgbench -c 40 -j 10 -T 150 -U postgres -S -P 5 pgbench
CREATE DATABASE:
create database test with template myTemplate
All running PostgreSQL 9.6 x64 with similar configuration. All running as virtual machines, no other virtual machines creating any load. Using the same template database on all machines.
Although the indicative numbers of pgbench and CrystalDiskMark show better values for server #2 and #3, server #1 creates a new database considerably faster.
All servers have SSDs. Server #1 has two single SSDs (a system disk and a data disk). Servers #2 and #3 have only one logical disk for system and data, and this is two SSDs running as RAID 1. This may be slower but if it is, I would excpect this also to show up in the pgbench results.
The reason behind this exercise is that a test application was also reported to be slower on server #2 and 3.
Any idea how to track down the performance difference?
Thank you
Klaus
Journyx, Inc.
7600 Burnet Road #300
Austin, TX 78757
www.journyx.com<http://www.journyx.com;
p 512.834.8888
f 512-834-8858
Do you receive our promotional emails? Click here <http://journyx.com/communication-preferences; or visit http://journyx.com/communication-preferences to unsubscribe.
^ permalink raw reply [nested|flat] 9+ messages in thread
* Re: Performance difference between servers
@ 2017-11-15 19:21 Klaus P. Pieper <kpi6288@gmail.com>
parent: Scott Whitney <scott@journyx.com>
0 siblings, 0 replies; 9+ messages in thread
From: Klaus P. Pieper @ 2017-11-15 19:21 UTC (permalink / raw)
To: pgsql-admin
The BIOS RAID was one of my first thoughts, too. But both CrystalDiskMark and pgbench show better values fort he servers running on the RAID systems.
One other thing that came into mind is that server #1 might use fixed VHDs whereas #2 and #3 use dynamic VHDs. I‘ not sure about #1 but will investigate this tomorrow.
I compared the postgresql.conf files already and they are very similar, nothing that should explain such a big difference.
Klaus
Von: pgsql-admin-owner@postgresql.org [mailto:pgsql-admin-owner@postgresql.org] Im Auftrag von Scott Whitney
Gesendet: Mittwoch, 15. November 2017 19:25
An: Evan Rempel <erempel@uvic.ca>; pgsql-admin@postgresql.org
Betreff: Re: [ADMIN] Performance difference between servers
That's a very valid point, Evan, which slipped my mind entirely. Klaus said that they're BIOS RAID. I would expect a performance hit there, yes.
_____
From: pgsql-admin-owner@postgresql.org <mailto:pgsql-admin-owner@postgresql.org> <pgsql-admin-owner@postgresql.org <mailto:pgsql-admin-owner@postgresql.org> > on behalf of Evan Rempel <erempel@uvic.ca <mailto:erempel@uvic.ca> >
Sent: Wednesday, November 15, 2017 12:21 PM
To: pgsql-admin@postgresql.org <mailto:pgsql-admin@postgresql.org>
Subject: Re: [ADMIN] Performance difference between servers
I would expect any heavy write task to take 100% longer on a RAID 1 system. Unless you have a higher end RAID controller, the RAID 1 will write data to one drive, and then write the same data to the second drive. If you can test this, break the RAID 1 mirror and retry your test.
Evan.
On 11/15/2017 09:59 AM, Scott Whitney wrote:
Well, you've got me stumped a bit on this. I prefer the easy ones. 😉
The only thing I see here that is suspect is the 2 1TB spindle drives, but if that were the situation, you would just see server #2 as the outlier which is not what you're seeing.
A few things I would check:
1) postgresql.conf on all 3 servers. What are the differences if any?
2) Logging on all systems from the host OS to the guest OS to pg (in the conf file).
3) Are these commands running local to the server or remote from another host?
4) Check the free RAM on the host OSes. Make sure you're not paging in the host. Whether the guests are idle or not, it won't matter if the host OS is swapping. I doubt it based on the specs you sent.
Comparing #1 and #3 (leaving 2 out for the moment) gives you pretty much a 1:1 hardware comparison.
If I read this correctly, running the same create db statement on #3 as #1 take minimum twice the amount of time? That ain't right.
_____
From: pgsql-admin-owner@postgresql.org <mailto:pgsql-admin-owner@postgresql.org> <mailto:pgsql-admin-owner@postgresql.org> <pgsql-admin-owner@postgresql.org> on behalf of kpi6288@gmail.com <mailto:kpi6288@gmail.com> <mailto:kpi6288@gmail.com> <kpi6288@gmail.com>
Sent: Wednesday, November 15, 2017 11:43 AM
To: pgsql-admin@postgresql.org <mailto:pgsql-admin@postgresql.org>
Subject: Re: [ADMIN] Performance difference between servers
Trying as best as a can:
#1 HP 8200 Elite microtower, i7-2600, 16GB RAM, 1 SSD 480 GB, 1 SSD 900 GB, Hyper-V 2012 R2 (not 2008 R2 as written in my original question)
#2 Lenovo TS 150, E3-1245 V5, 40GB RAM, 2 SSD 850GB as RAID 1 (BIOS level), 2 HDDs 1TB as RAID 1 (BIOS level)
#3 model unknown, E3-1270 V3, 32GB RAM, 2 SSD 480GB as RAID 1 (BIOS level)
Server #1 is more a PC than a server.
Server #1 runs in total 4 virtual guests. 8GB and 6 „cores“ dedicated to the server running PostgreSQL and 3GB to other machines which are almost 100% idle.
Server #2 has currently on the one guets running PostgreSQL with 16GB RAM and 6 „cores“ dedicated.
Server #3 runs 2 virtual guests. 12GB and 4 cores dedicated tot he guest runnning PostgreSQL. 4 GB and 3 cores decicated to another guest with is practically idle.
Servers #2 and #3 have still plenty of free disk space while server #1 is using approx. 70% oft he disks.
Server #1 has much older SSDs than #2. Not sure about #3.
Von: Scott Whitney [mailto:scott@journyx.com]
Gesendet: Mittwoch, 15. November 2017 18:19
An: kpi6288@gmail.com <mailto:kpi6288@gmail.com>
Betreff: Re: [ADMIN] Performance difference between servers
Can you post the hardware host specs for #1, #2 and #3? If those ARE the hardware specs (for example, you list SSDs), can you list the resources assigned to the guests?
_____
From: kpi6288@gmail.com <mailto:kpi6288@gmail.com> <kpi6288@gmail.com <mailto:kpi6288@gmail.com> >
Sent: Wednesday, November 15, 2017 11:15 AM
To: Scott Whitney
Subject: AW: [ADMIN] Performance difference between servers
Yes, exactly:
Three different (hardware) machines, each having a hyper-V host and the Windows Servers as Hyper-V guests.
Von: Scott Whitney [mailto:scott@journyx.com]
Gesendet: Mittwoch, 15. November 2017 18:11
An: kpi6288@gmail.com <mailto:kpi6288@gmail.com> ; pgsql-admin@postgresql.org <mailto:pgsql-admin@postgresql.org>
Betreff: Re: [ADMIN] Performance difference between servers
Are you saying that each of these servers is a virtual HyperV machine running under a hardware host?
_____
From: pgsql-admin-owner@postgresql.org <mailto:pgsql-admin-owner@postgresql.org> <pgsql-admin-owner@postgresql.org <mailto:pgsql-admin-owner@postgresql.org> > on behalf of kpi6288@gmail.com <mailto:kpi6288@gmail.com> <kpi6288@gmail.com <mailto:kpi6288@gmail.com> >
Sent: Wednesday, November 15, 2017 11:06 AM
To: pgsql-admin@postgresql.org <mailto:pgsql-admin@postgresql.org>
Subject: [ADMIN] Performance difference between servers
We have 3 different servers, one (the oldest) ist significantly faster at certain operations and I can’t find out the reason:
(table created in monospace font)
Server Processor RAM CrystalDiskMark pgbench CREATE DATABASE OS
#1 i7-2600 8GB 495 / 473 26.000 4.5 … 6 s W/ Server 2008 R2 on Hyper V Server 2008
#2 E3-1245 16GB 797 / 514 50.000 13 … 19 s W/ Server 2016 Std. on Hyper V Server 2016
#3 E3-1270 12GB 933 / 334 40.000 13 … 20 s W/ Server 2008 Essentials on Hyper V Server 2016
CrystalDiskMark: „Seq Q32T1“
Pgbench:
pgbench -i -s 200 -U postgres pgbench
pgbench -c 40 -j 10 -T 150 -U postgres -S -P 5 pgbench
CREATE DATABASE:
create database test with template myTemplate
All running PostgreSQL 9.6 x64 with similar configuration. All running as virtual machines, no other virtual machines creating any load. Using the same template database on all machines.
Although the indicative numbers of pgbench and CrystalDiskMark show better values for server #2 and #3, server #1 creates a new database considerably faster.
All servers have SSDs. Server #1 has two single SSDs (a system disk and a data disk). Servers #2 and #3 have only one logical disk for system and data, and this is two SSDs running as RAID 1. This may be slower but if it is, I would excpect this also to show up in the pgbench results.
The reason behind this exercise is that a test application was also reported to be slower on server #2 and 3.
Any idea how to track down the performance difference?
Thank you
Klaus
Journyx, Inc.
7600 Burnet Road #300
Austin, TX 78757
www.journyx.com <http://www.journyx.com;
p 512.834.8888
f 512-834-8858
Do you receive our promotional emails? Click here <http://journyx.com/communication-preferences; or visit http://journyx.com/communication-preferences to unsubscribe.
---
Diese E-Mail wurde von Avast Antivirus-Software auf Viren geprüft.
https://www.avast.com/antivirus
^ permalink raw reply [nested|flat] 9+ messages in thread
* Re: Performance difference between servers
@ 2017-11-15 23:42 Rui DeSousa <rui.desousa@icloud.com>
parent: kpi6288@gmail.com
1 sibling, 0 replies; 9+ messages in thread
From: Rui DeSousa @ 2017-11-15 23:42 UTC (permalink / raw)
To: kpi6288@gmail.com; +Cc: pgsql-admin
There is a log of variables there. Is the i7 single core performance faster than the E3? Bus/memory speeds, etc. I would also consider any vCPU imbalances. You could end up with guest scheduling issue; i.e if guest requires 1 core but is allocated 4 cores; then for 4 cores still need to be available and ready to schedule the guest even if it current need is only 1 core at the moment.
> On Nov 15, 2017, at 12:43 PM, kpi6288@gmail.com wrote:
>
> Trying as best as a can:
>
> #1 HP 8200 Elite microtower, i7-2600, 16GB RAM, 1 SSD 480 GB, 1 SSD 900 GB, Hyper-V 2012 R2 (not 2008 R2 as written in my original question)
> #2 Lenovo TS 150, E3-1245 V5, 40GB RAM, 2 SSD 850GB as RAID 1 (BIOS level), 2 HDDs 1TB as RAID 1 (BIOS level)
> #3 model unknown, E3-1270 V3, 32GB RAM, 2 SSD 480GB as RAID 1 (BIOS level)
>
> Server #1 is more a PC than a server.
>
> Server #1 runs in total 4 virtual guests. 8GB and 6 „cores“ dedicated to the server running PostgreSQL and 3GB to other machines which are almost 100% idle.
> Server #2 has currently on the one guets running PostgreSQL with 16GB RAM and 6 „cores“ dedicated.
> Server #3 runs 2 virtual guests. 12GB and 4 cores dedicated tot he guest runnning PostgreSQL. 4 GB and 3 cores decicated to another guest with is practically idle.
>
> Servers #2 and #3 have still plenty of free disk space while server #1 is using approx. 70% oft he disks.
>
> Server #1 has much older SSDs than #2. Not sure about #3.
>
> Von: Scott Whitney [mailto:scott@journyx.com <mailto:scott@journyx.com>]
> Gesendet: Mittwoch, 15. November 2017 18:19
> An: kpi6288@gmail.com <mailto:kpi6288@gmail.com>
> Betreff: Re: [ADMIN] Performance difference between servers
>
> Can you post the hardware host specs for #1, #2 and #3? If those ARE the hardware specs (for example, you list SSDs), can you list the resources assigned to the guests?
>
>
> From: kpi6288@gmail.com <mailto:kpi6288@gmail.com> <kpi6288@gmail.com <mailto:kpi6288@gmail.com>>
> Sent: Wednesday, November 15, 2017 11:15 AM
> To: Scott Whitney
> Subject: AW: [ADMIN] Performance difference between servers
>
> Yes, exactly:
>
> Three different (hardware) machines, each having a hyper-V host and the Windows Servers as Hyper-V guests.
>
>
> Von: Scott Whitney [mailto:scott@journyx.com <mailto:scott@journyx.com>]
> Gesendet: Mittwoch, 15. November 2017 18:11
> An: kpi6288@gmail.com <mailto:kpi6288@gmail.com>; pgsql-admin@postgresql.org <mailto:pgsql-admin@postgresql.org>
> Betreff: Re: [ADMIN] Performance difference between servers
>
> Are you saying that each of these servers is a virtual HyperV machine running under a hardware host?
>
>
>
>
> From: pgsql-admin-owner@postgresql.org <mailto:pgsql-admin-owner@postgresql.org> <pgsql-admin-owner@postgresql.org <mailto:pgsql-admin-owner@postgresql.org>> on behalf of kpi6288@gmail.com <mailto:kpi6288@gmail.com> <kpi6288@gmail.com <mailto:kpi6288@gmail.com>>
> Sent: Wednesday, November 15, 2017 11:06 AM
> To: pgsql-admin@postgresql.org <mailto:pgsql-admin@postgresql.org>
> Subject: [ADMIN] Performance difference between servers
>
> We have 3 different servers, one (the oldest) ist significantly faster at certain operations and I can’t find out the reason:
>
> (table created in monospace font)
>
> Server Processor RAM CrystalDiskMark pgbench CREATE DATABASE OS
> #1 i7-2600 8GB 495 / 473 26.000 4.5 … 6 s W/ Server 2008 R2 on Hyper V Server 2008
> #2 E3-1245 16GB 797 / 514 50.000 13 … 19 s W/ Server 2016 Std. on Hyper V Server 2016
> #3 E3-1270 12GB 933 / 334 40.000 13 … 20 s W/ Server 2008 Essentials on Hyper V Server 2016
>
> CrystalDiskMark: „Seq Q32T1“
> Pgbench:
> pgbench -i -s 200 -U postgres pgbench
> pgbench -c 40 -j 10 -T 150 -U postgres -S -P 5 pgbench
> CREATE DATABASE:
> create database test with template myTemplate
>
> All running PostgreSQL 9.6 x64 with similar configuration. All running as virtual machines, no other virtual machines creating any load. Using the same template database on all machines.
>
> Although the indicative numbers of pgbench and CrystalDiskMark show better values for server #2 and #3, server #1 creates a new database considerably faster.
> All servers have SSDs. Server #1 has two single SSDs (a system disk and a data disk). Servers #2 and #3 have only one logical disk for system and data, and this is two SSDs running as RAID 1. This may be slower but if it is, I would excpect this also to show up in the pgbench results.
>
> The reason behind this exercise is that a test application was also reported to be slower on server #2 and 3.
>
> Any idea how to track down the performance difference?
>
> Thank you
> Klaus
>
>
>
> Journyx, Inc.
> 7600 Burnet Road #300
> Austin, TX 78757
> www.journyx.com <http://www.journyx.com/;
>
> p 512.834.8888
> f 512-834-8858
>
> Do you receive our promotional emails? Click here <http://journyx.com/communication-preferences>or visit http://journyx.com/communication-preferences <http://journyx.com/communication-preferences; to unsubscribe.
^ permalink raw reply [nested|flat] 9+ messages in thread
end of thread, other threads:[~2017-11-15 23:42 UTC | newest]
Thread overview: 9+ messages (download: mbox mbox.gz follow: Atom feed)
-- links below jump to the message on this page --
2017-11-15 17:06 Performance difference between servers kpi6288@gmail.com
2017-11-15 17:11 ` Scott Whitney <scott@journyx.com>
2017-11-15 17:17 ` kpi6288@gmail.com
2017-11-15 17:43 ` kpi6288@gmail.com
2017-11-15 17:59 ` Scott Whitney <scott@journyx.com>
2017-11-15 18:21 ` Evan Rempel <erempel@uvic.ca>
2017-11-15 18:25 ` Scott Whitney <scott@journyx.com>
2017-11-15 19:21 ` Klaus P. Pieper <kpi6288@gmail.com>
2017-11-15 23:42 ` Rui DeSousa <rui.desousa@icloud.com>
This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox