pg.ddx.io pgsql-performance@postgresql.org mailing list archive help / color / mirror / Atom feed From: Yeb Havinga <yebhavinga@gmail.com>
To: Scott Marlowe <scott.marlowe@gmail.com>
Cc: Francisco Reyes <lists@stringsutils.com>
Cc: Pgsql performance <pgsql-performance@postgresql.org>
Subject: Re: 10K vs 15k rpm for analytics
Date: Wed, 03 Mar 2010 10:41:21 +0100
Message-ID: <4B8E2EC1.2040100@gmail.com> (raw )
In-Reply-To: <dcc563d11003021334nc2e9505ued5d248562e70d1e@mail.gmail.com >
References: <cone.1267562557.293175.32557.1000@shelca >
<4B8D7A6C.3010304@gmail.com >
<dcc563d11003021334nc2e9505ued5d248562e70d1e@mail.gmail.com >
Scott Marlowe wrote:
> On Tue, Mar 2, 2010 at 1:51 PM, Yeb Havinga <yebhavinga@gmail.com> wrote:
>
>> With 24 drives it'll probably be the controller that is the limiting factor
>> of bandwidth. Our HP SAN controller with 28 15K drives delivers 170MB/s at
>> maximum with raid 0 and about 155MB/s with raid 1+0. So I'd go for the 10K
>> drives and put the saved money towards the controller (or maybe more than
>> one controller).
>>
>
> That's horrifically bad numbers for that many drives. I can get those
> numbers for write performance on a RAID-6 on our office server. I
> wonder what's making your SAN setup so slow?
>
Pre scriptum:
A few minutes ago I mailed detailed information in the same thread but
as reply to an earlier response - it tells more about setup and gives
results of a raid1+0 test.
I just have to react to "horrifically bad" and "slow" :-) : The HP san
can do raid5 on 28 disks also on about 155MBps:
28 disks devided into 7 logical units with raid5, orion results are
below. Please note that this time I did sequential large io. The mixed
read/write MBps maximum here is comparable: around 155MBps.
regards,
Yeb Havinga
ORION VERSION 10.2.0.1.0
Commandline:
-run advanced -testname msa -num_disks 24 -size_small 4 -size_large 1024
-type seq -simulate concat -verbose -write 50 -duration 15 -matrix
detailed -cache_size 256
This maps to this test:
Test: msa
Small IO size: 4 KB
Large IO size: 1024 KB
IO Types: Small Random IOs, Large Sequential Streams
Number of Concurrent IOs Per Stream: 4
Force streams to separate disks: No
Simulated Array Type: CONCAT
Write: 50%
Cache Size: 256 MB
Duration for each Data Point: 15 seconds
Small Columns:, 0, 1, 2, 3, 4, 5,
6, 12, 18, 24, 30, 36, 42, 48, 54,
60, 66, 72, 78, 84, 90, 96, 102, 108,
114, 120
Large Columns:, 0, 1, 2, 3, 4, 8,
12, 16, 20, 24, 28, 32, 36, 40, 44, 48
Total Data Points: 416
Name: /dev/sda1 Size: 109256361984
Name: /dev/sdb1 Size: 109256361984
Name: /dev/sdc1 Size: 109256361984
Name: /dev/sdd1 Size: 109256361984
Name: /dev/sde1 Size: 109256361984
Name: /dev/sdf1 Size: 109256361984
Name: /dev/sdg1 Size: 109256361984
7 FILEs found.
Maximum Large MBPS=157.75 @ Small=0 and Large=1
Maximum Small IOPS=3595 @ Small=66 and Large=1
Minimum Small Latency=2.81 @ Small=1 and Large=0
MBPS matrix
Large/Small, 0, 1, 2, 3, 4, 5, 6,
12, 18, 24, 30, 36, 42, 48, 54, 60,
66, 72, 78, 84, 90, 96, 102, 108, 114, 120
1, 157.75, 156.47, 153.56, 153.45, 144.87, 141.78, 140.60,
112.45, 95.23, 72.80, 80.59, 36.91, 29.76, 42.86, 41.82, 33.87,
34.07, 45.62, 42.97, 26.37, 42.85, 45.49, 44.47, 37.26, 45.67,
36.18
2, 137.58, 128.48, 125.78, 133.85, 120.12, 127.86, 127.05,
119.26, 121.23, 115.00, 117.88, 114.35, 108.61, 106.55, 83.50, 78.61,
92.67, 96.01, 44.02, 70.60, 62.84, 46.52, 69.18, 51.84, 57.19,
59.62
3, 143.10, 134.92, 139.30, 138.62, 137.85, 146.17, 140.41,
138.48, 76.00, 138.17, 123.48, 137.45, 126.51, 137.11, 91.94, 90.33,
129.97, 45.35, 115.92, 89.60, 137.22, 72.46, 89.95, 77.40, 119.17,
82.09
4, 138.47, 133.74, 129.99, 122.33, 126.75, 125.22, 132.30,
120.41, 125.88, 132.21, 96.92, 115.70, 131.65, 66.34, 114.06, 113.62,
116.91, 96.97, 98.69, 127.16, 116.67, 111.53, 128.97, 92.38, 118.14,
78.31
8, 126.59, 127.92, 115.51, 125.02, 123.29, 111.94, 124.31,
125.71, 134.48, 126.40, 127.93, 125.36, 121.75, 121.75, 127.17, 116.51,
121.44, 121.12, 112.32, 121.55, 127.93, 124.86, 118.04, 114.59, 121.72,
114.79
12, 112.40, 122.58, 107.61, 125.42, 128.04, 123.80, 127.17,
127.70, 122.37, 96.52, 115.36, 124.49, 124.07, 129.31, 124.62, 124.23,
105.58, 123.55, 115.67, 120.59, 125.61, 123.57, 121.43, 121.45, 121.44,
113.64
16, 108.88, 119.79, 123.80, 120.55, 120.02, 121.66, 125.71,
122.19, 125.77, 122.27, 119.55, 118.44, 120.51, 104.66, 97.55, 115.43,
101.45, 108.99, 122.30, 100.45, 105.82, 119.56, 121.26, 126.59, 119.54,
115.09
20, 103.88, 122.95, 115.86, 114.59, 121.13, 108.52, 116.90,
121.10, 113.91, 108.20, 111.51, 125.64, 117.57, 120.86, 117.66, 100.40,
104.88, 103.15, 98.10, 104.86, 104.69, 102.99, 121.81, 107.22, 122.68,
106.43
24, 102.64, 102.33, 112.95, 110.63, 108.00, 111.53, 124.33,
103.17, 108.16, 112.63, 97.42, 106.22, 102.54, 117.46, 100.66, 99.01,
104.46, 99.02, 116.02, 112.49, 119.05, 104.03, 102.40, 102.44, 111.15,
99.51
28, 101.12, 102.76, 114.14, 109.72, 120.63, 118.09, 119.85,
113.80, 116.58, 110.24, 101.45, 110.31, 116.06, 112.04, 121.63, 91.26,
98.88, 101.55, 104.51, 116.43, 112.98, 119.46, 120.08, 109.46, 106.29,
96.69
32, 103.41, 117.33, 101.33, 102.29, 102.58, 116.18, 107.12,
114.63, 121.84, 95.14, 108.83, 99.82, 103.11, 99.36, 117.80, 94.91,
103.46, 103.97, 117.35, 100.51, 100.18, 101.98, 118.26, 115.03, 100.45,
107.90
36, 99.90, 97.98, 100.94, 95.56, 118.76, 99.05, 114.02,
93.61, 117.68, 115.22, 114.40, 116.38, 100.38, 99.15, 108.66, 101.67,
106.64, 98.69, 111.99, 108.28, 99.62, 112.67, 118.80, 110.40, 118.86,
108.46
40, 101.51, 103.38, 93.73, 121.69, 106.27, 104.09, 110.81,
105.83, 95.81, 101.47, 105.96, 113.26, 103.61, 114.26, 100.49, 102.35,
111.44, 95.09, 103.02, 106.21, 104.39, 118.31, 96.73, 109.79, 103.71,
99.70
44, 101.17, 107.22, 107.50, 115.19, 104.16, 108.93, 101.62,
111.82, 110.66, 104.13, 109.68, 103.20, 92.04, 104.70, 102.30, 117.28,
106.37, 100.42, 107.81, 105.31, 110.21, 108.66, 116.05, 105.55, 100.64,
106.67
48, 101.00, 104.13, 114.00, 99.55, 107.46, 113.29, 114.32,
108.75, 100.11, 99.89, 104.81, 107.36, 102.93, 106.43, 101.98, 103.15,
101.30, 113.94, 103.07, 102.40, 95.38, 111.33, 93.89, 112.30, 103.58,
101.82
iops matrix
Large/Small, 1, 2, 3, 4, 5, 6, 12,
18, 24, 30, 36, 42, 48, 54, 60, 66,
72, 78, 84, 90, 96, 102, 108, 114, 120
0, 355, 639, 875, 1063, 1230, 1366, 1933,
2297, 2571, 2750, 2981, 3394, 3027, 3045, 3036, 3139,
3218, 3081, 3151, 3203, 3128, 3179, 3093, 3141, 3135
1, 37, 99, 144, 298, 398, 488, 1183,
1637, 2069, 2268, 2613, 2729, 2860, 2983, 3119, 3595,
3065, 3077, 3036, 3008, 3039, 3030, 3067, 3138, 3041
2, 22, 36, 44, 130, 112, 92, 271,
378, 579, 673, 903, 1091, 1131, 1735, 1612, 1809,
1236, 2316, 2302, 1410, 2467, 2526, 2692, 2606, 2625
3, 5, 13, 18, 21, 27, 27, 56,
92, 162, 196, 209, 239, 309, 595, 1551, 611,
2408, 1034, 488, 401, 1226, 1700, 2490, 1516, 2435
4, 8, 10, 33, 38, 53, 38, 137,
191, 165, 502, 369, 212, 1127, 654, 1069, 721,
643, 1046, 537, 803, 1093, 497, 1669, 1120, 1945
8, 3, 8, 6, 15, 24, 19, 61,
47, 90, 139, 109, 174, 184, 154, 261, 294,
289, 460, 338, 199, 425, 433, 633, 475, 599
12, 3, 7, 7, 10, 11, 12, 32,
74, 67, 91, 93, 120, 157, 158, 201, 191,
143, 220, 327, 217, 283, 276, 297, 336, 365
16, 2, 3, 6, 6, 10, 11, 27,
35, 56, 52, 80, 100, 89, 118, 102, 140,
178, 158, 174, 188, 185, 243, 168, 235, 249
20, 1, 3, 5, 6, 8, 11, 15,
30, 30, 54, 44, 70, 76, 87, 104, 79,
121, 115, 128, 135, 147, 158, 194, 184, 250
24, 1, 2, 4, 5, 8, 6, 14,
21, 29, 36, 42, 50, 58, 61, 70, 64,
85, 102, 117, 120, 111, 126, 129, 170, 159
28, 1, 2, 4, 3, 7, 7, 16,
19, 23, 30, 37, 51, 60, 58, 59, 65,
75, 76, 91, 83, 107, 103, 113, 120, 135
32, 1, 2, 3, 3, 6, 6, 12,
17, 19, 28, 30, 31, 32, 44, 49, 57,
53, 82, 87, 80, 84, 106, 106, 96, 93
36, 1, 2, 4, 5, 4, 7, 9,
15, 22, 27, 30, 32, 35, 43, 46, 48,
52, 67, 69, 54, 78, 87, 98, 92, 114
40, 0, 2, 2, 3, 4, 5, 12,
12, 16, 24, 25, 29, 35, 36, 42, 51,
45, 55, 60, 61, 71, 67, 72, 77, 67
44, 0, 2, 2, 3, 4, 4, 10,
12, 19, 20, 24, 24, 25, 32, 34, 40,
43, 58, 62, 60, 71, 75, 75, 68, 81
48, 0, 1, 2, 5, 4, 4, 10,
14, 16, 18, 21, 23, 27, 31, 34, 37,
44, 42, 54, 48, 59, 54, 69, 65, 67
view thread (47+ messages) latest in thread
Message-ID: <4B8E2EC1.2040100@gmail.com>
Permalink: ../4B8E2EC1.2040100@gmail.com/
Also on: postgresql.org/message-id/4B8E2EC1.2040100@gmail.com
copy link · copy postgr.es
reply Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Reply to all the recipients using the --to and --cc options:
reply via email
To: pgsql-performance@postgresql.org
Cc: yebhavinga@gmail.com, scott.marlowe@gmail.com, lists@stringsutils.com
Subject: Re: 10K vs 15k rpm for analytics
In-Reply-To: <4B8E2EC1.2040100@gmail.com>
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox