pg.ddx.io  pgsql-performance@postgresql.org mailing list archive  
help / color / mirror / Atom feed
[OT] linux 3.10 kernel will improve ipc,sysv semaphore scalability
4+ messages / 2 participants
[nested] [flat]

* [OT] linux 3.10 kernel will improve ipc,sysv semaphore scalability
@ 2013-03-26 13:04  Andrea Suisani <sickpig@opinioni.net>
  0 siblings, 1 reply; 4+ messages in thread

From: Andrea Suisani @ 2013-03-26 13:04 UTC (permalink / raw)
  To: pgsql-performance

Hi all,

Just to let the community know that probably Linux kernel 3.10
will include some work to make sysv semaphore code more scalable.
Since Postgres use this kernel features I've thought to post it
here just for the sake of sharing a good news:

The thread where Rik van Riel posts the v3 patch series:

http://thread.gmane.org/gmane.linux.kernel/1460761

Here http://thread.gmane.org/gmane.linux.kernel/1460761/focus=1461794
Davidlohr Bueso (patches co-author) post an interesting results
comparing multiple runs of "[his] Oracle Swingbench DSS" workload.
Reported here for brevity:

TPS:
100 users: 1257.21 (vanilla)    2805.06 (v3 patchset)
400 users: 1437.57 (vanilla)    2664.67 (v3 patchset)
800 users: 1236.89 (vanilla)    2750.73 (v3 patchset)

ipc lock contention:
100 users:  8,74%  (vanilla)    3.17% (v3 patchset)
400 users:  21,86% (vanilla)    5.23% (v3 patchset)
800 users   84,35% (vanilla)    7.39% (v3 patchset)

as soon as I've a spare server to play with and a little
of time I will give it a spin.

Andrea







-- 
Sent via pgsql-performance mailing list (pgsql-performance@postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-performance



^ permalink  raw  reply  [nested|flat] 4+ messages in thread

* Re: [OT] linux 3.10 kernel will improve ipc,sysv semaphore scalability
@ 2013-03-26 18:59  Shaun Thomas <sthomas@optionshouse.com>
  parent: Andrea Suisani <sickpig@opinioni.net>
  0 siblings, 2 replies; 4+ messages in thread

From: Shaun Thomas @ 2013-03-26 18:59 UTC (permalink / raw)
  To: Andrea Suisani <sickpig@opinioni.net>; +Cc: pgsql-performance

On 03/26/2013 08:04 AM, Andrea Suisani wrote:

> TPS:
> 100 users: 1257.21 (vanilla)    2805.06 (v3 patchset)
> 400 users: 1437.57 (vanilla)    2664.67 (v3 patchset)
> 800 users: 1236.89 (vanilla)    2750.73 (v3 patchset)

Wow, I like the look of that. I wonder how this reacts with disabled 
autogrouping and increasing sched_migration_cost. If the completely fair 
scheduler has less locking contention with this patch-set, those tweaks 
may not even be necessary. I need to see if I can find a system to test on.

-- 
Shaun Thomas
OptionsHouse | 141 W. Jackson Blvd. | Suite 500 | Chicago IL, 60604
312-676-8870
sthomas@optionshouse.com

______________________________________________

See http://www.peak6.com/email_disclaimer/ for terms and conditions related to this email


-- 
Sent via pgsql-performance mailing list (pgsql-performance@postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-performance



^ permalink  raw  reply  [nested|flat] 4+ messages in thread

* Re: [OT] linux 3.10 kernel will improve ipc,sysv semaphore scalability
@ 2013-03-29 14:52  Andrea Suisani <sickpig@opinioni.net>
  parent: Shaun Thomas <sthomas@optionshouse.com>
  1 sibling, 0 replies; 4+ messages in thread

From: Andrea Suisani @ 2013-03-29 14:52 UTC (permalink / raw)
  To: pgsql-performance

Hi

On 03/26/2013 07:59 PM, Shaun Thomas wrote:
> On 03/26/2013 08:04 AM, Andrea Suisani wrote:
>
>> TPS:
>> 100 users: 1257.21 (vanilla)    2805.06 (v3 patchset)
>> 400 users: 1437.57 (vanilla)    2664.67 (v3 patchset)
>> 800 users: 1236.89 (vanilla)    2750.73 (v3 patchset)
>
> Wow, I like the look of that.

Me too.

> I wonder how this reacts with disabled autogrouping and increasing
> sched_migration_cost. If the completely fair scheduler has less locking
 > contention with this patch-set, those tweaks may not even be necessary.
 > I need to see if I can find a system to test on.

Yep, I'm eager to test it too, but unfortunately I have
no spare server to use. Probably early next I'll test it
on my workstation.

Andrea




-- 
Sent via pgsql-performance mailing list (pgsql-performance@postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-performance



^ permalink  raw  reply  [nested|flat] 4+ messages in thread

* Re: [OT] linux 3.10 kernel will improve ipc,sysv semaphore scalability
@ 2013-05-16 08:47  Andrea Suisani <sickpig@opinioni.net>
  parent: Shaun Thomas <sthomas@optionshouse.com>
  1 sibling, 0 replies; 4+ messages in thread

From: Andrea Suisani @ 2013-05-16 08:47 UTC (permalink / raw)
  To: sthomas@optionshouse.com; +Cc: pgsql-performance

Hi all,

On 03/26/2013 07:59 PM, Shaun Thomas wrote:
> On 03/26/2013 08:04 AM, Andrea Suisani wrote:
>
>> TPS:
>> 100 users: 1257.21 (vanilla)    2805.06 (v3 patchset)
>> 400 users: 1437.57 (vanilla)    2664.67 (v3 patchset)
>> 800 users: 1236.89 (vanilla)    2750.73 (v3 patchset)
>
> Wow, I like the look of that. I wonder how this reacts with disabled autogrouping and increasing sched_migration_cost. If the completely fair scheduler has less locking contention with this patch-set, those tweaks may not even be necessary. I need to see if I can find a system to test on.
>


still no time to do proper testing but I just want to inform that the
patchset actually went in the 3.10 first release candidate, as we can see
from git log :)


git log v3.9..v3.10-rc1 --grep="ipc,sem: fine grained locking for semtimedop" -- ipc/sem.c

commit 6062a8dc0517bce23e3c2f7d2fea5e22411269a3
Author: Rik van Riel <riel@surriel.com>
Date: Tue Apr 30 19:15:44 2013 -0700

ipc,sem: fine grained locking for semtimedop

...




-- 
Sent via pgsql-performance mailing list (pgsql-performance@postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-performance



^ permalink  raw  reply  [nested|flat] 4+ messages in thread


end of thread, other threads:[~2013-05-16 08:47 UTC | newest]

Thread overview: 4+ messages (download: mbox mbox.gz follow: Atom feed)
-- links below jump to the message on this page --
2013-03-26 13:04 [OT] linux 3.10 kernel will improve ipc,sysv semaphore scalability Andrea Suisani <sickpig@opinioni.net>
2013-03-26 18:59 ` Shaun Thomas <sthomas@optionshouse.com>
2013-03-29 14:52   ` Andrea Suisani <sickpig@opinioni.net>
2013-05-16 08:47   ` Andrea Suisani <sickpig@opinioni.net>

This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox