Received: from localhost (unknown [200.46.204.183]) by mail.postgresql.org (Postfix) with ESMTP id 2790C63342F for ; Fri, 10 Apr 2009 14:15:49 -0300 (ADT) Received: from mail.postgresql.org ([200.46.204.86]) by localhost (mx1.hub.org [200.46.204.183]) (amavisd-maia, port 10024) with ESMTP id 84762-09 for ; Fri, 10 Apr 2009 14:15:47 -0300 (ADT) X-Greylist: from auto-whitelisted by SQLgrey-1.7.6 Received: from outmail137183.authsmtp.net (outmail137183.authsmtp.net [62.13.137.183]) by mail.postgresql.org (Postfix) with ESMTP id 6F136632C76 for ; Fri, 10 Apr 2009 14:15:44 -0300 (ADT) Received: from mail-c188.authsmtp.com (mail-c188.authsmtp.com [62.13.128.25]) by punt5.authsmtp.com (8.14.2/8.14.2/Kp) with ESMTP id n3AHFepI092360; Fri, 10 Apr 2009 18:15:40 +0100 (BST) Received: from Sidney-Stratton.local (adsl-63-195-55-98.dsl.snfc21.pacbell.net [63.195.55.98]) (authenticated bits=0) by mail.authsmtp.com (8.14.2/8.14.2/Kp) with ESMTP id n3AHFaJ8086020; Fri, 10 Apr 2009 18:15:38 +0100 (BST) Message-ID: <49DF7EB8.8070009@agliodbs.com> Date: Fri, 10 Apr 2009 10:15:36 -0700 From: Josh Berkus Organization: PostgreSQL Experts Inc. User-Agent: Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.5; en-US; rv:1.9.1b3pre) Gecko/20090223 Thunderbird/3.0b2 MIME-Version: 1.0 To: "Joshua D. Drake" CC: pgsql-performance@postgresql.org Subject: Re: Using IOZone to simulate DB access patterns References: <49D697F7.2040304@agliodbs.com> <49D6A551.5080001@agliodbs.com> <1239379233.19518.361.camel@jd-laptop.pragmaticzealot.org> In-Reply-To: <1239379233.19518.361.camel@jd-laptop.pragmaticzealot.org> Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit X-Server-Quench: 370b840e-25f3-11de-aecc-001871e930f4 X-AuthRoute: OCdyZgscClZXSx8a IioLCC5HRQ8+YBZL BAkGMA9GIUINWEQL c1ADdh16KEdbHwkB CnYKU15VVVdyUC1z aBRQZABDZ09QVg11 Uk1LR01SWltrcGR3 V2QWUhF0dwdGNnxz bUAsXXdbDkx+dRNg QEsCFnAHZDM1dTFK AxNFdwNVeARLKxZG agZ7GhFYa3VsBg8C MSgJGgV5AC5eLisd YyY/KlQfCVoMViU9 Qg0GFCkiVWEvDyw4 JBE9MRYEFVoNP180 KjNh X-Authentic-SMTP: 61633136333939.cat.dmpriest.net.uk:1378/Kp X-Report-SPAM: If SPAM / abuse - report it at: http://www.authsmtp.com/abuse X-Virus-Scanned: Maia Mailguard 1.0.1 X-Spam-Status: No, hits=0 tagged_above=0 required=5 tests=none X-Spam-Level: X-Archive-Number: 200904/198 X-Sequence-Number: 33565 JD, > In order to test real interactivity (AFAIK) with iozone you have to > launch multiple iozone instances. You also need to do them from separate > directories, otherwise it all starts writing the same file. The work I > did here: Actually, current IOZone allows you to specify multiple files. For example, the command line I was using: iozone -R -i 0 -i 1 -i 2 -i 3 -i 4 -i 5 -i 8 -l 6 -u 6 -r 8k -s 4G -F f1 f2 f3 f4 f5 f6 And it does indeed launch 6 processes under that configuration. However, I found that for pretty much all of the write tests except for the first the processes blocked each other: F S UID PID PPID C PRI NI ADDR SZ WCHAN TTY TIME CMD 0 S 26 6061 5825 0 80 0 - 11714 wait pts/3 00:00:00 iozone 1 D 26 6238 6061 0 78 0 - 11714 sync_p pts/3 00:00:03 iozone 1 D 26 6239 6061 0 78 0 - 11714 sync_p pts/3 00:00:03 iozone 1 D 26 6240 6061 0 78 0 - 11714 sync_p pts/3 00:00:03 iozone 1 D 26 6241 6061 0 78 0 - 11714 sync_p pts/3 00:00:03 iozone 1 D 26 6242 6061 0 78 0 - 11714 stext pts/3 00:00:03 iozone 1 R 26 6243 6061 0 78 0 - 11714 - pts/3 00:00:03 iozone Don Capps says that the IOZone code is perfect, and that pattern indicates a problem with my system, which is possible. Can someone else try concurrent IOZone on their system and see if they get the same pattern? I just don't have that many multi-core machines to test on. Also, WTF is the difference between "Children See" and "Parent Sees"? IOZone doesn't document this anywhere. -- Josh Berkus PostgreSQL Experts Inc. www.pgexperts.com