Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtp (Exim 4.80) (envelope-from ) id 1Vthe0-0000kY-OG for pgsql-performance@arkaria.postgresql.org; Thu, 19 Dec 2013 17:44:20 +0000 Received: from localhost ([127.0.0.1] helo=postgresql.org) by malur.postgresql.org with smtp (Exim 4.80) (envelope-from ) id 1Vthe0-0002jz-62 for pgsql-performance@arkaria.postgresql.org; Thu, 19 Dec 2013 17:44:20 +0000 Received: from magus.postgresql.org ([2a02:c0:301:0:ffff::29]) by malur.postgresql.org with esmtp (Exim 4.80) (envelope-from ) id 1Vthdy-0002hB-8z for pgsql-performance@postgresql.org; Thu, 19 Dec 2013 17:44:18 +0000 Received: from smtp2.peak6.com ([38.98.137.9]) by magus.postgresql.org with esmtp (Exim 4.80) (envelope-from ) id 1Vthds-0005DO-SH for pgsql-performance@postgresql.org; Thu, 19 Dec 2013 17:44:16 +0000 X-AuditID: 0a02cb20-b7fab6d000000b57-c7-52b33069f29b Received: from sswchi5pcas2.peak6.net (Unknown_Domain [10.100.13.24]) by smtp2.peak6.com (Symantec Messaging Gateway) with SMTP id 7F.1D.02903.96033B25; Thu, 19 Dec 2013 11:44:10 -0600 (CST) Received: from [10.10.201.64] (10.10.201.64) by sswchi5pcas2.peak6.net (10.100.13.25) with Microsoft SMTP Server (TLS) id 14.3.158.1; Thu, 19 Dec 2013 11:44:09 -0600 Message-ID: <52B33069.1060203@optionshouse.com> Date: Thu, 19 Dec 2013 11:44:09 -0600 From: Shaun Thomas User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:24.0) Gecko/20100101 Thunderbird/24.1.1 MIME-Version: 1.0 To: Dave Johansen , pgsql-performance Subject: Re: Unexpected pgbench result References: In-Reply-To: Content-Type: text/plain; charset="ISO-8859-1"; format=flowed content-transfer-encoding: 7bit X-Originating-IP: [10.10.201.64] X-Brightmail-Tracker: H4sIAAAAAAAAA+NgFnrFIsWRmVeSWpSXmKPExsXClcIroZtlsDnI4PoRTov/bX8YLa7PPMfs wOSxc9Zddo8L+6axBzBFNTDaJObl5ZcklqQqpKQWJ9sq+ReUZObnFXvklxanKrhkFifnJGbm phYpKWSm2CoZKykU5CQmp+am5pXYKiUWFKTmpSjZcSlgABugssw8hdS85PyUzLx0WyXPYH9d CwtTS11DJbt4ZJDQyZJx6k0fc8EKrorPlx4yNTDO5ehi5OCQEDCRmNto18XICWSKSVy4t54N xBYSOMAo8WiVYRcjF5C9klFizuF5jCAJXgF9iaaNS1hAbBYBVYn/F7+wg9hsAroSk/pXgDWL CoRJtF+YyQxRLyhxcuYTsHoRgSSJ5TfPMYHYwgIGEksuXoFaFiDxoHEK2HxOgUCJFXtmg81k FrCVuDDnOguELS+x/e0cZoh6VYkVzRPZII5WkPh/5R3TBEbBWUjWzULSPgtJ+wJG5lWM4sVl ickZmWYFxbklBUZ6BamJ2WZ6eaklmxhBEcp0WmEH4+Yeq0OMAhyMSjy8B/5tDBJiTSwrrsw9 xCjBwawkwjtPYXOQEG9KYmVValF+fFFpTmrxIUYfYHhMZJYSTc4HJo+8knhDY1MDU0tTQ1Nz U0MjHMJK4rxcOVODhATSgSkjOzW1ILUIZhwTB6dUA6NH8R5rp0s90eU7GQ1eMtpuX3oubun1 ysQ10x+/Olv7eV7okQdrudZujKwIrTcOimKMW5L9JbrAc+eJeXePemg16sw9s/gdt5A/b1Mf g784y+4jPXXlN38bnLYt4FHMmV02b6di6JenV87b2X15Lbf0A6Mc472/5kufqlWLrtZftzXM /OttIw4lluKMREMt5qLiRABTgv21/QIAAA== X-Pg-Spam-Score: -1.9 (-) List-Archive: List-Help: List-ID: List-Owner: List-Post: List-Subscribe: List-Unsubscribe: X-Mailing-List: pgsql-performance Precedence: bulk Sender: pgsql-performance-owner@postgresql.org On 12/19/2013 11:00 AM, Dave Johansen wrote: > When I run pgbench in "SELECT only" after doing "-i -s 2000" I get what > appears to be good performance (60k-70k tps) but if I initialize a new > database with "-i -s 4000" the tps drops to 4k-7k. Is this order of > magnitude drop expected? Or is there something wrong with my hardware or > database configuration that is causing this issue? When you increase the size of the initialized pgbench tables, you increase the size on disk. My guess is that you doubled it so that the data no longer fits in memory. You can verify this yourself: SELECT pg_size_pretty(sum(pg_database_size(oid))::bigint) from pg_database; Any amount of memory you have that is smaller than that, will affect select performance. I can guarantee you will not get 60k-70k tps from anything short of an array of SSD devices or a PCIe NVRAM solution. Your '-s 2000' test was probably running mostly from memory, while the '-s 4000' did not. What you're seeing is the speed your records are being supplied from disk, plus whatever cache effects are there when records are read before they are flushed in favor of more recent data. -- Shaun Thomas OptionsHouse | 141 W. Jackson Blvd. | Suite 500 | Chicago IL, 60604 312-676-8870 sthomas@optionshouse.com ______________________________________________ See http://www.peak6.com/email_disclaimer/ for terms and conditions related to this email -- Sent via pgsql-performance mailing list (pgsql-performance@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-performance