Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtp (Exim 4.84_2) (envelope-from ) id 1dV4PJ-0007RF-QY for pgsql-performance@arkaria.postgresql.org; Tue, 11 Jul 2017 23:17:29 +0000 Received: from localhost ([127.0.0.1] helo=postgresql.org) by malur.postgresql.org with smtp (Exim 4.84_2) (envelope-from ) id 1dV4PJ-0002Qm-2q for pgsql-performance@arkaria.postgresql.org; Tue, 11 Jul 2017 23:17:29 +0000 Received: from magus.postgresql.org ([2a02:c0:301:0:ffff::29]) by malur.postgresql.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_CBC_SHA384:256) (Exim 4.84_2) (envelope-from ) id 1dV4NX-0007jf-Gj for pgsql-performance@postgresql.org; Tue, 11 Jul 2017 23:15:39 +0000 Received: from mail-pg0-x230.google.com ([2607:f8b0:400e:c05::230]) by magus.postgresql.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_CBC_SHA1:256) (Exim 4.84_2) (envelope-from ) id 1dV4NP-0005iN-Qe for pgsql-performance@postgresql.org; Tue, 11 Jul 2017 23:15:38 +0000 Received: by mail-pg0-x230.google.com with SMTP id k14so3316400pgr.0 for ; Tue, 11 Jul 2017 16:15:31 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc:content-transfer-encoding; bh=BzSKMNOE8Bg8GhPq77wt2EkGmrHzYUBZ2VBf40A7yH8=; b=GYOq+rjE/vYkzp0emmMJm58DtplQdNmOoZ19mMUj/nGjf8SUFpqB+c22K4pxcGPE+q xrQiDVQN3pOhJkNBniogj2eyp/rt02yRfQ0VyQWDb6TmoJsQGzqXfQvL1oWxoD5vOtDd wUuG2BKP3dQVUu+go1QYppO38Nw/OXTv3zUl25jt1d8G8ao8ogXxthO99qBoO6HMLZ/u GHX91jzOm5XF/42E/+aMK6FK9IY6TTOgBMDmK/mZ4wxT0mD6HtNF1nedW/3uoZExz+5O nDU1jDw3iP4bbFhihzBb4yZwi0OBLW78uMYyjR9F1gmldwJuEf7ipFhmytLeOBslCUqq bGOA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc:content-transfer-encoding; bh=BzSKMNOE8Bg8GhPq77wt2EkGmrHzYUBZ2VBf40A7yH8=; b=R+QZoQ0ZMmGS2jGC4F9F99t7aUKofbsSXejAdO1QMwQsKMJut6DIVpr063zZSEvPHo Uwm+oJPMPtnBXRVouVtG8rTEFVZTaijyzGTsDVJAQmk5k7ONkcqtrmV9Ilp9TdbvBoQ2 713XA5useinzmjrC4HMychD0N83ns4ujQUv5uHZT3vIZ/SwsB+ZRPDJVNuCMHUw9EtXu ZCYPLhzmEbtMYdRCBY2dM9yTwbwvXsidyzK4V4qrArt53ncfImUa9reHo7oA9RcLZVWw k3zb0I4z76qgA4sq94ZTLwXS0hCXGnL6/dVjIZ7Pj2ljf2jMDHOXUJa0i64Nxc3YVRSD i0bw== X-Gm-Message-State: AIVw111voZoRtKp/CvqIFnQ3khZOLeV0Slm2Vi0JGiG9VfBn27lAnwNT J1G5OsK/Mx2aUbHnZzLfYXfD5yNdQw== X-Received: by 10.98.236.67 with SMTP id k64mr52149841pfh.236.1499814929402; Tue, 11 Jul 2017 16:15:29 -0700 (PDT) MIME-Version: 1.0 Received: by 10.100.160.202 with HTTP; Tue, 11 Jul 2017 16:15:28 -0700 (PDT) In-Reply-To: References: From: Merlin Moncure Date: Tue, 11 Jul 2017 18:15:28 -0500 Message-ID: Subject: Re: Very poor read performance, query independent To: Charles Nadeau Cc: postgres performance list Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable List-Archive: List-Help: List-ID: List-Owner: List-Post: List-Subscribe: List-Unsubscribe: X-Mailing-List: pgsql-performance Precedence: bulk Sender: pgsql-performance-owner@postgresql.org On Mon, Jul 10, 2017 at 9:03 AM, Charles Nadeau wrote: > I=E2=80=99m running PostgreSQL 9.6.3 on Ubuntu 16.10 (kernel 4.4.0-85-gen= eric). > Hardware is: > > *2x Intel Xeon E5550 > > *72GB RAM > > *Hardware RAID10 (4 x 146GB SAS 10k) P410i controller with 1GB FBWC (80% > read/20% write) for Postgresql data only: > > The problem I have is very poor read. When I benchmark my array with fio I > get random reads of about 200MB/s and 1100IOPS and sequential reads of ab= out > 286MB/s and 21000IPS. But when I watch my queries using pg_activity, I get > at best 4MB/s. Also using dstat I can see that iowait time is at about 25= %. > This problem is not query-dependent. Stop right there. 1100 iops * 8kb =3D ~8mb/sec raw which might reasonably translate to 4mb/sec to the client. 200mb/sec random read/sec on spinning media is simply not plausible; your benchmark is lying to you. Random reads on spinning media are absolutely going to be storage bound. merlin --=20 Sent via pgsql-performance mailing list (pgsql-performance@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-performance