Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtp (Exim 4.84_2) (envelope-from ) id 1diNpM-0003iB-PZ for pgsql-performance@arkaria.postgresql.org; Thu, 17 Aug 2017 16:39:24 +0000 Received: from localhost ([127.0.0.1] helo=postgresql.org) by malur.postgresql.org with smtp (Exim 4.84_2) (envelope-from ) id 1diNpM-0001TP-7R for pgsql-performance@arkaria.postgresql.org; Thu, 17 Aug 2017 16:39:24 +0000 Received: from magus.postgresql.org ([2a02:c0:301:0:ffff::29]) by malur.postgresql.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_CBC_SHA384:256) (Exim 4.84_2) (envelope-from ) id 1diNnc-0006c5-4v for pgsql-performance@postgresql.org; Thu, 17 Aug 2017 16:37:36 +0000 Received: from mail-it0-x235.google.com ([2607:f8b0:4001:c0b::235]) by magus.postgresql.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_CBC_SHA1:256) (Exim 4.84_2) (envelope-from ) id 1diNnY-0007VA-3D for pgsql-performance@postgresql.org; Thu, 17 Aug 2017 16:37:35 +0000 Received: by mail-it0-x235.google.com with SMTP id 76so33409796ith.0 for ; Thu, 17 Aug 2017 09:37:31 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc; bh=BbeW6uQqV3zW5Z3vk686wsh63xyQ1uDpw9juX+xsGoE=; b=nfrqVTqJ8KeIcdGUSfsp2fl88NOieQJG8Y27VtLpscuF1haY6BWoNAiLOayVSlti/v KAIu+FVeRttpDsrFeQwe4qfci4Q9Fyv0OtehQcs8/9P8lQtQsl9skNxFip/MCoYc4D6I xlGvVs4t0/IUT72AJ8fJyIkEnCpSJnTH/QX3OMXjRo4b/5ogqtd6aHUvl1e5Yr6rQ2qp pWcQDCaWTQjbFKn40/T7R9/HGdOW0JG3vpM91xHhK0vVTvxHGgzfiZaFUQG5FORaIXqJ Wmlnht/7DQPipT7SE6MjdZ74K9Rgzrlu0v9016ockbGJtl4P3DYd7EMNLPpgR8auFr9V hSDg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc; bh=BbeW6uQqV3zW5Z3vk686wsh63xyQ1uDpw9juX+xsGoE=; b=RZP0uoPf4NgPylS5kwyaezNKls4XQBMsPoxeUrzDHNZ2P9afI7A6aOi8XvTvYBPrqQ PGRkGzlt0S52pq7jF+1hnWFC8leaHFlkE2rkuYJyEZO0b4PE0lySzD1/8bnViVxQKnbJ vV4JNa0VC0qtCReRqSj81uyoxQOKBU+SRPTSbSM9khTgQlzpy9V+9vVpaqjUd4xLX46/ 7rbV/oWhS25dmHPlRQv4mr5BiRxE8m7KkpsTXgDBqRZy87yq1OceHVc5CbhYzXmfPiPx DzosXJ7CbSDn3A653452dEeXHLBoYQ4liqYkSDRVXZkGuznOAkI4ALyR9RB4TxY27SZk NCGw== X-Gm-Message-State: AHYfb5jagx4v5j9VyxxoGbU2z8mA4fkHSEZBzYZRPIHWAoVXRzpMAHmc USiqq+pqqHiJ4kA+QAfck5cMM5jDsg== X-Received: by 10.36.25.70 with SMTP id b67mr2408014itb.72.1502987850231; Thu, 17 Aug 2017 09:37:30 -0700 (PDT) MIME-Version: 1.0 Received: by 10.107.40.213 with HTTP; Thu, 17 Aug 2017 09:37:29 -0700 (PDT) In-Reply-To: References: <88350892-C4AB-4191-9F8E-DB7CFA81F6C6@gmail.com> <00990FBB-D288-4878-8B8E-36E24F808F2C@gmail.com> From: Claudio Freire Date: Thu, 17 Aug 2017 13:37:29 -0300 Message-ID: Subject: Re: performance problem on big tables To: Mariel Cherkassky Cc: Daniel Blanch Bataller , Scott Marlowe , "pgsql-performance@postgresql.org" Content-Type: text/plain; charset="UTF-8" List-Archive: List-Help: List-ID: List-Owner: List-Post: List-Subscribe: List-Unsubscribe: X-Mailing-List: pgsql-performance Precedence: bulk Sender: pgsql-performance-owner@postgresql.org On Thu, Aug 17, 2017 at 6:00 AM, Mariel Cherkassky wrote: > I checked with the storage team in the company and they saw that I have alot > of io on the server. How should I reduce the io that the postgresql uses ? Do you have concurrent activity on that server? What filesystem are you using wherever the data is sitting? If you've got concurrent fsyncs happening, some filesystems handle that poorly. When you've got WAL and data mixed in a single disk, or worse, filesystem, it happens often that the filesystem won't handle the write barriers for the WAL efficiently. I/O gets intermingled with bulk operations, and even small fsyncs will have to flush writes from bulk operations, which makes a mess of things. It is a very good idea, and in fact a recommended practice, to put WAL on its own disk for that reason mainly. With that little RAM, you'll also probably cause a lot of I/O in temp files, so I'd also recommend setting aside another disk for a temp tablespace so that I/O doesn't block other transactions as well. This is all assuming you've got concurrent activity on the server. If not, install iotop and try to see who's causing that much I/O. -- Sent via pgsql-performance mailing list (pgsql-performance@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-performance