Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtp (Exim 4.84_2) (envelope-from ) id 1dhfJV-0006Qo-Iq for pgsql-performance@arkaria.postgresql.org; Tue, 15 Aug 2017 17:07:33 +0000 Received: from localhost ([127.0.0.1] helo=postgresql.org) by malur.postgresql.org with smtp (Exim 4.84_2) (envelope-from ) id 1dhfJV-0005YZ-5P for pgsql-performance@arkaria.postgresql.org; Tue, 15 Aug 2017 17:07:33 +0000 Received: from magus.postgresql.org ([2a02:c0:301:0:ffff::29]) by malur.postgresql.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_CBC_SHA384:256) (Exim 4.84_2) (envelope-from ) id 1dhfJU-0005YQ-Pz for pgsql-performance@postgresql.org; Tue, 15 Aug 2017 17:07:32 +0000 Received: from mail-qt0-x233.google.com ([2607:f8b0:400d:c0d::233]) by magus.postgresql.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_CBC_SHA1:256) (Exim 4.84_2) (envelope-from ) id 1dhfJR-0002Pb-8i for pgsql-performance@postgresql.org; Tue, 15 Aug 2017 17:07:32 +0000 Received: by mail-qt0-x233.google.com with SMTP id p3so7670049qtg.2 for ; Tue, 15 Aug 2017 10:07:28 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc; bh=ejU/5tlYlVFwCb7aE+090CnHk3oY7gV9Wt1eRlOeqLk=; b=NDRcQ1BaiiiitUPMnXdMyE+31F9++BDPZMiFpLx1cNxpS10jqToB/UcCRZUVCZaXKk W5gNWRvzugZb8WCkQSxI0qB3EZVY8ATbk65GXVaoSF5IOWmSZd5ohE59MF14doldP+Vd rsovII9GMD7n12ugam1P6eqXkik/ht41CC4abb79jqEuWpcJRIYx+7AmTETRVqzVrNZT 4telLB91US11YatKTzYYUwZqEcYkB/QrwhIPi86yJqdFDSjlUYWyByEzQK+JSysJ30ug YrbaPfw6cj95sW79qnLsmgcBsuZ+Dk7b/rpXhIB8PXnylS0xvALClMAKaxqRjEkdtPia 5ZDw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc; bh=ejU/5tlYlVFwCb7aE+090CnHk3oY7gV9Wt1eRlOeqLk=; b=JDn38Tkf888EVXuhjGUjNb2+42fCh5SCn+xBYJCVr/+XdWfXbONf6chQlsFL3WnrTs 64ot5xsjr9q/OnUwB6gXeM3pap2Q6vKLlg9TCointraoKDinY3TW/CqHPLZE3MPlxmm4 Ha0B55ROg0G/htRMjmY+o9dbZsxuBIh0+nXRjxjC1ERwWmYG6tHrT9R37HO8ryHN1PSg NHRbRriENHbnwBYJ9+u2o+VnUYyPUTBCiCmLqI8CaMFUaIsaGPlWNfJQM2PhdLn2aTZ7 gDd6MJpMlA3/gVp5g9Cxg+4dMFcF3McxzRlmGuAGsod99xjvz+3cqDFlfn15MjWtc9dh ksqQ== X-Gm-Message-State: AHYfb5iGnElsdxk9eGbnD4nmnO+uAlWtL4LGrN/Bb/tVCfkO7OftLdh9 G9UJDeFz6my2rABbtTsf5nQdptdA6A== X-Received: by 10.237.53.169 with SMTP id c38mr36477457qte.191.1502816847441; Tue, 15 Aug 2017 10:07:27 -0700 (PDT) MIME-Version: 1.0 Received: by 10.140.105.164 with HTTP; Tue, 15 Aug 2017 10:07:26 -0700 (PDT) In-Reply-To: <87mv71eoep.fsf@jsievers.enova.com> References: <87mv71eoep.fsf@jsievers.enova.com> From: Scott Marlowe Date: Tue, 15 Aug 2017 11:07:26 -0600 Message-ID: Subject: Re: Odd sudden performance degradation related to temp object churn To: Jerry Sievers Cc: Peter Geoghegan , Jeremy Finzel , postgres performance list Content-Type: text/plain; charset="UTF-8" List-Archive: List-Help: List-ID: List-Owner: List-Post: List-Subscribe: List-Unsubscribe: X-Mailing-List: pgsql-performance Precedence: bulk Sender: pgsql-performance-owner@postgresql.org On Mon, Aug 14, 2017 at 5:10 PM, Jerry Sievers wrote: > Peter Geoghegan writes: > >> On Mon, Aug 14, 2017 at 12:53 PM, Jeremy Finzel wrote: >> >>> This particular db is on 9.3.15. Recently we had a serious performance >>> degradation related to a batch job that creates 4-5 temp tables and 5 >>> indexes. It is a really badly written job but what really confuses us is >>> that this job has been running for years with no issue remotely approaching >>> this one. We are also using pgpool. >> >> Did you happen to notice that this occurred when you upgrading point >> release? If so, what version did you move from/to? > > The system was last started back in November. Running 9.3.15. > > Not aware of any host system libs or whatever change recently but will investigate. So do iostat or iotop show you if / where your disks are working hardest? Or is this CPU overhead that's killing performance? -- Sent via pgsql-performance mailing list (pgsql-performance@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-performance