Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_CBC_SHA1:256) (Exim 4.89) (envelope-from ) id 1h4ShF-0007SE-TU for pgsql-performance@arkaria.postgresql.org; Thu, 14 Mar 2019 15:55:06 +0000 Received: from localhost ([127.0.0.1] helo=malur.postgresql.org) by malur.postgresql.org with esmtp (Exim 4.89) (envelope-from ) id 1h4ShE-000306-NN for pgsql-performance@arkaria.postgresql.org; Thu, 14 Mar 2019 15:55:04 +0000 Received: from magus.postgresql.org ([2a02:c0:301:0:ffff::29]) by malur.postgresql.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_CBC_SHA1:256) (Exim 4.89) (envelope-from ) id 1h4ShE-0002zy-Bb for pgsql-performance@lists.postgresql.org; Thu, 14 Mar 2019 15:55:04 +0000 Received: from mail-it1-x133.google.com ([2607:f8b0:4864:20::133]) by magus.postgresql.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_CBC_SHA1:256) (Exim 4.89) (envelope-from ) id 1h4ShB-0003lm-Iw for pgsql-performance@postgresql.org; Thu, 14 Mar 2019 15:55:04 +0000 Received: by mail-it1-x133.google.com with SMTP id e24so5479946itl.1 for ; Thu, 14 Mar 2019 08:55:01 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=telsasoft-com.20150623.gappssmtp.com; s=20150623; h=date:from:to:cc:subject:message-id:references:mime-version :content-disposition:in-reply-to:user-agent; bh=7xSHMx1Rgw0ZkSjmzbsLhrTDAJnhl4bGHLAVypVFwd8=; b=X0hA4gxrXQmIDhbDPX5hJifuMELjDVO02Cb+xGtoY19qoqajx6KY2SE0mudqucaYAS G+VzCgRHWi/yXPjk+I3equIyDgOMyqk0ubS8DLf90RLeKRPsPXGAVdH4yFAsl2Ykl8hb mtceHzC1TxPPY36vaSijW/kJ1Txq2ir2zi4sP4cwysXR2Xd6Be3mXm6qSmKK++LndoBP 55GofBPV5NPlScHLpJCyYS4/72nJizpwn7j6qTDxVQjzLmrIo4mv3ysnYy9iK3y1+ofk XYfHlOXI6CHIcstFow2f67CLKGUEeCWLE1Fb1nLOKpsbRV+rllk1hIh/3LgdVFG4Z7jQ iYtA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:date:from:to:cc:subject:message-id:references :mime-version:content-disposition:in-reply-to:user-agent; bh=7xSHMx1Rgw0ZkSjmzbsLhrTDAJnhl4bGHLAVypVFwd8=; b=kVqWCnQW0qAHE9mUqGfyfw8Yqq4Hgp06Cqulp/L4f1Qok5nOZm2Lffx/+qez86+b4Y mGqdL0urD1/jcSt2dEbS0BhUnMAgn4LbmAeXmYUYSt+YM18b1pdScU0nbA1mdIMR97mB rkzrgTz9O8BjPeHNLFrvJANl43k5/rYWSHtAtgOHuVIEH6d7XtpZzS5UH14HSjTIaUiv 90YpXRJK8BJyz4APJCCQVIYbwSLpTYIhiBQ/ePlt8okP9cthY66PbS1XWP3+sBydvNK7 Tqr2TTuzPgoKNr7lH7FhpgsZOOLGRuHOSp4EyHieVqLyH8+GDRE8QAID2uu3IJQFqMoT qsHA== X-Gm-Message-State: APjAAAXAbCtKsHSu16XU6iSGkBdj2q6p6kCW3ua1yf5MiGUs/UCBgqEY U3KVbW8ZeU6Z23O8KrIDtZFLZyBt7P0= X-Google-Smtp-Source: APXvYqwUm+XNFlX1ki2Y3P/zQ2cjKrjaLpUPdOnPNghPuvDOtu/q1aXoWWNPUdUFg5ylnRTQ2yO7gw== X-Received: by 2002:a02:47:: with SMTP id 68mr28510401jaa.121.1552578899038; Thu, 14 Mar 2019 08:54:59 -0700 (PDT) Received: from pryzbyj (charmander.telsasoft.com. [50.244.222.1]) by smtp.gmail.com with ESMTPSA id o126sm1439138itg.1.2019.03.14.08.54.57 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Thu, 14 Mar 2019 08:54:58 -0700 (PDT) Received: by pryzbyj (Postfix, from userid 1000) id CAED6800B8B; Thu, 14 Mar 2019 10:54:56 -0500 (CDT) Date: Thu, 14 Mar 2019 10:54:56 -0500 From: Justin Pryzby To: Gunther Cc: pgsql-performance@postgresql.org Subject: Re: Distributing data over "spindles" even on AWS EBS, (followup to the work queue saga) Message-ID: <20190314155456.GG6030@telsasoft.com> References: MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.5.23 (2014-03-12) List-Id: List-Help: List-Subscribe: List-Post: List-Owner: List-Archive: Precedence: bulk On Wed, Mar 13, 2019 at 02:44:10PM -0400, Gunther wrote: > You see that I already did a lot to balance IO out to many different > tablespaces that's why there are so many volumes. I wonder if it wouldn't be both better and much easier to have just 1 or 2 tablespaces and combine drives into a single LVM VG and do something like lvcreate --stripes > I am not sure my autovacuum setup is working right though. I wonder if there > isn't some autovacuum statistics which I can query that would give me > confidence that it is actually running? pg_stat_all_tables Did you do this ? ALTER TABLE ... SET (autovacuum_vacuum_scale_factor=0.001, autovacuum_vacuum_threshold=1); Justin