Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtps (TLS1.3:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1pczVB-00055R-IL for pgsql-hackers@arkaria.postgresql.org; Fri, 17 Mar 2023 02:07:29 +0000 Received: from localhost ([127.0.0.1] helo=malur.postgresql.org) by malur.postgresql.org with esmtp (Exim 4.92) (envelope-from ) id 1pczVA-0003ga-GL for pgsql-hackers@arkaria.postgresql.org; Fri, 17 Mar 2023 02:07:28 +0000 Received: from makus.postgresql.org ([2001:4800:3e1:1::229]) by malur.postgresql.org with esmtps (TLS1.3:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1pczVA-0003gR-4c for pgsql-hackers@lists.postgresql.org; Fri, 17 Mar 2023 02:07:28 +0000 Received: from mail-pj1-x1033.google.com ([2607:f8b0:4864:20::1033]) by makus.postgresql.org with esmtps (TLS1.3:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.92) (envelope-from ) id 1pczV7-0008VB-Ot for pgsql-hackers@lists.postgresql.org; Fri, 17 Mar 2023 02:07:27 +0000 Received: by mail-pj1-x1033.google.com with SMTP id fy10-20020a17090b020a00b0023b4bcf0727so3531197pjb.0 for ; Thu, 16 Mar 2023 19:07:25 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; t=1679018845; h=in-reply-to:content-disposition:mime-version:references:message-id :subject:cc:to:from:date:from:to:cc:subject:date:message-id:reply-to; bh=u+JySsCOXC3ATSHtJgdpZKNXTBIaZRraBdmybB5ayic=; b=ELYqq9qRzdofZcK8b2R94UBfbSqCfP91jWN3cKVDeTG6MMdgYVrW4zYk/TeNATDmRx WxhEY0Kxopi6LmZwJ+edo6d3NeTkZn/aYMSR9ewkHhjwLjI3lbX+pAsalrKZUhI7spNi vKW1WJLR9GYrDAT5BGt7me43nlNFlVvUThgBq6xNNOUrB3HrL5NlVnl3hGTYtcp9xMUB nlp+sOT+G9GHPEt8+GPXGvtxsQsKNH+t3FFf86F5TqQucdqCI6BPpU1mxFHRUa31QWoX tcBa2XLytw9BG+1P/MvWCBjeKLFsBhKpEZwTDtyU3ZgTwfh8H6TXRhVPWPpLr23rlnsh QiLw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; t=1679018845; h=in-reply-to:content-disposition:mime-version:references:message-id :subject:cc:to:from:date:x-gm-message-state:from:to:cc:subject:date :message-id:reply-to; bh=u+JySsCOXC3ATSHtJgdpZKNXTBIaZRraBdmybB5ayic=; b=KqsVTR7JeF9Dj2roeAB8tF2kL1eFYfx6mU3h6cdeF+gx41w+ltjMvddz5JvP0Tvkfu Gpl86nkIsKZKf2gXBvST6QGO13koQxHwz8UQUFiiJ7njws3uqtWl1PYdVgpERJhcTQis pzKzYsVGP5mFst7C9Umj6CGN2Dil9OJjpOXt6+QfhM7ttgoYTsdCSF0YX/4JInIhuctm amMByxHtKMHjhjNGo7woCk6Topjc5fO9D4CI9ibyOraoROWp08Cd2dluhAAl/flF9FZD mWhmrXjsZEFD+z8qvEfqMUWG3tPvcuWhmXo+NviGB9yZp5FA8NzfHNJZvytqlLaeKg4g 0Ynw== X-Gm-Message-State: AO0yUKVwO3jfEOuVSkPPapxxmX3FShNoxGvCeh9faxywsLGBFS1xHP8n 8xMMtdGSsDYhSgMr9FKlj6w= X-Google-Smtp-Source: AK7set9esqhm5nK4iRhI010aBEv2YP25F1I9dU/qSn/g6FGXpVPOanZ6baxUMsN2r4E7PJrORo7xxQ== X-Received: by 2002:a17:902:d485:b0:19f:2332:d2ca with SMTP id c5-20020a170902d48500b0019f2332d2camr6699521plg.52.1679018844558; Thu, 16 Mar 2023 19:07:24 -0700 (PDT) Received: from jrouhaud (2001-b011-1005-72e1-2c07-ac23-686e-aaea.dynamic-ip6.hinet.net. [2001:b011:1005:72e1:2c07:ac23:686e:aaea]) by smtp.gmail.com with ESMTPSA id c23-20020a170902849700b001933b4b1a49sm336503plo.183.2023.03.16.19.07.22 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Thu, 16 Mar 2023 19:07:23 -0700 (PDT) Date: Fri, 17 Mar 2023 10:07:20 +0800 From: Julien Rouhaud To: Tom Lane Cc: Andrew Dunstan , Alvaro Herrera , David Rowley , Peter Geoghegan , Robert Haas , pgsql-hackers@lists.postgresql.org, Andrew Subject: Re: pg_dump versus hash partitioning Message-ID: <20230317020720.3752vjir2qhjtrur@jrouhaud> References: <1533086.1675349554@sss.pgh.pa.us> <1912821.1676402493@sss.pgh.pa.us> <20230311030154.pg63uspio35h4a6t@jrouhaud> <1078804.1678504214@sss.pgh.pa.us> <20230311033232.g6jgkuzxdawepsbe@jrouhaud> <1602203.1678650412@sss.pgh.pa.us> <20230313083314.pivmgfu36fi4eu2n@jrouhaud> <2441413.1678750752@sss.pgh.pa.us> <20230316090352.v2m2d473fcv5tli6@jrouhaud> <3756156.1678970636@sss.pgh.pa.us> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <3756156.1678970636@sss.pgh.pa.us> List-Id: List-Help: List-Subscribe: List-Post: List-Owner: List-Archive: Archived-At: Precedence: bulk On Thu, Mar 16, 2023 at 08:43:56AM -0400, Tom Lane wrote: > Julien Rouhaud writes: > > On Mon, Mar 13, 2023 at 07:39:12PM -0400, Tom Lane wrote: > >> Yeah, we need to do both. Attached find an updated patch series: > > > I didn't find a CF entry, is it intended? > > Yeah, it's there: > > https://commitfest.postgresql.org/42/4226/ Ah thanks! I was looking for "pg_dump" in the page. > > I'm not sure if you intend to keep the current 0002 - 0003 separation, but if > > yes the part about te->defn and possible fallback should be moved to 0003. In > > 0002 we're only looking at the COPY statement. > > I was intending to smash it all into one commit --- the separation is > just to ease review. Ok, no problem then and I agree it's better to squash them. > > I know you're only inheriting this comment, but isn't it well outdated and not > > accurate anymore? I'm assuming that "archiving is not on" was an acceptable > > way to mean "wal_level < archive" at some point, but it's now completely > > misleading. > > Sure, want to propose wording? Just mentioning the exact wal_level, something like * [...]. If wal_level is set to minimal this prevents * WAL-logging the COPY. This obtains a speedup similar to * [...] > > More generally, I also think that forcing --load-via-partition-root for > > known unsafe partitioning seems like the best compromise. I'm not sure if we > > should have an option to turn it off though. > > I think the odds of that yielding a usable dump are nil, so I don't > see why we should bother. No objection from me.