Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.94.2) (envelope-from ) id 1uf2d1-001JvQ-L4 for pgsql-hackers@arkaria.postgresql.org; Thu, 24 Jul 2025 20:33:24 +0000 Received: from localhost ([127.0.0.1] helo=malur.postgresql.org) by malur.postgresql.org with esmtp (Exim 4.94.2) (envelope-from ) id 1uf2d0-00Aw2x-KW for pgsql-hackers@arkaria.postgresql.org; Thu, 24 Jul 2025 20:33:22 +0000 Received: from makus.postgresql.org ([2001:4800:3e1:1::229]) by malur.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.94.2) (envelope-from ) id 1uf2d0-00Aw2o-6J for pgsql-hackers@lists.postgresql.org; Thu, 24 Jul 2025 20:33:22 +0000 Received: from mail-qv1-xf36.google.com ([2607:f8b0:4864:20::f36]) by makus.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256 (Exim 4.96) (envelope-from ) id 1uf2cy-000bpY-0p for pgsql-hackers@lists.postgresql.org; Thu, 24 Jul 2025 20:33:21 +0000 Received: by mail-qv1-xf36.google.com with SMTP id 6a1803df08f44-6fae04a3795so11551356d6.3 for ; Thu, 24 Jul 2025 13:33:19 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=dunslane-net.20230601.gappssmtp.com; s=20230601; t=1753389199; x=1753993999; darn=lists.postgresql.org; h=in-reply-to:autocrypt:content-language:from:references:cc:to :subject:user-agent:mime-version:date:message-id:from:to:cc:subject :date:message-id:reply-to; bh=VswQjTJRwmw4I+MtQzD29Id0x/PU4WBNMCHte+E2tTA=; b=RvAnBiHIDA48T5qnVAAerqbd36KV9PnSy+ncF+eX+PH2X3Qj+E72thIM1LbNBBoGrm NQHT0iKuYOhXyYFQnDOqGwStajo+jeEyt+U5FCHO9gdtO14BjXJoaR9aMZ0sYtAtRiKD WaIwvHNOyP6NS75AmnTCMuMeTNbOzXrVK553tEDY4sKUiosGAn6WARKyoCkKLXEoCbke N24W70Ph+EA8Rk9x1W4plGPju+Se8oGhf91gvOR0YWiIJGiisvXxqMjRg75Fd/ktFi+R QbLYH6qwWoLR9DPPDvT2lCqCetyvdT+BW+zAd0JGVcNNt533ORYiwJefpVhRcR9so89f H59A== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1753389199; x=1753993999; h=in-reply-to:autocrypt:content-language:from:references:cc:to :subject:user-agent:mime-version:date:message-id:x-gm-message-state :from:to:cc:subject:date:message-id:reply-to; bh=VswQjTJRwmw4I+MtQzD29Id0x/PU4WBNMCHte+E2tTA=; b=Vcr9z2Y9/dDwQCnqwhu7UZIConXzC4biMwH0FTyCFMueOJP2a6ePH4aure/kEiKOOY peH5fwfQQv6N++YP0h+e/dAH5momWG2V+kShfI/CMpWPh1TKj8My4dgiqEhXBdSvlfVf VckTBGeRZpVI2ZymGtVhinCXhDzrV+edx4fi+yh/wzYisdC1lJFujwUWTmtFBkenCw/G E57SSPcQbagaCd9OvKpBn3egXAHSp2+2AiiCeAf0AWCBRB4wBu5FbIOWGiFexkR0ErC5 iPCHhmwd/ilzxe6GJkYB2QTFI82E+ANos9Mxt/7D90cqjcPYbneuDg98UCTnbUJ7A7KX BSzg== X-Forwarded-Encrypted: i=1; AJvYcCX0erBo0GvVQI9IDTXeK+Ia2YTWL/vezrVHAXwulrjlVg9pRZ4yju4W7/m7oqSi0k4amhcdeXMdkhBUHSQq@lists.postgresql.org X-Gm-Message-State: AOJu0YxbMUiijph4lRdmKIXOBr15s+tXSmLiKKxD+HTpD8URNjCh8zrZ RzoOrBIMkkpwR/I1397Rz1VdZP3IaGv66YjbrMluCr68uilz8LdpxiKSw7C8sqCxsQFExEk6GYP e068j X-Gm-Gg: ASbGncsE/gVQA2G2pWObvm552wLVDclH2q9gClAx26lySws3PcGGQTTzMS9iXCaSga3 SiGuQWNgPluN3dnY9lN5CdB0VWQ2SuUxKfWQotSN3rcZHIjh/MrQLz6GVJiYKEqES79+N6H6+pg UChy/XIxvMEzu1YSffYlgGJ+Y6GTccfXP6iKbBfCn6EpwczqCScHZtU/kdkxzNmwFY1+DpXpDV6 j9ohZeu8Lmpo/6RHKDF9CH5lupQWollNluUowHgqjuXcmX7RHfXACv8/3KMptWLh3RiTNHypKjA TJS5Z0F+3isk4YA6fd/YbVHjwQhCbaE/L4622Jld51VwPM6KKDyFiUy+f7pNknjnOittk/bJ/cZ 0OOhLCSSoPXzGnQC8Qa6obDehbNFWHKF6Vyepv+GQ X-Google-Smtp-Source: AGHT+IE/JPyU7AidHHeuKn4C8wgTHiBLpGqoowuFDgMgr7Iq4Wo5yMKZWdlrBPD20y4O8pnQHd55og== X-Received: by 2002:a05:6214:1c8c:b0:704:8db8:d3cd with SMTP id 6a1803df08f44-707005abb6bmr100255036d6.8.1753389198448; Thu, 24 Jul 2025 13:33:18 -0700 (PDT) Received: from ?IPV6:2605:a601:a6b0:500::1cb? ([2605:a601:a6b0:500::1cb]) by smtp.googlemail.com with ESMTPSA id 6a1803df08f44-7070fc9f439sm18112846d6.59.2025.07.24.13.33.17 (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Thu, 24 Jul 2025 13:33:17 -0700 (PDT) Content-Type: multipart/alternative; boundary="------------IkUJ6BS5ipRVFCdxh9vNk0ce" Message-ID: Date: Thu, 24 Jul 2025 16:33:15 -0400 MIME-Version: 1.0 User-Agent: Mozilla Thunderbird Subject: Re: Non-text mode for pg_dumpall To: Noah Misch Cc: Mahendra Singh Thalor , =?UTF-8?Q?=C3=81lvaro_Herrera?= , jian he , Srinath Reddy , pgsql-hackers@lists.postgresql.org References: <616efe2c-3986-43cf-b88c-4435849acf9e@dunslane.net> <948154fe-0278-4f4c-8f5a-085e12f03163@dunslane.net> <20250708212819.09.nmisch@google.com> <20250716001957.c6.nmisch@google.com> <3f22a8bb-29e8-40cc-97a1-309181da2c13@dunslane.net> <20250722005339.ca.nmisch@google.com> From: Andrew Dunstan Content-Language: en-US Autocrypt: addr=andrew@dunslane.net; keydata= xsBNBE7KWFkBCAClridxur2AIc7eW2AR7izbfp3EnNefie2HbLF0izW5Ik5UjX2HBXBx4syI gY6b0ugohXrr274+baoAlvSbq6cAoQuEVrk5IZFzt20b1Xkx65FwGSEj526yiKLocqkJceSq Xr9xcA5SGY+FZv441chh5SU92v4q6z+6LPpoHOh97ptAVXZYNTtU0LevyvD5lja0TzbvJm6C eFXitJfnm1pLEr0DGJCR/iUOl/N62Kh4855zZC7NHIjQHPOvV5Stz/l5ilDhvGVk+xkXFPys SjZoUr1rXhYLpiyi5sR0X9FHXT0KnGuz1F5ERO7ZTLSSQ6fJwPj6gOk9K+vvoKvoeql5ABEB AAHNJEFuZHJldyBEdW5zdGFuIDxhbmRyZXdAZHVuc2xhbmUubmV0PsLAlwQTAQgAQQIbAwIX gAIZAQULCQgHAwUVCgkICwUWAgMBAAIeBRYhBOQ+WEYd/Hy/RGkVpZn6f8tZ/DuBBQJoGNGd BQkdEO8nAAoJEJn6f8tZ/DuBq74H/jkTR4Zi3stbw+xC7v2u3QozssK7MYPL2AsVfh7OealS h182fiWXpfvmmAB7WUHbhk9GC2RAOnHI/2d2jgKaMLAHsGYOT0YopTVIwRY43fCw/mK67yxc wmDcX+zyKfLaivNbf5A7QPLNwda98bEAMSJ8Sn652Uc6cA8t3uKGsVzbRBQOoYzjgvBCfSrE 9ql3PDNg0l4BfAqabd2f70ZUm9VAMEPrgv/v2xI7M2XiL4g5BVmqLCOwxLM8RMCotCuoweUr VO43DeBCIDwLxotMJKvGWDjBzQYlU1NPUAtNcz/gN9ITUe1VUGjyvGj4u1lxBOcQQUw7l1+T 5moZ4iZxXzvOwE0ETspYWQEIANGc4zQULOxhbqO2dyD51YhqCNRmm9oKWaqf+wmW4tpDe/VV cxAnNizd4LWCHfzpb5cHAtGkOPePMfzWVf6nvdF7d3eglbtf59+zG7O7llV0xSSoFiieQBsr GvqDInXYX/4mRRXMtyhM353/tixC9RWLs1oofyYmCPPXXY7h9R7en3B8BoVrRFcdzlIY/NFN hFGW/9dkEiGjgna2Rk6e15kln4ZvFBWUg23p93w/pqXcxY6+k/8TEk+C4R+M6w7o2PLGOjdZ +kPiUcw5H85zf/yZJwQXzisXaNduwWB6Vads9YC9dj6kPR1c4VGRqAaYL++LAEOqrlvm2Tvq QqZRtnEAEQEAAcLAfAQYAQgAJgIbDBYhBOQ+WEYd/Hy/RGkVpZn6f8tZ/DuBBQJoGNI2BQkd EODdAAoJEJn6f8tZ/DuBfw0IAKTsfD40teP/pp+bsLLMSxPXUYrrprTj7WFB5v61p6dkpSr/ qXmMlyahdxQFaPmfVgVirB1Vk/kHiWNnnGjfUV9nB2Zg9LI0Xb9/ts3LsUiRWXzG3tkMY6XL vsVOxW4XFRND9l2q+WW93aZ1DZl+fqWfYgMvsusFRhmGFOKTRfKPta2Pkv+AhA24N4+PrR5p bU4k2MO8PAGiK8eaYKGFG1bHKuAvoDoF7WXJ3FHxuWqLnKEt4dfOLm5pAe3zq1Lt6q8azT9i QWGpSAK5vQUWQHBHpiDjdPeqKZ6HiAXIIKfSmb+jrvXBqoP+D6/K7rUjG2aXiRtTIAXms9sm VRu7cmw= In-Reply-To: <20250722005339.ca.nmisch@google.com> List-Id: List-Help: List-Subscribe: List-Post: List-Owner: List-Archive: Archived-At: Precedence: bulk This is a multi-part message in MIME format. --------------IkUJ6BS5ipRVFCdxh9vNk0ce Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit On 2025-07-21 Mo 8:53 PM, Noah Misch wrote: > > I suspect this is going to end with a structured dump like we use on the > pg_dump (per-database) side. It's not an accident that v17 pg_restore doesn't > lex text files to do its job. pg_dumpall deals with a more-limited set of > statements than pg_dump deals with, but they're not _that much_ more limited. > I won't veto a lexing-based approach if it gets the behaviors right, but I > don't have high hopes for it getting the behaviors right and staying that way. I have been talking offline with Mahendra about this. I agree that we would be better off with a structured object for globals. But the thing that's been striking me all afternoon as I have pondered it is that we should not be designing such an animal at this stage of the cycle. Whatever we do we're going to be stuck supporting, so I have very reluctantly come to the conclusion that it would probably be better to back the feature out and have another go for PG 19. cheers andrew -- Andrew Dunstan EDB:https://www.enterprisedb.com --------------IkUJ6BS5ipRVFCdxh9vNk0ce Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: 7bit


On 2025-07-21 Mo 8:53 PM, Noah Misch wrote:

I suspect this is going to end with a structured dump like we use on the
pg_dump (per-database) side.  It's not an accident that v17 pg_restore doesn't
lex text files to do its job.  pg_dumpall deals with a more-limited set of
statements than pg_dump deals with, but they're not _that much_ more limited.
I won't veto a lexing-based approach if it gets the behaviors right, but I
don't have high hopes for it getting the behaviors right and staying that way.


I have been talking offline with Mahendra about this. I agree that we would be better off with a structured object for globals. But the thing that's been striking me all afternoon as I have pondered it is that we should not be designing such an animal at this stage of the cycle. Whatever we do we're going to be stuck supporting, so I have very reluctantly come to the conclusion that it would probably be better to back the feature out and have another go for PG 19.


cheers


andrew

--
Andrew Dunstan
EDB: https://www.enterprisedb.com
--------------IkUJ6BS5ipRVFCdxh9vNk0ce--