Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.94.2) (envelope-from ) id 1tx6BU-002qPA-LT for pgsql-general@arkaria.postgresql.org; Tue, 25 Mar 2025 15:27:20 +0000 Received: from localhost ([127.0.0.1] helo=malur.postgresql.org) by malur.postgresql.org with esmtp (Exim 4.94.2) (envelope-from ) id 1tx6BT-005pBF-EG for pgsql-general@arkaria.postgresql.org; Tue, 25 Mar 2025 15:27:19 +0000 Received: from makus.postgresql.org ([2001:4800:3e1:1::229]) by malur.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.94.2) (envelope-from ) id 1tx6BS-005p9x-FJ for pgsql-general@lists.postgresql.org; Tue, 25 Mar 2025 15:27:19 +0000 Received: from fout-b2-smtp.messagingengine.com ([202.12.124.145]) by makus.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.96) (envelope-from ) id 1tx6BQ-00144y-1z for pgsql-general@lists.postgresql.org; Tue, 25 Mar 2025 15:27:17 +0000 Received: from phl-compute-03.internal (phl-compute-03.phl.internal [10.202.2.43]) by mailfout.stl.internal (Postfix) with ESMTP id 3840F11401E9; Tue, 25 Mar 2025 11:27:15 -0400 (EDT) Received: from phl-mailfrontend-01 ([10.202.2.162]) by phl-compute-03.internal (MEProxy); Tue, 25 Mar 2025 11:27:15 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=aklaver.com; h= cc:cc:content-transfer-encoding:content-type:content-type:date :date:from:from:in-reply-to:in-reply-to:message-id:mime-version :references:reply-to:subject:subject:to:to; s=fm1; t=1742916435; x=1743002835; bh=l0ctJw/V9g23+P1GpXO961UTlGa2Sv3/9oW9NvUnNLo=; b= cgpBuY+FMKaV1+vLh1kCTfW728Zj3y5uZQ7vRCcrFP7LEaICOKK2rEA2XonkqDq6 jrTGTafasXDKtvn8tOus3wf83LWM4JXJxQrIt2oqR8qc4fee+c2YsQjaAtS8wSNJ /xepivcXx4hr1XVHDuilXEJSb3kSydKtj14vxaOHGKgJYq4+xW8RZc6SPCYpLcvr byR8nJPaORInrSizf4LryLPADu1f4m1XwZLcvb645uXl8/kJV4esno4npzhLrFNK frUZfxO3QOZvniSknmM+UUNUyG3bypxqQQ384bCy2gokh2I/IiOgH97CWfmb3VYO YVb1xZCLjhisvO7qJP4oxg== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=cc:cc:content-transfer-encoding :content-type:content-type:date:date:feedback-id:feedback-id :from:from:in-reply-to:in-reply-to:message-id:mime-version :references:reply-to:subject:subject:to:to:x-me-proxy :x-me-sender:x-me-sender:x-sasl-enc; s=fm2; t=1742916435; x= 1743002835; bh=l0ctJw/V9g23+P1GpXO961UTlGa2Sv3/9oW9NvUnNLo=; b=O 8wIpZ7tcye9eK5LsjxQ6Hg7uG1WbDW/TMTCfFOp4xwuzHtSAeXaUpMjDIR2VWznu fCsZ2UUhPV/7g6If5oLFpo9MW2vnOjWNjpCzytygXAg5pwRtGTZB7vrucNCEoWsY QbxzgjFZpQ7oKW+IYY6zNV2i+T3rD9qxaG1ShDRaIlINGqcZ4ed7MMvv/cMDA74W lvHKKncgw0dGK9wQYfmdSwpuXqFRc0y+8FygXS3sJQDqYq8Ki4FIgeKgcFCKWHYQ PKpDSyOU7IG75pN6buBAgtfJCPijmG32qYqjQLeNflkBWAvHfOVZKIhE3hBfD7QY sxeYWs1faRM5z937Kd5QA== X-ME-Sender: X-ME-Received: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgeefvddrtddtgdduieeftdduucetufdoteggodetrf dotffvucfrrhhofhhilhgvmecuhfgrshhtofgrihhlpdggtfgfnhhsuhgsshgtrhhisggv pdfurfetoffkrfgpnffqhgenuceurghilhhouhhtmecufedttdenucesvcftvggtihhpih gvnhhtshculddquddttddmnecujfgurhepkfffgggfuffvvehfhfgjtgfgsehtjeertddt vdejnecuhfhrohhmpeetughrihgrnhcumfhlrghvvghruceorggurhhirghnrdhklhgrvh gvrhesrghklhgrvhgvrhdrtghomheqnecuggftrfgrthhtvghrnhepteeuffeuudeukeek veegfefgkedtieelhfevleegteevvdekheehgeefffdthfeunecuffhomhgrihhnpehpgh gsrggtkhhrvghsthdrohhrghenucevlhhushhtvghrufhiiigvpedtnecurfgrrhgrmhep mhgrihhlfhhrohhmpegrughrihgrnhdrkhhlrghvvghrsegrkhhlrghvvghrrdgtohhmpd hnsggprhgtphhtthhopeegpdhmohguvgepshhmthhpohhuthdprhgtphhtthhopehjihhm ihhssehgmhigrdhnvghtpdhrtghpthhtoheprhhonhhljhhohhhnshhonhhjrhesghhmrg hilhdrtghomhdprhgtphhtthhopehlrghurhgvnhiirdgrlhgsvgestgihsggvrhhtvggt rdgrthdprhgtphhtthhopehpghhsqhhlqdhgvghnvghrrghlsehlihhsthhsrdhpohhsth hgrhgvshhqlhdrohhrgh X-ME-Proxy: Feedback-ID: i76984098:Fastmail Received: by mail.messagingengine.com (Postfix) with ESMTPA; Tue, 25 Mar 2025 11:27:14 -0400 (EDT) Message-ID: Date: Tue, 25 Mar 2025 08:27:13 -0700 MIME-Version: 1.0 User-Agent: Mozilla Thunderbird Subject: Re: Experience and feedback on pg_restore --data-only To: Dimitrios Apostolou , Ron Johnson Cc: Laurenz Albe , pgsql-general@lists.postgresql.org References: <53760c70-4a87-a453-9e02-57abc9cb2e54@gmx.net> <455d28421ae33c73b73a6f527d2f72816ca5dd29.camel@cybertec.at> <5f1ebeda-f080-cb31-75c0-ce2211ea348f@gmx.net> <832c1cdd-c0fe-464b-b4b9-f9d0482b9b78@aklaver.com> Content-Language: en-US From: Adrian Klaver In-Reply-To: Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit List-Id: List-Help: List-Subscribe: List-Post: List-Owner: List-Archive: Archived-At: Precedence: bulk On 3/24/25 09:15, Dimitrios Apostolou wrote: > Hi Ron, > > I read your reply in the mailing list archives as I'm not subscribed to > the list, and I'm copy-pasting a response here. Please include me as a > recipient in further replies. > >> Why are you regularly having emergencies requiring the restoration of >> multi-TB tables to databases with lots of cruft? >> >> Fixing that would go a long way towards eliminating your problems with >> pg_restore. > > I don't have emergencies yet. I'm testing the process of restoring the > database dump, and it takes more than 24 hours currently. A successful > test is vital to approve the process. It is doubtful that pg_dump/pg_restore will meet the requirements. You are probably looking at some process that does incremental updates and then restores from that. Something like pgbackrest: https://pgbackrest.org/ comes to mind. > > But the primary usage of pg_restore that I have is not to save me from > emergencies but to populate the dev database with recent data. > > > Regards, > Dimitris > -- Adrian Klaver adrian.klaver@aklaver.com