Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.94.2) (envelope-from ) id 1twNkk-00DfwC-Ty for pgsql-general@arkaria.postgresql.org; Sun, 23 Mar 2025 16:00:47 +0000 Received: from localhost ([127.0.0.1] helo=malur.postgresql.org) by malur.postgresql.org with esmtp (Exim 4.94.2) (envelope-from ) id 1twNkj-000yQZ-21 for pgsql-general@arkaria.postgresql.org; Sun, 23 Mar 2025 16:00:45 +0000 Received: from makus.postgresql.org ([2001:4800:3e1:1::229]) by malur.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.94.2) (envelope-from ) id 1twNki-000yQR-Mj for pgsql-general@lists.postgresql.org; Sun, 23 Mar 2025 16:00:44 +0000 Received: from mail-ed1-x52b.google.com ([2a00:1450:4864:20::52b]) by makus.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256 (Exim 4.96) (envelope-from ) id 1twNkg-000hEw-2p for pgsql-general@lists.postgresql.org; Sun, 23 Mar 2025 16:00:43 +0000 Received: by mail-ed1-x52b.google.com with SMTP id 4fb4d7f45d1cf-5e033c2f106so5180250a12.3 for ; Sun, 23 Mar 2025 09:00:42 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=cybertec.at; s=google; t=1742745641; x=1743350441; darn=lists.postgresql.org; h=mime-version:user-agent:content-transfer-encoding:references :in-reply-to:date:to:from:subject:message-id:from:to:cc:subject:date :message-id:reply-to; bh=xJQrMsQ7ngu+BT7vW5xAdDFlCan6HpU1yPKQ1gFFO14=; b=bgnJaeFVV72B+X6+s4L7GzDb5+xBA8K9WsrS+m8AjIcBjpIOZXzL6UAAUBIMVIx6Yj tvBkkAEty/MhwPP6J4Eq75V2rgA2EOBfGc4oAQ5BJCtHuJMkToFcA5A91XlP+3pSaVx+ ev8kp92oxSfY1uzrmWVLcaSUYfh1IS8SsuPvkCtb3mO9f2s46agESmm5/RI+KeTfK0Rp 3pRgk+j7ZxR2P/vr6fVMFdJ8ijVO++uMRhpGKu6mnGRCcVtfgl4yBtCDnRVwDcH5fpzB l5Pe3ytHIMJHIlhXTHg6Z9UPlx0VIwG7RfQ5gLAHU8QBjlyhg+3ktW2ZcK9858tdPWAn Fxcw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1742745641; x=1743350441; h=mime-version:user-agent:content-transfer-encoding:references :in-reply-to:date:to:from:subject:message-id:x-gm-message-state:from :to:cc:subject:date:message-id:reply-to; bh=xJQrMsQ7ngu+BT7vW5xAdDFlCan6HpU1yPKQ1gFFO14=; b=G9UWdbqNFYg0gVnFFIYfFi57sq2+jIuEMooAFlIZynW04JZbik/zGEfSlY0IeZIhGq rj5ZCWm3HUOjUT07SQcdRnGHTqb2ROBophxJWUUj8rERdTecZOkXCi6c081GejJCQOnt Tlvw53Vz0U90HilIVgEC9dMTD2aAG1fPvsvkgOoi93xVOGddAdFUYTpZV7ciYbKEuG+e 9ntuGIsw/JLmtJ78EtMFmrr0ppjL97eFerzAdTbOX3fQJv9hkxToztLWaZPQoEQ8yZfT EB5/0n/vNMSXX189RtiWRZC8JdAeu/7GexE0zJtE635q5HwIO73NeydpHvkhvQMFhp1r 9XmQ== X-Forwarded-Encrypted: i=1; AJvYcCVNwmRpXB7FUYSv2cSNLGmvXEKGeJuj+rzXnqiKLFQUlnfjcFmpbnFzxG9psjuZ1JCN4AVTc5iq+B/VfaH9@lists.postgresql.org X-Gm-Message-State: AOJu0YyhlREqzQTbvcjIREMCgHqtVM+T/Wl3nMHv5rphtEANCMCK+iH2 KU7YvEGlGglKV324OC28ebTaMk11obzeujSHCsjxhYaztMZomLMi8N+ibqB7u0E= X-Gm-Gg: ASbGncsDdvDnp/qANn5okArZHCm62AH8u0lBM6aT3FupK7Xw3a/Oh6BFqTgHrsYD1YP EeHTDG9DmdQfi4XP7SVnh8ofvymyGvwZxWNYkAHYvCVsH0+38pu66NjOqPif18+l2Z6gnko3MpE WY6WqMG1WSWa8vFrQsKRjve7BDxr1R/3/cmsDfj7WH4Wk+30ijfZ6Y7BnwIiNijBeoFe76MSPYG BiElNszDPjcyb4E/lS4KnZM/D3+iP5Llv++B08Tx+GyBCxC2DOrJUk3+zz3RS+LST6WA7xyTEan BEZk8cJDMjAvK6RqW62I18ApbSGPvB/U5jtL9WgIIQpWpmSBqo+p1JLoAVTmLa6pMw== X-Google-Smtp-Source: AGHT+IGPwCeErkeX2jrBg5OrPrx1gcfbdtTIu+8v7K8+Up+6L/mouz43tLousFioIgtmPE7iYhbU2A== X-Received: by 2002:a05:6402:42c8:b0:5dc:9589:9f64 with SMTP id 4fb4d7f45d1cf-5ebcd4342bfmr8117635a12.13.1742745640864; Sun, 23 Mar 2025 09:00:40 -0700 (PDT) Received: from localhost.localdomain ([2001:871:260:d29e:2119:4ac3:ada4:bc98]) by smtp.gmail.com with ESMTPSA id 4fb4d7f45d1cf-5ebccf85945sm4869495a12.20.2025.03.23.09.00.40 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Sun, 23 Mar 2025 09:00:40 -0700 (PDT) Message-ID: <455d28421ae33c73b73a6f527d2f72816ca5dd29.camel@cybertec.at> Subject: Re: Experience and feedback on pg_restore --data-only From: Laurenz Albe To: Dimitrios Apostolou , pgsql-general@lists.postgresql.org Date: Sun, 23 Mar 2025 17:00:39 +0100 In-Reply-To: <53760c70-4a87-a453-9e02-57abc9cb2e54@gmx.net> References: <53760c70-4a87-a453-9e02-57abc9cb2e54@gmx.net> Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable User-Agent: Evolution 3.54.3 (3.54.3-1.fc41) MIME-Version: 1.0 List-Id: List-Help: List-Subscribe: List-Post: List-Owner: List-Archive: Archived-At: Precedence: bulk On Thu, 2025-03-20 at 23:48 +0100, Dimitrios Apostolou wrote: > Performance issues: (important as my db size is >5TB) >=20 > * WAL writes: I didn't manage to avoid writing to the WAL, despite having > =C2=A0=C2=A0 setting wal_level=3Dminimal. I even wrote my own function to= ALTER all > =C2=A0=C2=A0 tables to UNLOGGED, but failed with "could not change table = T to > =C2=A0=C2=A0 unlogged because it references logged table".=C2=A0 I'm out = of ideas on this > =C2=A0=C2=A0 one. You'd have to create an load the table in the same transaction, that is, you'd have to run pg_restore with --single-transaction. > Any feedback for improving my process? Should I put these ideas somewhere > as ideas for improvement on pg_restore? You put your ideas in the right place. Yours, Laurenz Albe