Received: from malur.postgresql.org ([217.196.149.56]) by arkaria.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.94.2) (envelope-from ) id 1szzgb-0091xV-ES for pgsql-admin@arkaria.postgresql.org; Sun, 13 Oct 2024 14:35:09 +0000 Received: from localhost ([127.0.0.1] helo=malur.postgresql.org) by malur.postgresql.org with esmtp (Exim 4.94.2) (envelope-from ) id 1szzgZ-004Gxs-M2 for pgsql-admin@arkaria.postgresql.org; Sun, 13 Oct 2024 14:35:08 +0000 Received: from magus.postgresql.org ([2a02:c0:301:0:ffff::29]) by malur.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.94.2) (envelope-from ) id 1szzgZ-004GxM-8Y for pgsql-admin@lists.postgresql.org; Sun, 13 Oct 2024 14:35:07 +0000 Received: from mailout.easymail.ca ([64.68.200.34]) by magus.postgresql.org with esmtps (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.94.2) (envelope-from ) id 1szzgW-000qdr-9W for pgsql-admin@lists.postgresql.org; Sun, 13 Oct 2024 14:35:06 +0000 Received: from localhost (localhost [127.0.0.1]) by mailout.easymail.ca (Postfix) with ESMTP id E1B89E36B0; Sun, 13 Oct 2024 14:35:02 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=elevated-dev.com; s=easymail; t=1728830102; bh=IGYdqnXF9EHo0ggIRfrwzkhd5ReHX7jWUTnu/FzEYek=; h=Subject:From:In-Reply-To:Date:Cc:References:To:From; b=xChjw3eyyjT1x54A3bwu1ysYps4nJD5RbSO9fA4OkZeVJkcmRh8JGCJk2FPtKaIZV MkkKHahi9378E3mQIUWxwxFJXOY9OvPyBNoPfQGGr2EbwqPgQ/g8mNMXPDjeMRSi+V LmaoJtyi7nEuzru6TN6k2BN1Fs71or4MLtrU2d3ystKWuDAedV7kM3UyxWLnoMaPAD 9Dp9fH7eoL80vhv5PkFLCCCifMUTwoocJxGO8ZyqT4AX/eL+UvWSLRUN0Ka0La84Gi szP+Cf1FV0iBIfK28KpKl8dVoOUnnaOrmJiOdR9vtQ4tmEGZ5VNjtH6eV0MC/GQCdt /fqmZXkS37a+g== X-Virus-Scanned: Debian amavisd-new at emo08-pco.easydns.vpn Received: from mailout.easymail.ca ([127.0.0.1]) by localhost (emo08-pco.easydns.vpn [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id d1kRAd9Vw1rC; Sun, 13 Oct 2024 14:35:02 +0000 (UTC) Received: from smtpclient.apple (unknown [50.204.225.178]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mailout.easymail.ca (Postfix) with ESMTPSA id 45BBAE36AF; Sun, 13 Oct 2024 14:35:02 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=elevated-dev.com; s=easymail; t=1728830102; bh=IGYdqnXF9EHo0ggIRfrwzkhd5ReHX7jWUTnu/FzEYek=; h=Subject:From:In-Reply-To:Date:Cc:References:To:From; b=xChjw3eyyjT1x54A3bwu1ysYps4nJD5RbSO9fA4OkZeVJkcmRh8JGCJk2FPtKaIZV MkkKHahi9378E3mQIUWxwxFJXOY9OvPyBNoPfQGGr2EbwqPgQ/g8mNMXPDjeMRSi+V LmaoJtyi7nEuzru6TN6k2BN1Fs71or4MLtrU2d3ystKWuDAedV7kM3UyxWLnoMaPAD 9Dp9fH7eoL80vhv5PkFLCCCifMUTwoocJxGO8ZyqT4AX/eL+UvWSLRUN0Ka0La84Gi szP+Cf1FV0iBIfK28KpKl8dVoOUnnaOrmJiOdR9vtQ4tmEGZ5VNjtH6eV0MC/GQCdt /fqmZXkS37a+g== Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3776.700.51\)) Subject: Re: Loading data from one table to another From: Scott Ribe In-Reply-To: Date: Sun, 13 Oct 2024 08:34:51 -0600 Cc: "pgsql-admin@lists.postgresql.org" Content-Transfer-Encoding: quoted-printable Message-Id: References: To: Sabyasachi Mukherjee X-Mailer: Apple Mail (2.3776.700.51) List-Id: List-Help: List-Subscribe: List-Post: List-Owner: List-Archive: Archived-At: Precedence: bulk Failing to allocate a memory segment of only 1MB seems suspicious. What = are your hardware specs? You might want to look at your memory & parallel query settings in = postgresql.conf--perhaps some of those are set too high relative to your = server's memory. I wouldn't really expect queries to be slow on 99GB, by the way. That is = not a large database. Partitioning is reasonable if you want to prune = old data periodically, as then you can just drop old partitions. But = unless your queries are regularly have to perform table scans, I = wouldn't expect them to be slow. And if they are performing table scans, = you'd need to investigate how to fix that--what indexes to add. = Partitioning will get you incremental performance gains in such a case, = while the right index will get you exponential gains.=