Received: from malur.postgresql.org ([2a02:16a8:dc51::56]) by arkaria.postgresql.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_CBC_SHA384:256) (Exim 4.89) (envelope-from ) id 1g1u4T-0001ql-GB for pgsql-admin@arkaria.postgresql.org; Mon, 17 Sep 2018 14:00:13 +0000 Received: from localhost ([127.0.0.1] helo=malur.postgresql.org) by malur.postgresql.org with esmtp (Exim 4.89) (envelope-from ) id 1g1u4Q-0006rz-Nw for pgsql-admin@arkaria.postgresql.org; Mon, 17 Sep 2018 14:00:10 +0000 Received: from magus.postgresql.org ([2a02:c0:301:0:ffff::29]) by malur.postgresql.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_CBC_SHA384:256) (Exim 4.89) (envelope-from ) id 1g1u4Q-0006ro-Gr for pgsql-admin@lists.postgresql.org; Mon, 17 Sep 2018 14:00:10 +0000 Received: from mailout.easymail.ca ([64.68.200.34]) by magus.postgresql.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_CBC_SHA384:256) (Exim 4.89) (envelope-from ) id 1g1u4I-0001LU-NM for pgsql-admin@lists.postgresql.org; Mon, 17 Sep 2018 14:00:10 +0000 Received: from localhost (localhost [127.0.0.1]) by mailout.easymail.ca (Postfix) with ESMTP id 06F8040CA2 for ; Mon, 17 Sep 2018 14:00:00 +0000 (UTC) Received: from mailout.easymail.ca ([127.0.0.1]) by localhost (emo03-pco.easydns.vpn [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id YWdN8o4BZBfd for ; Mon, 17 Sep 2018 14:00:00 +0000 (UTC) Received: from [192.168.2.130] (unknown [8.39.228.117]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mailout.easymail.ca (Postfix) with ESMTPSA id DB8014079D for ; Mon, 17 Sep 2018 13:59:59 +0000 (UTC) From: Scott Ribe Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable Mime-Version: 1.0 (Mac OS X Mail 11.5 \(3445.9.1\)) Subject: Re: Big image tables maintenance Date: Mon, 17 Sep 2018 07:59:58 -0600 References: To: pgsql-admin@lists.postgresql.org In-Reply-To: Message-Id: <0F8CB802-9FBC-4EA3-98AE-E81F26B3E559@elevated-dev.com> X-Mailer: Apple Mail (2.3445.9.1) List-Id: List-Help: List-Subscribe: List-Post: List-Owner: List-Archive: Precedence: bulk On 09/17/2018 07:38 AM, still Learner wrote: > Hi , >=20 > I have a 10 TB size table with multiple bytea columns (image & doc)and = makes 20TB of DB size. I have a couple of issues to maintain the DB. >=20 > 1. I Would like to separate the image column from the 10TB size table, = place it in a separate schema. The change should not result in any query = change in the application. Is it possible? Doing this it should not = affect the performance.=20 They're automatically stored separate, see = https://www.postgresql.org/docs/current/static/storage-toast.html. > 2. I can't maintain files on File system as the count is huge, So? I've stored millions of documents on a Mac mini. Real server = hardware & OS should have no problem--10TB is really not all that much. > so thinking of using any no-sql mostly mongo-DB, is it recommended? Or = PostgreSQL itself can handle?=20 Only if all you need is the document storage, none of everything else PG = offers. > 3. Taking the backup of 20TB data, is big task. Any more feasible = solution other than online backup/pg_dump? That's an argument for keeping the presumably immutable files on the = file system. (There are arguments against as well.)