From: Ron <ronljohnsonjr@gmail.com>
To: pgsql-general@lists.postgresql.org
Subject: Re: TEXT column > 1Gb
Date: Wed, 12 Apr 2023 15:29:10 -0500
Message-ID: <05437ceb-4e0b-d1e9-4339-926122773945@gmail.com> (raw)
In-Reply-To: <04ab2b33-be6e-5073-1004-31a7117531af@gmail.com>
References: <85984fc4-6e08-06ad-78d7-d6f73a5c90a0@gmail.com>
<0A8EB6F5-57BC-4519-8E9A-DBB809CC09D5@lbl.gov>
<E18E02B1-39DE-4464-9C8C-F0C06BBF771B@enterprisedb.com>
<A29ABFF1-8014-46B2-9425-34F59812581A@lbl.gov>
<4777754a-ad1f-eae3-f6c9-a4f783e803e3@gmail.com>
<04ab2b33-be6e-5073-1004-31a7117531af@gmail.com>
On 4/12/23 14:21, Rob Sargent wrote:
> On 4/12/23 13:02, Ron wrote:
>> /Must/ the genome all be in one big file, or can you store them one line
>> per table row?
>
> Not sure what OP is doing with plant genomes (other than some genomics)
> but the tools all use files and pipeline of sub-tools. In and out of
> tuples would be expensive. Very,very little "editing" done in the usual
> "update table set val where id" sense.
>
> Lines in a vcf file can have thousands of colums fo nasty, cryptic garbage
> data that only really makes sense to tools, reader. Highly denormalized of
> course. (Btw, I hate sequencing :) )
My thinking is that you'd never hit a 1GiB limit if every line in the vcf
file was in it's it's own row in a table.
Performance /would/ drop, though.
--
Born in Arizona, moved to Babylonia.
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Reply to all the recipients from your mail client; the link fills in
the headers below: reply via email
Some clients, webmail especially, drop In-Reply-To and References from
a link, and the reply then starts a new thread: use the mbox below.
To: pgsql-general@postgresql.org
Cc: ronljohnsonjr@gmail.com
Subject: Re: TEXT column > 1Gb
In-Reply-To: <05437ceb-4e0b-d1e9-4339-926122773945@gmail.com>
References: <85984fc4-6e08-06ad-78d7-d6f73a5c90a0@gmail.com> <0A8EB6F5-57BC-4519-8E9A-DBB809CC09D5@lbl.gov> <E18E02B1-39DE-4464-9C8C-F0C06BBF771B@enterprisedb.com> <A29ABFF1-8014-46B2-9425-34F59812581A@lbl.gov> <4777754a-ad1f-eae3-f6c9-a4f783e803e3@gmail.com> <04ab2b33-be6e-5073-1004-31a7117531af@gmail.com> <05437ceb-4e0b-d1e9-4339-926122773945@gmail.com>
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox