pg.ddx.io  pgsql-sql@postgresql.org mailing list archive  
help / color / mirror / Atom feed
From: Jan Wieck <janwieck@Yahoo.com>
To: pgsql-sql@postgresql.org
Cc: Jan Wieck <janwieck@Yahoo.com>
Cc: Keith Wong <keith@e-magine.com.au>
Subject: Re: 8K Limit, whats the best strategy?
Date: Mon, 21 Aug 2000 15:47:24 -0500 (EST)
Message-ID: <200008212047.PAA03170@jupiter.greatbridge.com> (raw)
In-Reply-To: <39A148B7.7D67B0BD@faroenet.fo>

Poul L. Christiansen wrote:
> Jan Wieck wrote:
>
> > Poul L. Christiansen wrote:
> > > I've just split the text up (in 8 pieces), so it fits into 8K rows. But thats
> > > only a viable solution if your text is less than a couple of 100K's.
> > >
> > > You could try to be a daredevil and use the Toast code, even if it's beta. But
> > > I don't know how far the Toast project has come.
> >
> >     TOAST  is  finished  and will be shipped with 7.1. It's not a
> >     solution for huge items, but medium sized  text  up  to  some
> >     hundred K works fine.
>
> What do you mean by "..not a solution for huge items"? Does TOAST have a size limit?
>

    Not  an explicit one. But imagine you really want to store an
    MP3 of - let's say 9M in the database.

    1.  Your client application must quote it somehow to  put  it
        into  an  INSERT querystring. The quoting makes it a 10MB
        thing (think positive).

    2.  The query is sent to  the  backend.  Now  you  have  this
        string a second time in memory.

    3.  The  query  is  parsed and a 10MB text datum is built for
        the querytrees Const node.

    4.  The query is executed, builds a 10MB tuple to store.

    5.  Toast jumps in and moves it out of the tuple again.

    So if the client and DB  are  running  on  the  same  system,
    you'll  have  the  MP3  four  times  in  memory.  Now  do  it
    concurrent with 20 backends and you'll need 800+ ... you  see
    why I said it's "not a solution for huge"?


Jan

--

#======================================================================#
# It's easier to get forgiveness for being wrong than for being right. #
# Let's break this rule - forgive me.                                  #
#================================================== JanWieck@Yahoo.com #





view thread (7+ messages)

Message-ID: <200008212047.PAA03170@jupiter.greatbridge.com>
Permalink:  ../200008212047.PAA03170@jupiter.greatbridge.com/
Also on:    postgresql.org/message-id/200008212047.PAA03170@jupiter.greatbridge.com

 · 

reply

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Reply to all the recipients from your mail client; the link fills in
  the headers below: reply via email
  Some clients, webmail especially, drop In-Reply-To and References from
  a link, and the reply then starts a new thread: use the mbox below.

  To: pgsql-sql@postgresql.org
  Cc: janwieck@Yahoo.com, keith@e-magine.com.au
  Subject: Re: 8K Limit, whats the best strategy?
  In-Reply-To: <200008212047.PAA03170@jupiter.greatbridge.com>
  References: <39A148B7.7D67B0BD@faroenet.fo> <200008212047.PAA03170@jupiter.greatbridge.com>

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox