pg.ddx.io  pgsql-sql@postgresql.org mailing list archive  
help / color / mirror / Atom feed
From: Mitch Vincent <mitch@venux.net>
To: pgsql-sql@postgreSQL.org
Subject: Dilema.
Date: Fri, 10 Dec 1999 16:36:33 -0500
Message-ID: <00a201bf4356$a1640b80$0300000a@doot.org> (raw)
References: <87n1riu7bx.fsf@venus.fondation>
	<002701bf432d$a8f549a0$ce2a18c3@skillbrokers.bg>

  I have a problem that I'm hoping someone can help me with. I've built a
web-pased application that is back-ended by PGsql.. It works great, I
couldn't ask for better preformance.

However, I just recently coded another module for it and this module needed
to accept text files (or just large text blocks lets say). I ran into the 8k
query limit barrier. I need these blocks of text to be searchable and am
having to do this with a flat-file based solution right now, it's slow and
cumbersome. I would much rather have the text stored in a PG field so I
don't have to stray from the design of the search engine (which is designed
to search only the pg database, but has been hacked to search flat files
too).. I could break the texts up but they really all need to be in a single
field, not broken up. I can't think up a way to do it with the 8k query
limit.

Another problem I see is that well, there are a lot of text files (4000 now,
with about 500 added a week), many over 8k in size. Would this be too much
for PG to handle saying that I could get all the text inserted?

Also feel free to suggest some kind of indexing system for the flat files,
the only problem with that will be integration into my existing application
but I've left some hooks open so I can deal with it..

Thanks guys!

-Mitch




view thread (5+ messages)  latest in thread

Message-ID: <00a201bf4356$a1640b80$0300000a@doot.org>
Permalink:  ../00a201bf4356$a1640b80$0300000a@doot.org/
Also on:    postgresql.org/message-id/00a201bf4356$a1640b80$0300000a@doot.org

 · 

reply

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Reply to all the recipients from your mail client; the link fills in
  the headers below: reply via email
  Some clients, webmail especially, drop In-Reply-To and References from
  a link, and the reply then starts a new thread: use the mbox below.

  To: pgsql-sql@postgresql.org
  Cc: mitch@venux.net
  Subject: Re: Dilema.
  In-Reply-To: <00a201bf4356$a1640b80$0300000a@doot.org>
  References: <87n1riu7bx.fsf@venus.fondation> <002701bf432d$a8f549a0$ce2a18c3@skillbrokers.bg> <00a201bf4356$a1640b80$0300000a@doot.org>

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox