pg.ddx.io  pgsql-admin@postgresql.org mailing list archive  

help / color / mirror / Atom feed
From: Greg Williamson <gwilliamson39@yahoo.com>
To: Kevin Grittner <Kevin.Grittner@wicourts.gov>
To: Tim <elatllat@gmail.com>
To: pgsql-admin@postgresql.org
Subject: Re: tsvector limitations
Date: Tue, 14 Jun 2011 22:56:26 -0700 (PDT)
Message-ID: <453674.41390.qm@web46113.mail.sp1.yahoo.com> (raw)
In-Reply-To: <4DF79808020000250003E649@gw.wicourts.gov>
References: <BANLkTi=hAv876hXEru6FO8PNGWFNYB21ZA@mail.gmail.com>
	<4DF7275C020000250003E59F@gw.wicourts.gov>
	<BANLkTikz+MY1DoO5UcxzJbG+VNgGKn0HFg@mail.gmail.com>
	<4DF7399B020000250003E5AB@gw.wicourts.gov>
	<BANLkTi=4EaMpXu7orXiAHOiA2AS0w9k_Yg@mail.gmail.com>
	<BANLkTiksUZuiKrtbsDfUkfYUU=zMEgK2cg@mail.gmail.com>
	<4DF79808020000250003E649@gw.wicourts.gov>

Kevin Grittner wrote:



> Tim <elatllat@gmail.com> wrote:
> 
<...>
> Your test (whatever data it is that you used) don't seem typical of
> English text.  The entire PostgreSQL documentation in HTML form,
> when all the html files are concatenated is 11424165 bytes (11MB),
> and the tsvector of that is 364410 (356KB).  I don't suppose you
> know of some publicly available file on the web that I could use to
> reproduce your problem?

Try trolling texts at the Internet Archive (archive.org) -- lots of stuff that 
has been rendered into ASCII ... Government documents and the like from all 
periods; novels and the like that are no longer under copyright, so lots of long 
classics.

<http://www.archive.org/stream/ataleoftwocities00098gut/old/2city12p_djvu.txt; 
for example ... 765K

HTH,

Greg Williamson

-- 
Sent via pgsql-admin mailing list (pgsql-admin@postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-admin




view thread (21+ messages)  latest in thread

Message-ID: <453674.41390.qm@web46113.mail.sp1.yahoo.com>
Permalink:  ../453674.41390.qm@web46113.mail.sp1.yahoo.com/
Also on:    postgresql.org/message-id/453674.41390.qm@web46113.mail.sp1.yahoo.com

 · 

reply
Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Reply to all the recipients using the --to and --cc options:
  reply via email

  To: pgsql-admin@postgresql.org
  Cc: gwilliamson39@yahoo.com, Kevin.Grittner@wicourts.gov, elatllat@gmail.com
  Subject: Re: tsvector limitations
  In-Reply-To: <453674.41390.qm@web46113.mail.sp1.yahoo.com>

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox