From: Oleg Bartunov <oleg@sai.msu.su>
To: Werner Bohl <WernerBohl@infutor.com>
Cc: pgsql-performance@postgresql.org
Subject: Re: How to speed up tsearch2 indexing
Date: Wed, 9 Mar 2005 20:41:01 +0300 (MSK)
Message-ID: <Pine.GSO.4.62.0503092038540.26616@ra.sai.msu.su> (raw)
In-Reply-To: <1110389147.21620.6.camel@sirio>
References: <1110389147.21620.6.camel@sirio>
On Wed, 9 Mar 2005, Werner Bohl wrote:
> All,
>
> I have a table with ~ 3 million records. I'm indexing a field holding
> names, no more than 200 bytes each. Indexing the resulting tsvector
> takes forever. It's been running now for more than 40 hours on a Linux
> with PG 8.01, a single Xeon & 4GB RAM. My work_mem postgresql.conf
> parameter is at 240960 and maintenance_work_mem at 96384, although the
> index task is using at most 12MB. Task is 99% cpu bound. Is there any
> way I may speed up the indexing?
What's your tsearch2 configuration ? Do you use dictionaries ?
I wrote a brief explanation of tsearch2 internals
http://www.sai.msu.su/~megera/oddmuse/index.cgi/Tsearch_V2_internals
Hope, it could help you.
>
>
> TIA,
>
>
>
Regards,
Oleg
_____________________________________________________________
Oleg Bartunov, sci.researcher, hostmaster of AstroNet,
Sternberg Astronomical Institute, Moscow University (Russia)
Internet: oleg@sai.msu.su, http://www.sai.msu.su/~megera/
phone: +007(095)939-16-83, +007(095)939-23-83
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Reply to all the recipients from your mail client; the link fills in
the headers below: reply via email
Some clients, webmail especially, drop In-Reply-To and References from
a link, and the reply then starts a new thread: use the mbox below.
To: pgsql-performance@postgresql.org
Cc: oleg@sai.msu.su, WernerBohl@infutor.com
Subject: Re: How to speed up tsearch2 indexing
In-Reply-To: <Pine.GSO.4.62.0503092038540.26616@ra.sai.msu.su>
References: <1110389147.21620.6.camel@sirio> <Pine.GSO.4.62.0503092038540.26616@ra.sai.msu.su>
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox