Re: Include Lists for Text Search

From: Oleg Bartunov <oleg(at)sai(dot)msu(dot)su>
To: Simon Riggs <simon(at)2ndquadrant(dot)com>
Cc: Heikki Linnakangas <heikki(at)enterprisedb(dot)com>, pgsql-hackers(at)postgresql(dot)org
Subject: Re: Include Lists for Text Search
Date: 2007-09-10 12:33:03
Message-ID: Pine.LNX.4.64.0709101631050.2767@sn.sai.msu.ru
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-hackers pgsql-patches

On Mon, 10 Sep 2007, Simon Riggs wrote:

> On Mon, 2007-09-10 at 12:58 +0100, Heikki Linnakangas wrote:
>> Simon Riggs wrote:
>>> It seems possible to write your own functions to support various
>>> possibilities with text search.
>>>
>>> One of the more common thoughts is to have a list of words that you
>>> would like to include, i.e. the opposite of a stop word list.
>>>
>>> There are clear indications that indexing too many words is a problem
>>> for both GIN and GIST. If people already know what they'll be looking
>>> for and what they will never be looking for, it seems easier to supply
>>> that list up front, rather than hide it behind lots of hand-crafted
>>> code.
>>
>> I don't understand what you're proposing. We already have dict_synonym
>> that you can use to accept a simple list of words.
>
> How does that allow me to limit the number of words to a known list?

text search doesn't index unknown words, so if your mapping contains
only one dictionary, this dictionary will control what words to index.
While dict_synonym is good for not big list I'd write separate dictionary
with fast lookup.

Regards,
Oleg
_____________________________________________________________
Oleg Bartunov, Research Scientist, Head of AstroNet (www.astronet.ru),
Sternberg Astronomical Institute, Moscow University, Russia
Internet: oleg(at)sai(dot)msu(dot)su, http://www.sai.msu.su/~megera/
phone: +007(495)939-16-83, +007(495)939-23-83

In response to

Browse pgsql-hackers by date

  From Date Subject
Next Message Oleg Bartunov 2007-09-10 12:35:40 Re: Include Lists for Text Search
Previous Message Simon Riggs 2007-09-10 12:28:59 Re: Include Lists for Text Search

Browse pgsql-patches by date

  From Date Subject
Next Message Oleg Bartunov 2007-09-10 12:35:40 Re: Include Lists for Text Search
Previous Message Simon Riggs 2007-09-10 12:28:59 Re: Include Lists for Text Search