Re: Tsearch2 & Hebrew

From: Oleg Bartunov <oleg(at)sai(dot)msu(dot)su>
To: Yonatan Ben-Nes <yonatan(at)epoch(dot)co(dot)il>
Cc: Michelle Konzack <linux4michelle(at)freenet(dot)de>, pgsql-general(at)postgresql(dot)org
Subject: Re: Tsearch2 & Hebrew
Date: 2006-09-05 15:57:54
Message-ID: Pine.GSO.4.63.0609051954180.16344@ra.sai.msu.su
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-general

On Tue, 5 Sep 2006, Yonatan Ben-Nes wrote:

> No, I didn't thought that it will be useful if it won't be accompanied by an
> hebrew stemmer which will work with it... I'm wrong?
>

ispell and stemmer are doing the same job, so you may use

ispell,simple configuration instead of "ideal" one: ispell, stemmer

Of course, some words will not recognized and will leave as is.
Also, you may write very simple stemmer using collection of very common
endings.

Oleg

>
> Oleg Bartunov wrote:
>
>> On Tue, 5 Sep 2006, Yonatan Ben-Nes wrote:
>>
>>> Hi all,
>>>
>>>
>>> Well my problem was that I didn't know if Tsearch2 can work on hebrew data
>>> without a fitting stemmer, my current solution is to use the 'simple'
>>> dictionary so no lexem is returned.
>>> I wonder if there is an hebrew stemmer which I can use but I can't seem to
>>> find one, so sadly one of the best features of Tsearch2 isn't working for
>>> me.
>>>
>>
>> Do you use hebrew ispell dictionary ?
>>
>>>
>>> If I'm wrong please let me know :)
>>>
>>>
>>> Thanks a lot in advance,
>>>
>>> Yonatan Ben-Nes
>>>
>>>
>>> Oleg Bartunov wrote:
>>>
>>>> You need to provide more details.
>>>>
>>>> Oleg
>>>> On Fri, 1 Sep 2006, Michelle Konzack wrote:
>>>>
>>>>> Hello Jonatan,
>>>>>
>>>>> Am 2006-08-30 19:09:19, schrieb Yonatan Ben-Nes:
>>>>>> I want to use Tsearch2 for a current project I have but I can't seem to
>>>>>> find a way to implement it on hebrew content.
>>>>>
>>>>> I have the same problem since I have an UTF-8 Database of arround
>>>>> 380 GByte (growing 100 MByte per day) in over 60 languages and
>>>>> can not search in arabic, farsi and hebrew.
>>>>>
>>>>> It seems, that there is NO solution for those three languages
>>>>>
>>>>> Greetings
>>>>> Michelle Konzack
>>>>> Systemadministrator
>>>>> Tamay Dogan Network
>>>>> Debian GNU/Linux Consultant
>>>>>
>>>>>
>>>>>
>>>>
>>>> Regards,
>>>> Oleg
>>>> _____________________________________________________________
>>>> Oleg Bartunov, Research Scientist, Head of AstroNet (www.astronet.ru),
>>>> Sternberg Astronomical Institute, Moscow University, Russia
>>>> Internet: oleg(at)sai(dot)msu(dot)su, http://www.sai.msu.su/~megera/
>>>> phone: +007(495)939-16-83, +007(495)939-23-83
>>>>
>>>> ---------------------------(end of broadcast)---------------------------
>>>> TIP 4: Have you searched our list archives?
>>>>
>>>> http://archives.postgresql.org
>>>>
>>>>
>>>> __________ NOD32 1.1739 (20060904) Information __________
>>>>
>>>> This message was checked by NOD32 antivirus system.
>>>> http://www.eset.com
>>>>
>>>>
>>>>
>>>
>>
>> Regards,
>> Oleg
>> _____________________________________________________________
>> Oleg Bartunov, Research Scientist, Head of AstroNet (www.astronet.ru),
>> Sternberg Astronomical Institute, Moscow University, Russia
>> Internet: oleg(at)sai(dot)msu(dot)su, http://www.sai.msu.su/~megera/
>> phone: +007(495)939-16-83, +007(495)939-23-83
>>
>> ---------------------------(end of broadcast)---------------------------
>> TIP 6: explain analyze is your friend
>>
>>
>> __________ NOD32 1.1739 (20060904) Information __________
>>
>> This message was checked by NOD32 antivirus system.
>> http://www.eset.com
>>
>>
>>
>

Regards,
Oleg
_____________________________________________________________
Oleg Bartunov, Research Scientist, Head of AstroNet (www.astronet.ru),
Sternberg Astronomical Institute, Moscow University, Russia
Internet: oleg(at)sai(dot)msu(dot)su, http://www.sai.msu.su/~megera/
phone: +007(495)939-16-83, +007(495)939-23-83

In response to

Responses

Browse pgsql-general by date

  From Date Subject
Next Message Yonatan Ben-Nes 2006-09-05 16:02:59 Re: Tsearch2 & Hebrew
Previous Message Yonatan Ben-Nes 2006-09-05 15:37:10 Re: Tsearch2 & Hebrew