Re: Tsearch2 & Hebrew

From: Yonatan Ben-Nes <yonatan(at)epoch(dot)co(dot)il>
To: Oleg Bartunov <oleg(at)sai(dot)msu(dot)su>
Cc: Michelle Konzack <linux4michelle(at)freenet(dot)de>, pgsql-general(at)postgresql(dot)org
Subject: Re: Tsearch2 & Hebrew
Date: 2006-09-05 16:02:59
Message-ID: 44FD9FB3.9090607@epoch.co.il
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-general


Oleg Bartunov wrote:

> On Tue, 5 Sep 2006, Yonatan Ben-Nes wrote:
>
>> No, I didn't thought that it will be useful if it won't be
>> accompanied by an hebrew stemmer which will work with it... I'm wrong?
>>
>
> ispell and stemmer are doing the same job, so you may use
>
> ispell,simple configuration instead of "ideal" one: ispell, stemmer
>
> Of course, some words will not recognized and will leave as is.
> Also, you may write very simple stemmer using collection of very common
> endings.
>
> Oleg
>
Thanks a lot I'll do that at once!
Yonatan Ben-Nes

>>
>> Oleg Bartunov wrote:
>>
>>> On Tue, 5 Sep 2006, Yonatan Ben-Nes wrote:
>>>
>>>> Hi all,
>>>>
>>>>
>>>> Well my problem was that I didn't know if Tsearch2 can work on
>>>> hebrew data without a fitting stemmer, my current solution is to
>>>> use the 'simple' dictionary so no lexem is returned.
>>>> I wonder if there is an hebrew stemmer which I can use but I can't
>>>> seem to find one, so sadly one of the best features of Tsearch2
>>>> isn't working for me.
>>>>
>>>
>>> Do you use hebrew ispell dictionary ?
>>>
>>>>
>>>> If I'm wrong please let me know :)
>>>>
>>>>
>>>> Thanks a lot in advance,
>>>>
>>>> Yonatan Ben-Nes
>>>>
>>>>
>>>> Oleg Bartunov wrote:
>>>>
>>>>> You need to provide more details.
>>>>>
>>>>> Oleg
>>>>> On Fri, 1 Sep 2006, Michelle Konzack wrote:
>>>>>
>>>>>> Hello Jonatan,
>>>>>>
>>>>>> Am 2006-08-30 19:09:19, schrieb Yonatan Ben-Nes:
>>>>>>> I want to use Tsearch2 for a current project I have but I can't
>>>>>>> seem to
>>>>>>> find a way to implement it on hebrew content.
>>>>>>
>>>>>> I have the same problem since I have an UTF-8 Database of arround
>>>>>> 380 GByte (growing 100 MByte per day) in over 60 languages and
>>>>>> can not search in arabic, farsi and hebrew.
>>>>>>
>>>>>> It seems, that there is NO solution for those three languages
>>>>>>
>>>>>> Greetings
>>>>>> Michelle Konzack
>>>>>> Systemadministrator
>>>>>> Tamay Dogan Network
>>>>>> Debian GNU/Linux Consultant
>>>>>>
>>>>>>
>>>>>>
>>>>>
>>>>> Regards,
>>>>> Oleg
>>>>> _____________________________________________________________
>>>>> Oleg Bartunov, Research Scientist, Head of AstroNet
>>>>> (www.astronet.ru),
>>>>> Sternberg Astronomical Institute, Moscow University, Russia
>>>>> Internet: oleg(at)sai(dot)msu(dot)su, http://www.sai.msu.su/~megera/
>>>>> phone: +007(495)939-16-83, +007(495)939-23-83
>>>>>
>>>>> ---------------------------(end of
>>>>> broadcast)---------------------------
>>>>> TIP 4: Have you searched our list archives?
>>>>>
>>>>> http://archives.postgresql.org
>>>>>
>>>>>
>>>>> __________ NOD32 1.1739 (20060904) Information __________
>>>>>
>>>>> This message was checked by NOD32 antivirus system.
>>>>> http://www.eset.com
>>>>>
>>>>>
>>>>>
>>>>
>>>
>>> Regards,
>>> Oleg
>>> _____________________________________________________________
>>> Oleg Bartunov, Research Scientist, Head of AstroNet (www.astronet.ru),
>>> Sternberg Astronomical Institute, Moscow University, Russia
>>> Internet: oleg(at)sai(dot)msu(dot)su, http://www.sai.msu.su/~megera/
>>> phone: +007(495)939-16-83, +007(495)939-23-83
>>>
>>> ---------------------------(end of
>>> broadcast)---------------------------
>>> TIP 6: explain analyze is your friend
>>>
>>>
>>> __________ NOD32 1.1739 (20060904) Information __________
>>>
>>> This message was checked by NOD32 antivirus system.
>>> http://www.eset.com
>>>
>>>
>>>
>>
>
> Regards,
> Oleg
> _____________________________________________________________
> Oleg Bartunov, Research Scientist, Head of AstroNet (www.astronet.ru),
> Sternberg Astronomical Institute, Moscow University, Russia
> Internet: oleg(at)sai(dot)msu(dot)su, http://www.sai.msu.su/~megera/
> phone: +007(495)939-16-83, +007(495)939-23-83
>
>
> __________ NOD32 1.1739 (20060904) Information __________
>
> This message was checked by NOD32 antivirus system.
> http://www.eset.com
>
>
>

In response to

Browse pgsql-general by date

  From Date Subject
Next Message codeWarrior 2006-09-05 16:11:10 Re: Porting from ORACLE to PostgSQL
Previous Message Oleg Bartunov 2006-09-05 15:57:54 Re: Tsearch2 & Hebrew