List search broken?

List search isn't returning some messages I'd expect it to. For
example, if I use Advanced Search to search for "infinity" in all
mailing lists and sort by date, I don't see either of the following
messages, which do contain the word "infinity":

http://archives.postgresql.org/pgsql-general/2006-02/msg00848.php
http://archives.postgresql.org/pgsql-hackers/2006-02/msg00919.php

Is something amiss?

--
Michael Fuhr

Michael Fuhr <mike(at)fuhr(dot)org> writes:
> List search isn't returning some messages I'd expect it to. For
> example, if I use Advanced Search to search for "infinity" in all
> mailing lists and sort by date, I don't see either of the following
> messages, which do contain the word "infinity":

Now that you mention it, I was having similar problems a day or two
ago --- a message that should have been found in Advanced Search was
not. I forget what I was using as search key though.

regards, tom lane

btw, you could always use pgsql.ru/db/mw

Oleg
On Thu, 23 Feb 2006, Tom Lane wrote:

> Michael Fuhr <mike(at)fuhr(dot)org> writes:
>> List search isn't returning some messages I'd expect it to. For
>> example, if I use Advanced Search to search for "infinity" in all
>> mailing lists and sort by date, I don't see either of the following
>> messages, which do contain the word "infinity":
>
> Now that you mention it, I was having similar problems a day or two
> ago --- a message that should have been found in Advanced Search was
> not. I forget what I was using as search key though.
>
> regards, tom lane
>
> ---------------------------(end of broadcast)---------------------------
> TIP 2: Don't 'kill -9' the postmaster
>

Regards,
Oleg
_____________________________________________________________
Oleg Bartunov, Research Scientist, Head of AstroNet (www.astronet.ru),
Sternberg Astronomical Institute, Moscow University, Russia
Internet: oleg(at)sai(dot)msu(dot)su, http://www.sai.msu.su/~megera/
phone: +007(495)939-16-83, +007(495)939-23-83

On Thu, Feb 23, 2006 at 09:56:29PM +0300, Oleg Bartunov wrote:
> btw, you could always use pgsql.ru/db/mw

Or groups.google.com, but the search function on the main site ought
to work. Failing outright might be better than returning a partial
result; at least you'd know something was wrong. I only noticed
that search wasn't working because I was looking for specific
messages that I remembered seeing and search wasn't finding them.

--
Michael Fuhr

Michael Fuhr wrote:
> On Thu, Feb 23, 2006 at 09:56:29PM +0300, Oleg Bartunov wrote:
>> btw, you could always use pgsql.ru/db/mw
>
> Or groups.google.com, but the search function on the main site ought
> to work. Failing outright might be better than returning a partial
> result; at least you'd know something was wrong. I only noticed
> that search wasn't working because I was looking for specific
> messages that I remembered seeing and search wasn't finding them.

It should be noted that we are in the middle of migrating search to a
new machine.

Joshua D. Drake

--
The PostgreSQL Company - Command Prompt, Inc. 1.503.667.4564
PostgreSQL Replication, Consulting, Custom Development, 24x7 support
Managed Services, Shared and Dedicated Hosting
Co-Authors: plPHP, plPerlNG - http://www.commandprompt.com/

On Thu, Feb 23, 2006 at 02:21:35PM -0700, Michael Fuhr wrote:
> On Thu, Feb 23, 2006 at 09:56:29PM +0300, Oleg Bartunov wrote:
> > btw, you could always use pgsql.ru/db/mw
>
> Or groups.google.com, but the search function on the main site ought
> to work. Failing outright might be better than returning a partial
> result; at least you'd know something was wrong. I only noticed
> that search wasn't working because I was looking for specific
> messages that I remembered seeing and search wasn't finding them.

ISTM this problem has existed forever, though I always just attributed
it to me not being able to remember exact phrases. But maybe the search
engine itself just has serious issues...
--
Jim C. Nasby, Sr. Engineering Consultant jnasby(at)pervasive(dot)com
Pervasive Software http://pervasive.com work: 512-231-6117
vcard: http://jim.nasby.net/pervasive.vcf cell: 512-569-9461

On Thu, 23 Feb 2006, Jim C. Nasby wrote:

> On Thu, Feb 23, 2006 at 02:21:35PM -0700, Michael Fuhr wrote:
>> On Thu, Feb 23, 2006 at 09:56:29PM +0300, Oleg Bartunov wrote:
>>> btw, you could always use pgsql.ru/db/mw
>>
>> Or groups.google.com, but the search function on the main site ought
>> to work. Failing outright might be better than returning a partial
>> result; at least you'd know something was wrong. I only noticed
>> that search wasn't working because I was looking for specific
>> messages that I remembered seeing and search wasn't finding them.
>
> ISTM this problem has existed forever, though I always just attributed
> it to me not being able to remember exact phrases. But maybe the search
> engine itself just has serious issues...

Just curious, but if you search google, is it picking all the threads
properly? is it just search.postgresql.org that is losing the archives,
or all search engines?

----
Marc G. Fournier Hub.Org Networking Services (http://www.hub.org)
Email: scrappy(at)hub(dot)org Yahoo!: yscrappy ICQ: 7615664

On Thu, Feb 23, 2006 at 08:20:29PM -0400, Marc G. Fournier wrote:
> Just curious, but if you search google, is it picking all the threads
> properly? is it just search.postgresql.org that is losing the archives,
> or all search engines?

Google Groups seems to work; so does the site Oleg mentioned. From
what I've seen only search.postgresql.org has a problem.

--
Michael Fuhr

On Thu, 23 Feb 2006, Michael Fuhr wrote:

> On Thu, Feb 23, 2006 at 08:20:29PM -0400, Marc G. Fournier wrote:
>> Just curious, but if you search google, is it picking all the threads
>> properly? is it just search.postgresql.org that is losing the archives,
>> or all search engines?
>
> Google Groups seems to work; so does the site Oleg mentioned. From
> what I've seen only search.postgresql.org has a problem.

Right, but nether Google Groups, nor Oleg's site, search
http://archives.postgresql.org ... isn't there a way of telling Google to
search for results only on site http://archives.postgresql.org? What I'm
more curious about is whether there is a problem with the ASPseek stuff,
or is there a problem with archives itself that the search engines aren't
picking up those pages you mention are missing, altho they do show up when
one does a physical check of them ...

----
Marc G. Fournier Hub.Org Networking Services (http://www.hub.org)
Email: scrappy(at)hub(dot)org Yahoo!: yscrappy ICQ: 7615664

>
> Right, but nether Google Groups, nor Oleg's site, search
> http://archives.postgresql.org ... isn't there a way of telling Google
> to search for results only on site http://archives.postgresql.org?
> What I'm more curious about is whether there is a problem with the
> ASPseek stuff, or is there a problem with archives itself that the
> search engines aren't picking up those pages you mention are missing,
> altho they do show up when one does a physical check of them ...

site:archives.postgresql.org infinity

In the google search box.

>
> ----
> Marc G. Fournier Hub.Org Networking Services
> (http://www.hub.org)
> Email: scrappy(at)hub(dot)org Yahoo!: yscrappy ICQ:
> 7615664
>
> ---------------------------(end of broadcast)---------------------------
> TIP 4: Have you searched our list archives?
>
> http://archives.postgresql.org

--
The PostgreSQL Company - Command Prompt, Inc. 1.503.667.4564
PostgreSQL Replication, Consulting, Custom Development, 24x7 support
Managed Services, Shared and Dedicated Hosting
Co-Authors: PLphp, PLperl - http://www.commandprompt.com/

On Thu, Feb 23, 2006 at 07:24:33PM -0800, Joshua D. Drake wrote:
> >Right, but nether Google Groups, nor Oleg's site, search
> >http://archives.postgresql.org ... isn't there a way of telling Google
> >to search for results only on site http://archives.postgresql.org?
> >What I'm more curious about is whether there is a problem with the
> >ASPseek stuff, or is there a problem with archives itself that the
> >search engines aren't picking up those pages you mention are missing,
> >altho they do show up when one does a physical check of them ...
>
> site:archives.postgresql.org infinity
>
> In the google search box.

If Google (as opposed to Google Groups) doesn't find a recent page
then it's hard to know whether Google had trouble indexing that
page or if they haven't attempted to index it yet. Does anybody
know how fast Google usually finds new messages in the archives?
The most recent message I found from myself on Google was from
11 Feb, so if they're usually faster then maybe that can narrow
down when the problem started. Do the web server logs show anything
interesting?

archives.postgresql.org appears to stop on 17 Feb; searching for
common words like "select" and names of frequent posters doesn't
find anything newer than that. Maybe that's an additional clue
about when something went awry.

--
Michael Fuhr

> archives.postgresql.org appears to stop on 17 Feb; searching for
> common words like "select" and names of frequent posters doesn't
> find anything newer than that. Maybe that's an additional clue
> about when something went awry.
>
>
rsync: send_files failed to open "/sfpug/2002-10/.mhonarc.db" (in
pgsql-archives): Permission denied (13)
rsync: send_files failed to open "/sfpug/2002-11/.mhonarc.db" (in
pgsql-archives): Permission denied (13)
rsync: send_files failed to open "/sfpug/2002-12/.mhonarc.db" (in
pgsql-archives): Permission denied (13)
rsync: send_files failed to open "/sfpug/2003-01/.mhonarc.db" (in
pgsql-archives): Permission denied (13)
rsync: send_files failed to open "/sfpug/2003-02/.mhonarc.db" (in
pgsql-archives): Permission denied (13)
rsync: send_files failed to open "/sfpug/2003-03/.mhonarc.db" (in
pgsql-archives): Permission denied (13)
rsync: send_files failed to open "/sfpug/2003-04/.mhonarc.db" (in
pgsql-archives): Permission denied (13)

I am getting permission errors when pulling the archives.

Joshua D. Drake

--
The PostgreSQL Company - Command Prompt, Inc. 1.503.667.4564
PostgreSQL Replication, Consulting, Custom Development, 24x7 support
Managed Services, Shared and Dedicated Hosting
Co-Authors: PLphp, PLperl - http://www.commandprompt.com/

those are standard errors and shouldn't be affecting your pulling the
archives ... those files aren't *part* of the archives, only
administrative stuff for mhonarc itself ...

On Thu, 23 Feb 2006, Joshua D. Drake wrote:

>
>> archives.postgresql.org appears to stop on 17 Feb; searching for
>> common words like "select" and names of frequent posters doesn't
>> find anything newer than that. Maybe that's an additional clue
>> about when something went awry.
>>
>>
> rsync: send_files failed to open "/sfpug/2002-10/.mhonarc.db" (in
> pgsql-archives): Permission denied (13)
> rsync: send_files failed to open "/sfpug/2002-11/.mhonarc.db" (in
> pgsql-archives): Permission denied (13)
> rsync: send_files failed to open "/sfpug/2002-12/.mhonarc.db" (in
> pgsql-archives): Permission denied (13)
> rsync: send_files failed to open "/sfpug/2003-01/.mhonarc.db" (in
> pgsql-archives): Permission denied (13)
> rsync: send_files failed to open "/sfpug/2003-02/.mhonarc.db" (in
> pgsql-archives): Permission denied (13)
> rsync: send_files failed to open "/sfpug/2003-03/.mhonarc.db" (in
> pgsql-archives): Permission denied (13)
> rsync: send_files failed to open "/sfpug/2003-04/.mhonarc.db" (in
> pgsql-archives): Permission denied (13)
>
> I am getting permission errors when pulling the archives.
>
> Joshua D. Drake
>
>
>
> --
> The PostgreSQL Company - Command Prompt, Inc. 1.503.667.4564
> PostgreSQL Replication, Consulting, Custom Development, 24x7 support
> Managed Services, Shared and Dedicated Hosting
> Co-Authors: PLphp, PLperl - http://www.commandprompt.com/
>
>

----
Marc G. Fournier Hub.Org Networking Services (http://www.hub.org)
Email: scrappy(at)hub(dot)org Yahoo!: yscrappy ICQ: 7615664

On Thu, 23 Feb 2006, Marc G. Fournier wrote:

> On Thu, 23 Feb 2006, Michael Fuhr wrote:
>
>> On Thu, Feb 23, 2006 at 08:20:29PM -0400, Marc G. Fournier wrote:
>>> Just curious, but if you search google, is it picking all the threads
>>> properly? is it just search.postgresql.org that is losing the archives,
>>> or all search engines?
>>
>> Google Groups seems to work; so does the site Oleg mentioned. From
>> what I've seen only search.postgresql.org has a problem.
>
> Right, but nether Google Groups, nor Oleg's site, search
> http://archives.postgresql.org ... isn't there a way of telling Google to

Marc, you miss menu to restrict search
http://pgsql.ru/db/pgsearch/, but this is static index

Also, http://pgsql.ru/db/mw/ - is an online ! index of all messages our
robot subscribed.

> search for results only on site http://archives.postgresql.org? What I'm
> more curious about is whether there is a problem with the ASPseek stuff, or
> is there a problem with archives itself that the search engines aren't
> picking up those pages you mention are missing, altho they do show up when
> one does a physical check of them ...

If people search recent messages, they could just not yet indexed ?

>
> ----
> Marc G. Fournier Hub.Org Networking Services (http://www.hub.org)
> Email: scrappy(at)hub(dot)org Yahoo!: yscrappy ICQ: 7615664
>

Regards,
Oleg
_____________________________________________________________
Oleg Bartunov, Research Scientist, Head of AstroNet (www.astronet.ru),
Sternberg Astronomical Institute, Moscow University, Russia
Internet: oleg(at)sai(dot)msu(dot)su, http://www.sai.msu.su/~megera/
phone: +007(495)939-16-83, +007(495)939-23-83