Re: Critical performance problems on large databases

From: Gunther Schadow <gunther(at)aurora(dot)regenstrief(dot)org>
To: Oleg Bartunov <oleg(at)sai(dot)msu(dot)su>
Cc: pgsql-general(at)postgresql(dot)org
Subject: Re: Critical performance problems on large databases
Date: 2002-04-11 20:05:33
Message-ID: 3CB5EC8D.2060803@aurora.regenstrief.org
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-general

Oleg Bartunov wrote:

> On Thu, 11 Apr 2002, Bruce Momjian wrote:
>
>
>>Oleg Bartunov wrote:
>>
>>>The big issue with LIMIT,OFFSET is that it still use all rows
>>>for sorting. I already suggested to use partial sorting to avoid
>>>sorting all rows if one selected only first 20 row, for example.
>>>It's very important for Web applications because web users usually
>>>read first 1-2 pages. Our experimnets have shown 6 times performance
>>>win when using partial sorting.
>>>
>>We do have this TODO item:
>>
>> * Allow ORDER BY ... LIMIT to select top values without sort or index
>> using a sequential scan for highest/lowest values
>>
>>
>
> looks too complex to me :-) I like partial sorting, but it's not
> important.

Oleg, I might argee. I might even take some of this one. But I
think a first step would be for you to put your libpsort and
the pacth "out there" so that someone could just look and try
and see if taking the time to do what needs to be done is feasible
with this. If you can put up your lib and patch and documentation
(even crude notes)) onto a web site, that would be a good start.

regards
-Gunther

--
Gunther Schadow, M.D., Ph.D. gschadow(at)regenstrief(dot)org
Medical Information Scientist Regenstrief Institute for Health Care
Adjunct Assistant Professor Indiana University School of Medicine
tel:1(317)630-7960 http://aurora.regenstrief.org

In response to

Responses

Browse pgsql-general by date

  From Date Subject
Next Message Andrew Gould 2002-04-11 20:26:27 Re: where to find info about data types?
Previous Message Johann Zuschlag 2002-04-11 19:24:08 Re: Why does this not work? (finally)