Re: is a special cost for external sort?

From: Jeff Janes <jeff(dot)janes(at)gmail(dot)com>
To: Pavel Stehule <pavel(dot)stehule(at)gmail(dot)com>
Cc: PostgreSQL Hackers <pgsql-hackers(at)postgresql(dot)org>
Subject: Re: is a special cost for external sort?
Date: 2013-07-18 22:30:20
Message-ID: CAMkU=1y4+ei780uVBWAnVNad_xAmi5viZBudVax6kzBk4-RVmQ@mail.gmail.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-hackers

On Thu, Jul 18, 2013 at 9:14 AM, Pavel Stehule <pavel(dot)stehule(at)gmail(dot)com> wrote:
> Hello
>
> I found a slow query with large external sort. I expect, so external
> sort should be penalized. Is it?

It tries to, but it doesn't seem to be much good at it. In
particular, I think it does a poor job of estimating the CPU cost of
an external sort relative to an in-memory sort of a slightly smaller
data set. In my experience adding the single tuple that actually
pushes you over the work_mem limit costs about 3x in CPU.

It is one of those things I started looking into a few times, but
never got anywhere before getting distracted.

Cheers,

Jeff

In response to

Browse pgsql-hackers by date

  From Date Subject
Next Message Michael Paquier 2013-07-18 22:31:07 Re: Fatal error after starting postgres : sys identifiers must be different
Previous Message Alvaro Herrera 2013-07-18 22:15:07 Re: [9.4 CF 1] Patches which desperately need code review