lowering priority automatically at connection

Lists: pgsql-performance
From: Chris Mair <list(at)1006(dot)org>
To: pgsql-performance(at)postgresql(dot)org
Subject: lowering priority automatically at connection
Date: 2006-05-25 16:16:24
Message-ID: 1148573784.6017.26.camel@dell.home.lan
Views: Raw Message | Whole Thread | Download mbox | Resend email
Lists: pgsql-performance

Hi,

I find this very helpful:

Lowering the priority of a PostgreSQL query
http://weblog.bignerdranch.com/?p=11

Now I was wondering whether one could have a
SELECT pg_setpriority(10);
executed automatically each time a certain user
connects (not necessarily using psql)?

Any ideas if and how this might be possible?

Regards :)
Chris.


From: Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
To: Chris Mair <list(at)1006(dot)org>
Cc: pgsql-performance(at)postgresql(dot)org
Subject: Re: lowering priority automatically at connection
Date: 2006-05-25 16:26:43
Message-ID: 13758.1148574403@sss.pgh.pa.us
Views: Raw Message | Whole Thread | Download mbox | Resend email
Lists: pgsql-performance

Chris Mair <list(at)1006(dot)org> writes:
> I find this very helpful:
> Lowering the priority of a PostgreSQL query
> http://weblog.bignerdranch.com/?p=11

That guy doesn't actually have the foggiest idea what he's doing.
The reason there is no built-in capability to do that is that it *does
not work well*. Search the list archives for "priority inversion" to
find out why not.

regards, tom lane


From: Chris Mair <list(at)1006(dot)org>
To: pgsql-performance(at)postgresql(dot)org
Subject: Re: lowering priority automatically at connection
Date: 2006-05-25 16:35:28
Message-ID: 1148574928.6017.36.camel@dell.home.lan
Views: Raw Message | Whole Thread | Download mbox | Resend email
Lists: pgsql-performance


> > I find this very helpful:
> > Lowering the priority of a PostgreSQL query
> > http://weblog.bignerdranch.com/?p=11
>
> That guy doesn't actually have the foggiest idea what he's doing.
> The reason there is no built-in capability to do that is that it *does
> not work well*. Search the list archives for "priority inversion" to
> find out why not.
>
> regards, tom lane

Ok,
I've learned something new (*).
I'll drop that idea :)

Bye,
Chris.

(*)
http://en.wikipedia.org/wiki/Priority_inversion


From: Michael Fuhr <mike(at)fuhr(dot)org>
To: Chris Mair <list(at)1006(dot)org>
Cc: pgsql-performance(at)postgresql(dot)org
Subject: Re: lowering priority automatically at connection
Date: 2006-05-25 16:54:56
Message-ID: 20060525165456.GA70276@winnie.fuhr.org
Views: Raw Message | Whole Thread | Download mbox | Resend email
Lists: pgsql-performance

On Thu, May 25, 2006 at 06:16:24PM +0200, Chris Mair wrote:
> I find this very helpful:
>
> Lowering the priority of a PostgreSQL query
> http://weblog.bignerdranch.com/?p=11
>
> Now I was wondering whether one could have a
> SELECT pg_setpriority(10);
> executed automatically each time a certain user
> connects (not necessarily using psql)?

Beware that setting priorities can have unintended, adverse effects.
Use a search engine to find information about "priority inversion"
before deciding that query priorities are a good idea.

--
Michael Fuhr


From: Christopher Kings-Lynne <chris(dot)kings-lynne(at)calorieking(dot)com>
To: Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
Cc: Chris Mair <list(at)1006(dot)org>, pgsql-performance(at)postgresql(dot)org
Subject: Re: lowering priority automatically at connection
Date: 2006-05-26 01:32:56
Message-ID: 44765AC8.5060003@calorieking.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Lists: pgsql-performance

> That guy doesn't actually have the foggiest idea what he's doing.
> The reason there is no built-in capability to do that is that it *does
> not work well*. Search the list archives for "priority inversion" to
> find out why not.

http://en.wikipedia.org/wiki/Priority_inversion


From: Ron Mayer <rm_pg(at)cheapcomplexdevices(dot)com>
To: Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
Subject: Re: lowering priority automatically at connection
Date: 2006-06-06 23:27:16
Message-ID: 44860F54.7080401@cheapcomplexdevices.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Lists: pgsql-performance

Tom Lane wrote:
> That guy doesn't actually have the foggiest idea what he's doing.
> The reason there is no built-in capability to do that is that it *does
> not work well*. Search the list archives for "priority inversion" to
> find out why not.

I agree that that particular author seems clueless, but better
researched papers do show benefits as well:

The CMU paper
"Priority Mechanisms for OLTP and Transactional Web Applications" [1]
studied both TPC-C and TPC-W workloads on postgresql (as well as DB2).
For PostgreSQL they found that without priority inheritance they
had factor-of-2 benefits for high-priority transactions;
and with priority inheritance they had factor-of-6 benefits
for high priority transactions -- both with negligible harm
to the low priority transactions.

Unless there's something wrong with that paper (and at first glance
it looks like their methodologies apply at least to many workloads)
it seems that "it *does not work well*" is a bit of a generalization;
and that databases with TPC-C and TPC-W like workloads may indeed
be cases where this feature would be useful.

[1] http://www.cs.cmu.edu/~harchol/Papers/actual-icde-submission.pdf
"
...This paper analyzes and proposes prioritization for
transactional workloads in conventional DBMS...This paper
provides a detailed resource utilization breakdown for
OLTP workloads executing on a range of database platforms
including IBM DB2[14], Shore[16], and PostgreSQL[17]....
...
For DBMS using MVCC (with TPC-C or TPC-W workloads) and
for TPC-W workloads (with any concurrency control mechanism),
we find that lock scheduling is largely ineffective (even
preemptive lock scheduling) and CPU scheduling is highly
effective. For example, we find that for PostgreSQL
running under TPC-C, the simplest CPU scheduling
algorithm CPU-Prio provides a factor of 2 improvement
for the high-priority transactions, and adding priority
inheritance (CPU-Prio-Inherit) brings this up to a factor
of near 6 improvement under high loads, while hardly
penalizing low-priority transactions.
"

Or am I missing something?
Ron


From: Markus Schaber <schabi(at)logix-tt(dot)com>
To: Chris Mair <list(at)1006(dot)org>
Cc: pgsql-performance(at)postgresql(dot)org
Subject: Re: lowering priority automatically at connection
Date: 2006-06-20 15:12:16
Message-ID: 44981050.4050109@logix-tt.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Lists: pgsql-performance

Hi, Chris,

Chris Mair wrote:

> Now I was wondering whether one could have a
> SELECT pg_setpriority(10);
> executed automatically each time a certain user
> connects (not necessarily using psql)?
>
> Any ideas if and how this might be possible?

When using Java, most Datasource implementations (e. G. the JBoss one)
allow to specify SQL statements that are executed on connection init.

Markus

--
Markus Schaber | Logical Tracking&Tracing International AG
Dipl. Inf. | Software Development GIS

Fight against software patents in EU! www.ffii.org www.nosoftwarepatents.org