Re: Massive I/O spikes during checkpoint

From: Andres Freund <andres(at)2ndquadrant(dot)com>
To: Jeff Janes <jeff(dot)janes(at)gmail(dot)com>
Cc: pgsql-performance(at)postgresql(dot)org, Maxim Boguk <maxim(dot)boguk(at)gmail(dot)com>, David Kerr <dmk(at)mr-paradox(dot)net>
Subject: Re: Massive I/O spikes during checkpoint
Date: 2012-07-10 13:41:18
Message-ID: 201207101541.18492.andres@2ndquadrant.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-performance

On Tuesday, July 10, 2012 03:36:35 PM Jeff Janes wrote:
> On Tue, Jul 10, 2012 at 5:44 AM, Andres Freund <andres(at)2ndquadrant(dot)com>
wrote:
> > On Tuesday, July 10, 2012 08:14:00 AM Maxim Boguk wrote:
> >> So kernel doesn't start write any pages out in background before it has
> >> at least 13Gb dirty pages in kernel memory.
> >> And at end of the checkpoint kernel trying flush all dirty pages to
> >> disk.
> >
> > Thast not entirely true. The kernel will also writeout pages which
> > haven't been written to for dirty_expire_centisecs.
>
> There seems to be many situations in which it totally fails to do that.
Totally as in diry pages sitting around without any io activity? Or just not
agressive enough?

Currently its a bit hard to speculate about all without specifying the kernel
because there have been massive rewrites of all that stuff in several kernels
in the last two years...

Andres
--
Andres Freund http://www.2ndQuadrant.com/
PostgreSQL Development, 24x7 Support, Training & Services

In response to

Browse pgsql-performance by date

  From Date Subject
Next Message Merlin Moncure 2012-07-10 19:05:55 Re: The need for clustered indexes to boost TPC-V performance
Previous Message Jeff Janes 2012-07-10 13:36:35 Re: Massive I/O spikes during checkpoint