Re: BUG #12071: Stat collector went crasy (50MB/s constant writes)

From: Maxim Boguk <maxim(dot)boguk(at)gmail(dot)com>
To: Tomas Vondra <tv(at)fuzzy(dot)cz>
Cc: pgsql-bugs <pgsql-bugs(at)postgresql(dot)org>
Subject: Re: BUG #12071: Stat collector went crasy (50MB/s constant writes)
Date: 2014-11-26 21:19:32
Message-ID: CAK-MWwTFTRVuBjLz_rJVNEompGj2btot88G5uwXW+d2DierSNQ@mail.gmail.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-bugs pgsql-hackers

>
> How many backends are there, requesting a fresh stats file? I thought
> you mentioned the system is rather idle?
>

0-1 backend
no active connections
no active autovacuums

>
> A regular backend won't request a fresh copy unless the current file is
> older than 640 ms. So that can't cause ~50MB of writes (it'd require 10
> writes per second). Maybe there are multiple backends sending such
> requests, but I don't see how that could cause a continuous write load
> (I'd understand a short spike at the beginning, and then getting
> synchronized).
>

It's definitely doing full file writes 6-12 times per second.

> Autovacuum launcher / workers might cause that, because it's using 10 ms
> threshold. But that'd require a lot of autovacuum processes running in
> parallel, I guess.
>

No active autovacuum processes visible.
Now just interesting calculation:
autovacuum_naptime = 1 second (customized value from production)
active databases - 9...
Suspiciously close to 1/10 second.
Testing: increase autovacuum_naptime to
10second - two writes per second.
100second - only two writes every 10 second.

So yes, pgstat_send_inquiry definitely issued by autovacuum launcher.
Now question why EVERY pgstat_send_inquiry request from autovacuum leads to
the 1-2 full pgstat.stat rewrite on idle server?

--
Maxim Boguk
Senior Postgresql DBA
http://www.postgresql-consulting.ru/ <http://www.postgresql-consulting.com/>

In response to

Responses

Browse pgsql-bugs by date

  From Date Subject
Next Message Maxim Boguk 2014-11-26 21:36:23 Re: BUG #12071: Stat collector went crasy (50MB/s constant writes)
Previous Message Tomas Vondra 2014-11-26 20:45:12 Re: BUG #12071: Stat collector went crasy (50MB/s constant writes)

Browse pgsql-hackers by date

  From Date Subject
Next Message Andrew Dunstan 2014-11-26 21:34:50 Re: bug in json_to_record with arrays
Previous Message Andres Freund 2014-11-26 21:03:28 Re: 9.2 recovery/startup problems