Re: tracking commit timestamps

From: Jim Nasby <Jim(dot)Nasby(at)BlueTreble(dot)com>
To: Alvaro Herrera <alvherre(at)2ndquadrant(dot)com>, Robert Haas <robertmhaas(at)gmail(dot)com>
Cc: Petr Jelinek <petr(at)2ndquadrant(dot)com>, Steve Singer <steve(at)ssinger(dot)info>, Andres Freund <andres(at)2ndquadrant(dot)com>, Michael Paquier <michael(dot)paquier(at)gmail(dot)com>, Anssi Kääriäinen <anssi(dot)kaariainen(at)thl(dot)fi>, Simon Riggs <simon(at)2ndquadrant(dot)com>, Heikki Linnakangas <hlinnakangas(at)vmware(dot)com>, Pg Hackers <pgsql-hackers(at)postgresql(dot)org>, Jaime Casanova <jaime(at)2ndquadrant(dot)com>
Subject: Re: tracking commit timestamps
Date: 2014-11-11 19:51:40
Message-ID: 546268CC.7010507@BlueTreble.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-hackers pgsql-www

On 11/10/14, 7:40 AM, Alvaro Herrera wrote:
> Robert Haas wrote:
>> On Sun, Nov 9, 2014 at 8:41 PM, Alvaro Herrera <alvherre(at)2ndquadrant(dot)com> wrote:
>>> Robert Haas wrote:
>>>> I think the key question here is the time for which the data needs to
>>>> be retained. 2^32 of anything is a lot, but why keep around that
>>>> number of records rather than more (after all, we have epochs to
>>>> distinguish one use of a given txid from another) or fewer?
>>>
>>> The problem is not how much data we retain; is about how much data we
>>> can address.
>>
>> I thought I was responding to a concern about disk space utilization.
>
> Ah, right. So AFAIK we don't need to keep anything older than
> RecentXmin or something like that -- which is not too old. If I recall
> correctly Josh Berkus was saying in a thread about pg_multixact that it
> used about 128kB or so in <= 9.2 for his customers; that one was also
> limited to RecentXmin AFAIR. I think a similar volume of commit_ts data
> would be pretty acceptable. Moreso considering that it's turned off by
> default.

FWIW, AFAICS MultiXacts are only truncated after a (auto)vacuum process is able to advance datminmxid, which will (now) only happen when an entire relation has been scanned (which should be infrequent).

I believe the low normal space usage is just an indication that most databases don't use many MultiXacts.
--
Jim Nasby, Data Architect, Blue Treble Consulting
Data in Trouble? Get it in Treble! http://BlueTreble.com

In response to

Responses

Browse pgsql-hackers by date

  From Date Subject
Next Message Alvaro Herrera 2014-11-11 20:03:44 Re: tracking commit timestamps
Previous Message Tom Lane 2014-11-11 19:31:39 Re: Column/type dependency recording inconsistencies

Browse pgsql-www by date

  From Date Subject
Next Message Alvaro Herrera 2014-11-11 20:03:44 Re: tracking commit timestamps
Previous Message Andres Freund 2014-11-11 17:13:13 Re: tracking commit timestamps