Re: Compression of full-page-writes

From: Fujii Masao <masao(dot)fujii(at)gmail(dot)com>
To: Bruce Momjian <bruce(at)momjian(dot)us>
Cc: Claudio Freire <klaussfreire(at)gmail(dot)com>, Andres Freund <andres(at)2ndquadrant(dot)com>, "ktm(at)rice(dot)edu" <ktm(at)rice(dot)edu>, Michael Paquier <michael(dot)paquier(at)gmail(dot)com>, Jeff Davis <pgsql(at)j-davis(dot)com>, Heikki Linnakangas <hlinnakangas(at)vmware(dot)com>, PostgreSQL-development <pgsql-hackers(at)postgresql(dot)org>
Subject: Re: Compression of full-page-writes
Date: 2015-01-05 09:12:39
Message-ID: CAHGQGwGuiW34rYGQWe=GwDUgEO_kUSHNdcin+r+=OeKKLvqp1g@mail.gmail.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-hackers

On Sat, Jan 3, 2015 at 2:24 AM, Bruce Momjian <bruce(at)momjian(dot)us> wrote:
> On Fri, Jan 2, 2015 at 02:18:12PM -0300, Claudio Freire wrote:
>> On Fri, Jan 2, 2015 at 2:11 PM, Andres Freund <andres(at)2ndquadrant(dot)com> wrote:
>> >> , I now see the compression patch as something that has negatives, so
>> >> has to be set by the user, and only wins in certain cases. I am
>> >> disappointed, and am trying to figure out how this became such a
>> >> marginal win for 9.5. :-(
>> >
>> > I find the notion that a multi digit space reduction is a "marginal win"
>> > pretty ridiculous and way too narrow focused. Our WAL volume is a
>> > *significant* problem in the field. And it mostly consists out of FPWs
>> > spacewise.
>>
>> One thing I'd like to point out, is that in cases where WAL I/O is an
>> issue (ie: WAL archiving), usually people already compress the
>> segments during archiving. I know I do, and I know it's recommended on
>> the web, and by some consultants.
>>
>> So, I wouldn't want this FPW compression, which is desirable in
>> replication scenarios if you can spare the CPU cycles (because of
>> streaming), adversely affecting WAL compression during archiving.
>
> To be specific, desirable in streaming replication scenarios that don't
> use SSL compression. (What percentage is that?) It is something we
> should mention in the docs for this feature?

Even if SSL is used in replication, FPW compression is useful. It can reduce
the amount of I/O in the standby side. Sometimes I've seen walreceiver's I/O had
become a performance bottleneck especially in synchronous replication cases.
FPW compression can be useful for those cases, for example.

Regards,

--
Fujii Masao

In response to

Responses

Browse pgsql-hackers by date

  From Date Subject
Next Message Fabien COELHO 2015-01-05 09:13:00 Re: add modulo (%) operator to pgbench
Previous Message Fujii Masao 2015-01-05 09:07:23 Re: Compression of full-page-writes