Re: Do you know the reason for increased max latency due to xlog scaling?

From: "MauMau" <maumau307(at)gmail(dot)com>
To: "Jeff Janes" <jeff(dot)janes(at)gmail(dot)com>, "Heikki Linnakangas" <hlinnakangas(at)vmware(dot)com>
Cc: "Andres Freund" <andres(at)2ndquadrant(dot)com>, "pgsql-hackers" <pgsql-hackers(at)postgresql(dot)org>
Subject: Re: Do you know the reason for increased max latency due to xlog scaling?
Date: 2014-02-19 14:43:21
Message-ID: FAE78AEDDE2F45E0863E8ACAB3CF1AAD@maumau
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-hackers

From: "Jeff Janes" <jeff(dot)janes(at)gmail(dot)com>
> I thought that this was the point I was making, not the point I was
> missing. You have the same hard drives you had before, but now due to a
> software improvement you are cramming 5 times more stuff through them.
> Yeah, you will get bigger latency spikes. Why wouldn't you? You are now
> beating the snot out of your hard drives, whereas before you were not.
>
> If you need 10,000 TPS, then you need to upgrade to 9.4. If you need it
> with low maximum latency as well, then you probably need to get better IO
> hardware as well (maybe not--maybe more tuning could help). With 9.3 you
> didn't need better IO hardware, because you weren't capable of maxing out
> what you already had. With 9.4 you can max it out, and this is a good
> thing.
>
> If you need 10,000 TPS but only 2000 TPS are completing under 9.3, then
> what is happening to the other 8000 TPS? Whatever is happening to them, it
> must be worse than a latency spike.
>
> On the other hand, if you don't need 10,000 TPS, than measuring max
> latency
> at 10,000 TPS is the wrong thing to measure.

Thank you, I've probably got the point --- you mean the hard disk for WAL is
the bottleneck. But I still wonder a bit why the latency spike became so
bigger even with # of clients fewer than # of CPU cores. I suppose the
requests get processed more smoothly when the number of simultaneous
requests is small. Anyway, I want to believe the latency spike would become
significantly smaller on an SSD.

Regards
MauMau

In response to

Browse pgsql-hackers by date

  From Date Subject
Next Message Tom Lane 2014-02-19 14:52:56 Re: GiST support for inet datatypes
Previous Message Robert Haas 2014-02-19 14:33:53 Re: should we add a XLogRecPtr/LSN SQL type?