Disk Fills Up and fsck "Compresses" it

Lists: pgsql-performance
From: "Y Sidhu" <ysidhu(at)gmail(dot)com>
To: pgsql-performance(at)postgresql(dot)org
Subject: Disk Fills Up and fsck "Compresses" it
Date: 2007-05-15 20:18:42
Message-ID: b09064f30705151318v2c770d76h89e32c9303777070@mail.gmail.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Lists: pgsql-performance

Anyone seen PG filling up a 66 GB partition from say 40-ish percentage to
60-ish percentage in a manner of minutes. When I run a 'fsck' the disk usage
comes down to 40-ish percentage. That's about 10+ GB's variance.

This is a FreeBSD 6.2 RC2, 4GB memory, Xeon 3.2 GHz '4' of the '8' CPUs in
use - dual cpu, dual core with HTT turned off in the sense that the other 4
cpu's have been masked out. The drive is a Western Digital 70 GB SATA.

--
Yudhvir Singh Sidhu
408 375 3134 cell


From: "Jim C(dot) Nasby" <decibel(at)decibel(dot)org>
To: Y Sidhu <ysidhu(at)gmail(dot)com>
Cc: pgsql-performance(at)postgresql(dot)org
Subject: Re: Disk Fills Up and fsck "Compresses" it
Date: 2007-05-15 23:41:53
Message-ID: 20070515234152.GD20707@nasby.net
Views: Raw Message | Whole Thread | Download mbox | Resend email
Lists: pgsql-performance

I'm guessing you're seeing the affect of softupdates. With those enabled
it can take some time before the space freed by a delete will actually
show up as available.

On Tue, May 15, 2007 at 01:18:42PM -0700, Y Sidhu wrote:
> Anyone seen PG filling up a 66 GB partition from say 40-ish percentage to
> 60-ish percentage in a manner of minutes. When I run a 'fsck' the disk usage
> comes down to 40-ish percentage. That's about 10+ GB's variance.
>
> This is a FreeBSD 6.2 RC2, 4GB memory, Xeon 3.2 GHz '4' of the '8' CPUs in
> use - dual cpu, dual core with HTT turned off in the sense that the other 4
> cpu's have been masked out. The drive is a Western Digital 70 GB SATA.
>
> --
> Yudhvir Singh Sidhu
> 408 375 3134 cell

--
Jim Nasby decibel(at)decibel(dot)org
EnterpriseDB http://enterprisedb.com 512.569.9461 (cell)


From: "Y Sidhu" <ysidhu(at)gmail(dot)com>
To: "Jim C(dot) Nasby" <decibel(at)decibel(dot)org>
Cc: pgsql-performance(at)postgresql(dot)org
Subject: Re: Disk Fills Up and fsck "Compresses" it
Date: 2007-05-16 15:21:23
Message-ID: b09064f30705160821k55a37476v65ba5ab054473cd2@mail.gmail.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Lists: pgsql-performance

What do you mean by "softupdates?" Is that a parameter in what I am guessing
is the conf file?

Yudhvir

On 5/15/07, Jim C. Nasby <decibel(at)decibel(dot)org> wrote:
>
> I'm guessing you're seeing the affect of softupdates. With those enabled
> it can take some time before the space freed by a delete will actually
> show up as available.
>
> On Tue, May 15, 2007 at 01:18:42PM -0700, Y Sidhu wrote:
> > Anyone seen PG filling up a 66 GB partition from say 40-ish percentage
> to
> > 60-ish percentage in a manner of minutes. When I run a 'fsck' the disk
> usage
> > comes down to 40-ish percentage. That's about 10+ GB's variance.
> >
> > This is a FreeBSD 6.2 RC2, 4GB memory, Xeon 3.2 GHz '4' of the '8' CPUs
> in
> > use - dual cpu, dual core with HTT turned off in the sense that the
> other 4
> > cpu's have been masked out. The drive is a Western Digital 70 GB SATA.
> >
> > --
> > Yudhvir Singh Sidhu
> > 408 375 3134 cell
>
> --
> Jim Nasby decibel(at)decibel(dot)org
> EnterpriseDB http://enterprisedb.com 512.569.9461 (cell)
>

--
Yudhvir Singh Sidhu
408 375 3134 cell


From: "Jim C(dot) Nasby" <decibel(at)decibel(dot)org>
To: Y Sidhu <ysidhu(at)gmail(dot)com>
Cc: pgsql-performance(at)postgresql(dot)org
Subject: Re: Disk Fills Up and fsck "Compresses" it
Date: 2007-05-16 15:51:45
Message-ID: 20070516155145.GM14548@nasby.net
Views: Raw Message | Whole Thread | Download mbox | Resend email
Lists: pgsql-performance

No, it's part of FreeBSD's UFS. google FreeBSD softupdates and you
should get plenty of info.

As I said, it's probably not worth worrying about.

On Wed, May 16, 2007 at 08:21:23AM -0700, Y Sidhu wrote:
> What do you mean by "softupdates?" Is that a parameter in what I am guessing
> is the conf file?
--
Jim Nasby decibel(at)decibel(dot)org
EnterpriseDB http://enterprisedb.com 512.569.9461 (cell)


From: Mark Kirkwood <markir(at)paradise(dot)net(dot)nz>
To: "Jim C(dot) Nasby" <decibel(at)decibel(dot)org>, Y Sidhu <ysidhu(at)gmail(dot)com>
Cc: pgsql-performance(at)postgresql(dot)org
Subject: Re: Disk Fills Up and fsck "Compresses" it
Date: 2007-05-16 23:28:30
Message-ID: 464B939E.8090402@paradise.net.nz
Views: Raw Message | Whole Thread | Download mbox | Resend email
Lists: pgsql-performance

Jim C. Nasby wrote:
> No, it's part of FreeBSD's UFS. google FreeBSD softupdates and you
> should get plenty of info.
>
> As I said, it's probably not worth worrying about.
>
> On Wed, May 16, 2007 at 08:21:23AM -0700, Y Sidhu wrote:
>> What do you mean by "softupdates?" Is that a parameter in what I am guessing
>> is the conf file?

Here is quite a good article on the interaction of fsck and softupdates
in FreeBSD:

http://www.usenix.org/publications/library/proceedings/bsdcon02/mckusick/mckusick_html/index.html

Having said that, it seems to talk about space lost by unreferenced
blocks and inodes is the context of panic or power outage, as opposed to
normal softupdate operation (unless I'm missing something...)

Cheers

Mark