Re: [PERFORM] Tunning postgresql on linux (fedora core 3)

Lists: pgsql-performancepgsql-sql
From: Din Adrian <adrian(dot)din(at)easynet(dot)ro>
To: pgsql-performance(at)postgresql(dot)org
Subject: Tunning postgresql on linux (fedora core 3)
Date: 2005-02-03 09:55:04
Message-ID: opsll8h2shawcxfg@adi
Views: Raw Message | Whole Thread | Download mbox | Resend email
Lists: pgsql-performance pgsql-sql

Hello,
I have a little time and I decided to improve the performance of my
server(s). I have found on google many 'tips' in tuning linux kernel and
postgresql database ... but I can't decide wich 'how-to' is better ... :(
So the question is: where to find a 'easy' and complete documentation
about this tweaks ... ?

thank you,
Adrian Din

--
Using Opera's revolutionary e-mail client: http://www.opera.com/m2/


From: Richard Huxton <dev(at)archonet(dot)com>
To: Din Adrian <adrian(dot)din(at)easynet(dot)ro>
Cc: pgsql-performance(at)postgresql(dot)org
Subject: Re: Tunning postgresql on linux (fedora core 3)
Date: 2005-02-03 10:54:08
Message-ID: 420202D0.7070602@archonet.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Lists: pgsql-performance pgsql-sql

Din Adrian wrote:
> Hello,
> I have a little time and I decided to improve the performance of my
> server(s). I have found on google many 'tips' in tuning linux kernel
> and postgresql database ... but I can't decide wich 'how-to' is better
> ... :(
> So the question is: where to find a 'easy' and complete documentation
> about this tweaks ... ?

Try the "performance tuning" article linked from this page:
http://www.varlena.com/varlena/GeneralBits/Tidbits/index.php

--
Richard Huxton
Archonet Ltd


From: Richard Huxton <dev(at)archonet(dot)com>
To: Din Adrian <adrian(dot)din(at)easynet(dot)ro>
Cc: 'Postgresql Performance' <pgsql-performance(at)postgresql(dot)org>
Subject: Re: Tunning postgresql on linux (fedora core 3)
Date: 2005-02-03 13:56:50
Message-ID: 42022DA2.3040000@archonet.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Lists: pgsql-performance pgsql-sql

Please CC the mailing list as well as replying to me, so that others can
help too.

Din Adrian wrote:
> yes I have read this as well ...
>
> One question about this option:
> fsync = true / false
> a) I have Raid and UPS - it is safe to turn this off ... (' But be
> very aware that any unexpected database shutdown will force you to
> restore the database from your last backup.' - from my last backup if
> the server goes down ??? why ? just at 'any unexpected database
> shutdown' ? ....!!!!!!!!!!!)

Because fsync=true flushes transaction details to disk (the Write Ahead
Log). That way if (say) the power-supply in your server fails you can
check the WAL and compare it to the main database files to make sure
everything is in a known state.

> b) in docs say that after 7.2 seting this to false does'n turn off the
> wall ...!? wich option does?

The docs don't say that, as far as I can see. It doesn't make sense to
turn off the WAL.
--
Richard Huxton
Archonet Ltd


From: Richard Huxton <dev(at)archonet(dot)com>
To: Din Adrian <adrian(dot)din(at)easynet(dot)ro>
Cc: 'Postgresql Performance' <pgsql-performance(at)postgresql(dot)org>
Subject: Re: Tunning postgresql on linux (fedora core 3)
Date: 2005-02-03 14:52:04
Message-ID: 42023A94.5040904@archonet.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Lists: pgsql-performance pgsql-sql

I'll repeat myself:

Please CC the mailing list as well as replying to me, so that others
can help too.

Din Adrian wrote:
>
> On Thu, 03 Feb 2005 13:56:50 +0000, Richard Huxton <dev(at)archonet(dot)com>
> wrote:
>
>> Please CC the mailing list as well as replying to me, so that others
>> can help too.
>>
>>
>>> b) in docs say that after 7.2 seting this to false does'n turn off
>>> the wall ...!? wich option does?
>>
>>
>> The docs don't say that, as far as I can see. It doesn't make sense
>> to turn off the WAL.
>
>
> hmm this is the doc about ...
>
> ' NOTE: Since 7.2, turning fsync off does NOT stop WAL. It does stop
> checkpointing, however. This is a change in the notes that follow Turn
> WAL off (fsync=false) only for a read-only database or one where the
> database can be regenerated from external software. While RAID plus
> UPSes can do a lot to protect your data, turning off fsync means that
> you will be restoring from backup in the event of hardware or power
> failure.'

I don't know what this is, and you don't give a URL, but it DOES NOT
appear to be in the manuals.

You should probably read the sections of the manuals regarding "run-time
configuration" and "write ahead logs". The manuals are quite extensive,
are available online at http://www.postgresql.org/ and also in most
distributions.

This is probably a good place to start.
http://www.postgresql.org/docs/8.0/interactive/runtime-config.html#RUNTIME-CONFIG-WAL

> If you turn it off you should have more speed ... !!!???

Basically, as I said in my last email - fsync=true makes sure
transaction details are safely stored on disk. If you turn this off, the
database doesn't have to wait for the data to physically be written to
the disk. But, if power fails then data might be in OS or disk cache and
so lost when you restart the machine.

Please CC the mailing list if you reply to this message.
--
Richard Huxton
Archonet Ltd


From: Richard Huxton <dev(at)archonet(dot)com>
To: Din Adrian <adrian(dot)din(at)easynet(dot)ro>
Cc: pgsql-sql(at)postgresql(dot)org
Subject: Re: [PERFORM] Tunning postgresql on linux (fedora core 3)
Date: 2005-02-03 15:15:32
Message-ID: 42024014.2030901@archonet.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Lists: pgsql-performance pgsql-sql

Din Adrian wrote:
> sorry about cc ...
> this is the site:
> http://www.varlena.com/varlena/GeneralBits/Tidbits/annotated_conf_e.html
> but I gues is not right ... hmm

It's not that it's incorrect, just that you should always use the
manuals as a starting point.

> On Thu, 03 Feb 2005 14:52:04 +0000, Richard Huxton <dev(at)archonet(dot)com>
> wrote:
>
>> I'll repeat myself:
>>
>>
>>
>>
>> Please CC the mailing list as well as replying to me, so that others
>> can help too.
>>
>>
>>
>>
>> Din Adrian wrote:
>>
>>> On Thu, 03 Feb 2005 13:56:50 +0000, Richard Huxton
>>> <dev(at)archonet(dot)com> wrote:
>>>
>>>> Please CC the mailing list as well as replying to me, so that
>>>> others can help too.
>>>>
>>>>
>>>>> b) in docs say that after 7.2 seting this to false does'n turn
>>>>> off the wall ...!? wich option does?
>>>>
>>>>
>>>>
>>>> The docs don't say that, as far as I can see. It doesn't make sense
>>>> to turn off the WAL.
>>>
>>> hmm this is the doc about ...
>>> ' NOTE: Since 7.2, turning fsync off does NOT stop WAL. It does
>>> stop checkpointing, however. This is a change in the notes that
>>> follow Turn WAL off (fsync=false) only for a read-only database or
>>> one where the database can be regenerated from external software.
>>> While RAID plus UPSes can do a lot to protect your data, turning
>>> off fsync means that you will be restoring from backup in the event
>>> of hardware or power failure.'
>>
>>
>> I don't know what this is, and you don't give a URL, but it DOES NOT
>> appear to be in the manuals.
>>
>> You should probably read the sections of the manuals regarding
>> "run-time configuration" and "write ahead logs". The manuals are
>> quite extensive, are available online at http://www.postgresql.org/
>> and also in most distributions.
>>
>> This is probably a good place to start.
>> http://www.postgresql.org/docs/8.0/interactive/runtime-config.html#RUNTIME-CONFIG-WAL
>>
>>
>>> If you turn it off you should have more speed ... !!!???
>>
>>
>> Basically, as I said in my last email - fsync=true makes sure
>> transaction details are safely stored on disk. If you turn this off,
>> the database doesn't have to wait for the data to physically be
>> written to the disk. But, if power fails then data might be in OS or
>> disk cache and so lost when you restart the machine.
>>
>> Please CC the mailing list if you reply to this message.
>> --
>> Richard Huxton
>> Archonet Ltd
>>
>
>
>

--
Richard Huxton
Archonet Ltd


From: Din Adrian <adrian(dot)din(at)easynet(dot)ro>
To: "Richard Huxton" <dev(at)archonet(dot)com>
Cc: pgsql-sql(at)postgresql(dot)org
Subject: Re: [PERFORM] Tunning postgresql on linux (fedora core 3)
Date: 2005-02-03 16:59:40
Message-ID: opslmr5qxxawcxfg@adi
Views: Raw Message | Whole Thread | Download mbox | Resend email
Lists: pgsql-performance pgsql-sql

sorry about cc ...
this is the site:
http://www.varlena.com/varlena/GeneralBits/Tidbits/annotated_conf_e.html
but I gues is not right ... hmm

Adrian Din

On Thu, 03 Feb 2005 14:52:04 +0000, Richard Huxton <dev(at)archonet(dot)com>
wrote:

> I'll repeat myself:
>
>
>
>
> Please CC the mailing list as well as replying to me, so that others
> can help too.
>
>
>
>
> Din Adrian wrote:
>> On Thu, 03 Feb 2005 13:56:50 +0000, Richard Huxton <dev(at)archonet(dot)com>
>> wrote:
>>
>>> Please CC the mailing list as well as replying to me, so that others
>>> can help too.
>>>
>>>
>>>> b) in docs say that after 7.2 seting this to false does'n turn off
>>>> the wall ...!? wich option does?
>>>
>>>
>>> The docs don't say that, as far as I can see. It doesn't make sense
>>> to turn off the WAL.
>> hmm this is the doc about ...
>> ' NOTE: Since 7.2, turning fsync off does NOT stop WAL. It does stop
>> checkpointing, however. This is a change in the notes that follow Turn
>> WAL off (fsync=false) only for a read-only database or one where the
>> database can be regenerated from external software. While RAID plus
>> UPSes can do a lot to protect your data, turning off fsync means that
>> you will be restoring from backup in the event of hardware or power
>> failure.'
>
> I don't know what this is, and you don't give a URL, but it DOES NOT
> appear to be in the manuals.
>
> You should probably read the sections of the manuals regarding "run-time
> configuration" and "write ahead logs". The manuals are quite extensive,
> are available online at http://www.postgresql.org/ and also in most
> distributions.
>
> This is probably a good place to start.
> http://www.postgresql.org/docs/8.0/interactive/runtime-config.html#RUNTIME-CONFIG-WAL
>
>> If you turn it off you should have more speed ... !!!???
>
> Basically, as I said in my last email - fsync=true makes sure
> transaction details are safely stored on disk. If you turn this off, the
> database doesn't have to wait for the data to physically be written to
> the disk. But, if power fails then data might be in OS or disk cache and
> so lost when you restart the machine.
>
> Please CC the mailing list if you reply to this message.
> --
> Richard Huxton
> Archonet Ltd
>

--
Using Opera's revolutionary e-mail client: http://www.opera.com/m2/