pgsql: Reduce the memory requirement for large ispell dictionaries.

From: Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>
To: pgsql-committers(at)postgresql(dot)org
Subject: pgsql: Reduce the memory requirement for large ispell dictionaries.
Date: 2010-10-06 23:32:21
Message-ID: E1P3dTB-0001kQ-6w@gemulon.postgresql.org
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-committers

Reduce the memory requirement for large ispell dictionaries.

This patch eliminates per-chunk palloc overhead for most small allocations
needed in the representation of an ispell dictionary. This saves close to
a factor of 2 on the current Czech ispell data. While it doesn't cover
every last small allocation in the ispell code, we are at the point of
diminishing returns, because about 95% of the allocations are covered
already.

Pavel Stehule, rather heavily revised by Tom

Branch
------
master

Details
-------
http://git.postgresql.org/gitweb?p=postgresql.git;a=commitdiff;h=3e5f9412d0a818be77c974e5af710928097b91f3

Modified Files
--------------
src/backend/tsearch/spell.c | 82 +++++++++++++++++++++++++++++++-----
src/include/tsearch/dicts/spell.h | 4 ++
2 files changed, 74 insertions(+), 12 deletions(-)

Browse pgsql-committers by date

  From Date Subject
Next Message User Masao_fujii 2010-10-07 08:31:00 pgbulkload - pgbulkload: Fixed problem with interactive authentication
Previous Message Hiroshi Saito 2010-10-06 15:42:53 psqlodbc - psqlodbc: this was applied for release preparation.