Re: COPY enhancements

From: Emmanuel Cecchet <manu(at)asterdata(dot)com>
To: Emmanuel Cecchet <manu(at)asterdata(dot)com>
Cc: PostgreSQL-development <pgsql-hackers(at)postgresql(dot)org>
Subject: Re: COPY enhancements
Date: 2009-09-18 04:14:18
Message-ID: 4AB3091A.5020506@asterdata.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-hackers

Here is a new version of error logging and autopartitioning in COPY
based on the latest COPY patch that provides the new syntax for copy
options (this patch also includes the COPY option patch).

New features compared to previous version:
- removed the GUC variables for error logging and use copy options
instead (renamed options as suggested by Josh)
- added documentation and examples (see copy.sgml)
- partitioning also activated by copy option rather than GUC variable
(renamed as well)
- added a new ERROR_LOGGING_MAX_ERRORS option that allows to abort the
COPY operation if a certain number of bad rows has been encountered.
- updated unit tests

I also tried to update the wiki pages but it's late and the doc is
probably better for now.

This addresses most of the comments so far except for the format of the
error table (lack of natural key) and a possible pg_error_table as a
default name.

Emmanuel

Emmanuel Cecchet wrote:
> Hi all,
>
> Finally the error logging and autopartitioning patches for COPY that I
> presented at PGCon are here!
> Error logging is described here:
> http://wiki.postgresql.org/wiki/Error_logging_in_COPY
> Autopartitioning is described here:
> http://wiki.postgresql.org/wiki/Auto-partitioning_in_COPY
>
> The attached patch contains both contribs as well as unit tests. I
> will submit shortly the new patch at commitfest.postgresql.org.
>
> Thanks in advance for your feedback,
> Emmanuel
>
> ------------------------------------------------------------------------
>
>
>

--
Emmanuel Cecchet
Aster Data Systems
Web: http://www.asterdata.com

Attachment Content-Type Size
aster-copy-newsyntax-patch-8.5v4context.txt.gz application/x-gzip 43.2 KB

In response to

Responses

Browse pgsql-hackers by date

  From Date Subject
Next Message Jeff Janes 2009-09-18 04:52:21 Re: Bulk Inserts
Previous Message Robert Fleming 2009-09-18 03:48:43 Re: LDAP where DN does not include UID attribute