Lists: | pgsql-admin |
---|
From: | "Fred Moyer" <fred(at)digicamp(dot)com> |
---|---|
To: | <pgsql-admin(at)postgresql(dot)org> |
Subject: | pg_dump max file size exceeded |
Date: | 2002-03-19 21:39:26 |
Message-ID: | ILEMKFGEMKDJNPOGGNCKOEDJCNAA.fred@digicamp.com |
Views: | Raw Message | Whole Thread | Download mbox | Resend email |
Lists: | pgsql-admin |
hey fellow pg'ers.
ran time pg_dump -c --verbose database > datafile.psql from the command line
and got a file size limit exceeded. datafile.psql stopped at 2 gigs. any
ideas how to exceed that limit?
redhat 7.2, 2.4.9-31 kernel
postgres 7.2
From: | "Nick Fankhauser" <nickf(at)ontko(dot)com> |
---|---|
To: | "Fred Moyer" <fred(at)digicamp(dot)com>, <pgsql-admin(at)postgresql(dot)org> |
Subject: | Re: pg_dump max file size exceeded |
Date: | 2002-03-19 22:46:46 |
Message-ID: | NEBBLAAHGLEEPCGOBHDGAEILEJAA.nickf@ontko.com |
Views: | Raw Message | Whole Thread | Download mbox | Resend email |
Lists: | pgsql-admin |
Pipe it into gzip:
pg_dump db_name|gzip>dbname.sql.gz
NickF
--------------------------------------------------------------------------
Nick Fankhauser nickf(at)ontko(dot)com Phone 1.765.935.4283 Fax 1.765.962.9788
Ray Ontko & Co. Software Consulting Services http://www.ontko.com/
> -----Original Message-----
> From: pgsql-admin-owner(at)postgresql(dot)org
> [mailto:pgsql-admin-owner(at)postgresql(dot)org]On Behalf Of Fred Moyer
> Sent: Tuesday, March 19, 2002 4:39 PM
> To: pgsql-admin(at)postgresql(dot)org
> Subject: [ADMIN] pg_dump max file size exceeded
>
>
> hey fellow pg'ers.
>
> ran time pg_dump -c --verbose database > datafile.psql from the
> command line
> and got a file size limit exceeded. datafile.psql stopped at 2 gigs. any
> ideas how to exceed that limit?
>
> redhat 7.2, 2.4.9-31 kernel
> postgres 7.2
>
>
> ---------------------------(end of broadcast)---------------------------
> TIP 2: you can get off all lists at once with the unregister command
> (send "unregister YourEmailAddressHere" to majordomo(at)postgresql(dot)org)
>
From: | Tuna Chatterjee <tchatter(at)alert(dot)infoplease(dot)com> |
---|---|
To: | Fred Moyer <fred(at)digicamp(dot)com> |
Cc: | pgsql-admin(at)postgresql(dot)org |
Subject: | Re: pg_dump max file size exceeded |
Date: | 2002-03-19 23:32:17 |
Message-ID: | 1016580738.2896.63.camel@steamer.infoplease.com |
Views: | Raw Message | Whole Thread | Download mbox | Resend email |
Lists: | pgsql-admin |
hi fred,
i ran into the same problem a couple of weeks ago and realized that the
problem was where the dump was being put instead of trying to deal with
the size of the file.
go ahead and do type 'df' at the command prompt and look at the space
allocated to your partitions. do the database dump accordingly. i.e. i
found out that /var/tmp was the perfect place to spit out my dbdump.txt
file.
good luck!
tuna
On Tue, 2002-03-19 at 16:39, Fred Moyer wrote:
> hey fellow pg'ers.
>
> ran time pg_dump -c --verbose database > datafile.psql from the command line
> and got a file size limit exceeded. datafile.psql stopped at 2 gigs. any
> ideas how to exceed that limit?
>
> redhat 7.2, 2.4.9-31 kernel
> postgres 7.2
>
>
> ---------------------------(end of broadcast)---------------------------
> TIP 2: you can get off all lists at once with the unregister command
> (send "unregister YourEmailAddressHere" to majordomo(at)postgresql(dot)org)
From: | Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us> |
---|---|
To: | "Fred Moyer" <fred(at)digicamp(dot)com> |
Cc: | pgsql-admin(at)postgresql(dot)org |
Subject: | Re: pg_dump max file size exceeded |
Date: | 2002-03-20 05:15:16 |
Message-ID: | 14611.1016601316@sss.pgh.pa.us |
Views: | Raw Message | Whole Thread | Download mbox | Resend email |
Lists: | pgsql-admin |
"Fred Moyer" <fred(at)digicamp(dot)com> writes:
> ran time pg_dump -c --verbose database > datafile.psql from the command line
> and got a file size limit exceeded. datafile.psql stopped at 2 gigs. any
> ideas how to exceed that limit?
> redhat 7.2, 2.4.9-31 kernel
[ scratches head... ] If you were on Solaris or HPUX I'd tell you to
recompile with 64-bit file offset support enabled. But I kinda thought
this was standard equipment on recent Linux versions. Anyone know the
magic incantation for large-file support on Linux?
regards, tom lane
From: | Jyry Kuukkanen <jyry(at)neutech(dot)fi> |
---|---|
To: | Fred Moyer <fred(at)digicamp(dot)com> |
Cc: | <pgsql-admin(at)postgresql(dot)org> |
Subject: | Re: pg_dump max file size exceeded |
Date: | 2002-03-20 06:05:34 |
Message-ID: | Pine.LNX.4.33L0.0203200756300.6883-100000@cyclone.neutech.fi |
Views: | Raw Message | Whole Thread | Download mbox | Resend email |
Lists: | pgsql-admin |
On Tue, 2002-03-19 at 16:39, Fred Moyer wrote:
> hey fellow pg'ers.
>
> ran time pg_dump -c --verbose database > datafile.psql from the command line
> and got a file size limit exceeded. datafile.psql stopped at 2 gigs. any
> ideas how to exceed that limit?
>
> redhat 7.2, 2.4.9-31 kernel
> postgres 7.2
Hello Fred
Are you trying to dump over NFS? NFS has a 2G file size limit and AFAIK
there is no simple way to get around it.
Howver, you could compress you dump on the fly:
pg_dump -c --verbose database |gzip -c >datafile.psql.gz
or
pg_dump -c --verbose database | bzip2 -c >datafile.psql.bz2
(for better compression)
restoring:
zcat datafile.psql.gz | psql database
or
bzcat datafile.psql.gz | psql database
Cheers,
--Jyry
C:-( C:-/ C========8-O C8-/ C:-(
Kansainvälisten kisojen tulosteksteissä käytetään
kilpailijoiden nimiin äänestoainetta.
From: | Naomi Walker <nwalker(at)eldocomp(dot)com> |
---|---|
To: | Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>, "Fred Moyer" <fred(at)digicamp(dot)com> |
Cc: | pgsql-admin(at)postgresql(dot)org |
Subject: | Re: pg_dump max file size exceeded |
Date: | 2002-03-20 15:45:43 |
Message-ID: | 4.2.2.20020320084356.00b05460@ecint.ecinet.com |
Views: | Raw Message | Whole Thread | Download mbox | Resend email |
Lists: | pgsql-admin |
At 12:15 AM 3/20/02 -0500, Tom Lane wrote:
>"Fred Moyer" <fred(at)digicamp(dot)com> writes:
> > ran time pg_dump -c --verbose database > datafile.psql from the command
> line
> > and got a file size limit exceeded. datafile.psql stopped at 2 gigs. any
> > ideas how to exceed that limit?
>
> > redhat 7.2, 2.4.9-31 kernel
>
>[ scratches head... ] If you were on Solaris or HPUX I'd tell you to
>recompile with 64-bit file offset support enabled. But I kinda thought
>this was standard equipment on recent Linux versions. Anyone know the
>magic incantation for large-file support on Linux?
depending on the shell being used, i'd try limit or ulimit
We've seen a case where large file support had to be tweaked in the Veritas
file systems as well.
--
Naomi Walker
Chief Information Officer
Eldorado Computing, Inc.
602-604-3100 ext 242
From: | Rolf Luettecke <rolf(dot)luettecke(at)michael-telecom(dot)de> |
---|---|
To: | pgsql-admin(at)postgresql(dot)org |
Subject: | Re: pg_dump max file size exceeded |
Date: | 2002-03-20 17:47:03 |
Message-ID: | 20020320184703.15733f21.rolf.luettecke@michael-telecom.de |
Views: | Raw Message | Whole Thread | Download mbox | Resend email |
Lists: | pgsql-admin |
>"Fred Moyer" <fred(at)digicamp(dot)com> writes:
> ran time pg_dump -c --verbose database > datafile.psql from the command
> line and got a file size limit exceeded. datafile.psql stopped at 2 gigs.
> any ideas how to exceed that limit?
Workaround: Pipe output to gzip/bzip2, if compressed file size does not
reach 2 GB limit, or cut output into 2GB-pieces.
Regards
R. Luettecke
From: | Dmitry Morozovsky <marck(at)rinet(dot)ru> |
---|---|
To: | Rolf Luettecke <rolf(dot)luettecke(at)michael-telecom(dot)de> |
Cc: | pgsql-admin(at)postgresql(dot)org |
Subject: | Re: pg_dump max file size exceeded |
Date: | 2002-03-22 09:38:54 |
Message-ID: | 20020322123725.O19587-100000@woozle.rinet.ru |
Views: | Raw Message | Whole Thread | Download mbox | Resend email |
Lists: | pgsql-admin |
On Wed, 20 Mar 2002, Rolf Luettecke wrote:
RL> >"Fred Moyer" <fred(at)digicamp(dot)com> writes:
RL> > ran time pg_dump -c --verbose database > datafile.psql from the command
RL> > line and got a file size limit exceeded. datafile.psql stopped at 2 gigs.
RL> > any ideas how to exceed that limit?
RL>
RL> Workaround: Pipe output to gzip/bzip2, if compressed file size does not
RL> reach 2 GB limit, or cut output into 2GB-pieces.
... and if it's still does not fit, pipe it further into split(1) ;-)
[though I don't know whether this utility exists in standard Linux
distrib. In BSDs it does.]
Sincerely,
D.Marck [DM5020, DM268-RIPE, DM3-RIPN]
------------------------------------------------------------------------
*** Dmitry Morozovsky --- D.Marck --- Wild Woozle --- marck(at)rinet(dot)ru ***
------------------------------------------------------------------------