Re: How to recover when can't start database

"L.Boldareva" <pg(at)pierro(dot)dds(dot)nl> wrote on 01.04.2005, 12:02:21:
> Hi!
> (Hope this is the right place to post)
>
> I crashed the postmaster and cannot start it anymore, with the error
>
> LOG: database system was interrupted while in recovery at 2005-04-01 11:04:33 CEST
> HINT: This probably means that some data is corrupted and you will have to use the last backup for recovery.
> LOG: checkpoint record is at 5/6F00C540
> LOG: redo record is at 5/6F000ABC; undo record is at 0/0; shutdown FALSE
> LOG: next transaction ID: 599824; next OID: 147679259
> LOG: database system was not properly shut down; automatic recovery in
> progress
> LOG: redo starts at 5/6F000ABC
> PANIC: btree_split_redo: lost left sibling
> LOG: startup process (PID 5603) was terminated by signal 6
> LOG: aborting startup due to startup process failure
>
> Is there a way to recover from that?
>
> I don't have a fresh backup, but loosing some couple of days won't be a
> problem.
>
> I use PG 8.0 on a linux box, with standard postgresq.conf (except some
> increased memory settings).
>

Well, it *might* be possible to recover using a Point in Time Recovery,
with some manipulation. Never been done, as far as I know, so don't
hold your breath.

PITR wasn't designed for the situation where you haven't actually taken
a backup, but it might still be possible. I think it will cause a
problem since there's no pg_stop_backup() been executed, but perhaps we
can think of a way to override that or build a custom recovery server.

First, backup exactly everything you have now and save it.
You might even want to do it twice, so there's no mistake.

If you've got the original failure log that would be great. We need to
establish what time the original failure took place, if there was one,
so we can try to rollforward to a time just before that.

Anyway, I'll be free in a few hours to have a look at this, but it could
take a few days to figure it out, so don't promise anybody success and
don't say it would be quick either. You may not wish to wait that long,
I've no idea of your business. Please save the database anyway so we've
got a test case.

Best Regards, Simon Riggs