Re: PostgreSQL in Cluster

Lists: pgsql-general
From: "Luiz Guilherme Freitas de Paula" <luiz(at)auge(dot)com(dot)br>
To: <pgsql-general(at)postgresql(dot)org>
Subject: PostgreSQL in Cluster
Date: 2004-02-27 18:31:16
Message-ID: 005301c3fd60$13aa1ff0$4f00a8c0@auge.com.br
Views: Raw Message | Whole Thread | Download mbox | Resend email
Lists: pgsql-general

Hi everyone,

Anyone have PostgreSQL running on a cluster?
I'm trying to run on a OpenMosix 2-machine cluster but the processes are not migrating.
All the load is concentrating in one machine.
And, how can I have fail over?

Thank you,

Luiz


From: "scott(dot)marlowe" <scott(dot)marlowe(at)ihs(dot)com>
To: Luiz Guilherme Freitas de Paula <luiz(at)auge(dot)com(dot)br>
Cc: <pgsql-general(at)postgresql(dot)org>
Subject: Re: PostgreSQL in Cluster
Date: 2004-02-27 19:09:37
Message-ID: Pine.LNX.4.33.0402271138300.14902-100000@css120.ihs.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Lists: pgsql-general

On Fri, 27 Feb 2004, Luiz Guilherme Freitas de Paula wrote:

> Hi everyone,
>
> Anyone have PostgreSQL running on a cluster?
> I'm trying to run on a OpenMosix 2-machine cluster but the processes are not migrating.
> All the load is concentrating in one machine.
> And, how can I have fail over?

so far, everyone who's tested postgresql on openmosix has found it to be
quite slow. IT would appear the shared memory is the deal breaker there.


From: Richard Huxton <dev(at)archonet(dot)com>
To: "Luiz Guilherme Freitas de Paula" <luiz(at)auge(dot)com(dot)br>, <pgsql-general(at)postgresql(dot)org>
Subject: Re: PostgreSQL in Cluster
Date: 2004-02-27 19:39:06
Message-ID: 200402271939.06408.dev@archonet.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Lists: pgsql-general

On Friday 27 February 2004 18:31, Luiz Guilherme Freitas de Paula wrote:
> Hi everyone,
>
> Anyone have PostgreSQL running on a cluster?
> I'm trying to run on a OpenMosix 2-machine cluster but the processes are
> not migrating. All the load is concentrating in one machine.

I don't think openmosix allows shared memory to migrate. Since PG uses shared
memory to communicate between backends, this will cause you problems.

> And, how can I have fail over?

More information?

--
Richard Huxton
Archonet Ltd


From: "Luiz Guilherme Freitas de Paula" <luiz(at)auge(dot)com(dot)br>
To: "Richard Huxton" <dev(at)archonet(dot)com>, <pgsql-general(at)postgresql(dot)org>
Subject: Re: PostgreSQL in Cluster
Date: 2004-02-27 20:13:57
Message-ID: 007d01c3fd6e$3d03e080$4f00a8c0@auge.com.br
Views: Raw Message | Whole Thread | Download mbox | Resend email
Lists: pgsql-general

Is there any way to use PostgreSQL in a cluster configuration or have
redundancy?
How can I have my DB to not stop on hardware failure?

Thank you,

Luiz

> On Friday 27 February 2004 18:31, Luiz Guilherme Freitas de Paula wrote:
> > Hi everyone,
> >
> > Anyone have PostgreSQL running on a cluster?
> > I'm trying to run on a OpenMosix 2-machine cluster but the processes are
> > not migrating. All the load is concentrating in one machine.
>
> I don't think openmosix allows shared memory to migrate. Since PG uses
shared
> memory to communicate between backends, this will cause you problems.
>
> > And, how can I have fail over?
>
> More information?
>
> --
> Richard Huxton
> Archonet Ltd
>
> ---------------------------(end of broadcast)---------------------------
> TIP 3: if posting/reading through Usenet, please send an appropriate
> subscribe-nomail command to majordomo(at)postgresql(dot)org so that your
> message can get through to the mailing list cleanly
>


From: Richard Huxton <dev(at)archonet(dot)com>
To: "Luiz Guilherme Freitas de Paula" <luiz(at)auge(dot)com(dot)br>, <pgsql-general(at)postgresql(dot)org>
Subject: Re: PostgreSQL in Cluster
Date: 2004-02-27 20:33:00
Message-ID: 200402272033.00849.dev@archonet.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Lists: pgsql-general

On Friday 27 February 2004 20:13, Luiz Guilherme Freitas de Paula wrote:
> Is there any way to use PostgreSQL in a cluster configuration or have
> redundancy?

Well, you don't say much about your hardware, usage patterns etc. but you
might want look at the various replication options currently available.

There's one in the source distribution: contrib/dbmirror.
Or perhaps erserver/rservimp on gborg.postgresql.org

> How can I have my DB to not stop on hardware failure?

I don't know of anyone doing instant fail-over to a secondary machine. You
might want to consider the following:

1. External, shared RAID drives (note that you *MUST NOT* run two versions of
PG against the same files)
2. Duplicate machines with replication and one of the "heartbeat+failover"
options (free or commercial)
3. Commercial high-availability hardware (I know - too expensive)

Can't say much more without knowing what you want. Whatever path you decide to
take, do a proper risk assessment first and allow time to understand the
systems involved and too proper testing.

--
Richard Huxton
Archonet Ltd


From: Jonathan Bartlett <johnnyb(at)eskimo(dot)com>
To: Luiz Guilherme Freitas de Paula <luiz(at)auge(dot)com(dot)br>
Cc: Richard Huxton <dev(at)archonet(dot)com>, pgsql-general(at)postgresql(dot)org
Subject: Re: PostgreSQL in Cluster
Date: 2004-02-27 20:38:21
Message-ID: Pine.SUN.4.58.0402271237100.2605@eskimo.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Lists: pgsql-general

> Is there any way to use PostgreSQL in a cluster configuration or have
> redundancy?
> How can I have my DB to not stop on hardware failure?

You can have a fail-over cluster by having an external disk array
connected to two machines, where machine B is activated, mounts the
disks, and switches off power from machine A if it fails.

Jon

>
> Thank you,
>
> Luiz
>
> > On Friday 27 February 2004 18:31, Luiz Guilherme Freitas de Paula wrote:
> > > Hi everyone,
> > >
> > > Anyone have PostgreSQL running on a cluster?
> > > I'm trying to run on a OpenMosix 2-machine cluster but the processes are
> > > not migrating. All the load is concentrating in one machine.
> >
> > I don't think openmosix allows shared memory to migrate. Since PG uses
> shared
> > memory to communicate between backends, this will cause you problems.
> >
> > > And, how can I have fail over?
> >
> > More information?
> >
> > --
> > Richard Huxton
> > Archonet Ltd
> >
> > ---------------------------(end of broadcast)---------------------------
> > TIP 3: if posting/reading through Usenet, please send an appropriate
> > subscribe-nomail command to majordomo(at)postgresql(dot)org so that your
> > message can get through to the mailing list cleanly
> >
>
>
> ---------------------------(end of broadcast)---------------------------
> TIP 6: Have you searched our list archives?
>
> http://archives.postgresql.org
>


From: "Augusto Cesar Castoldi" <castoldi(at)npd(dot)ufsc(dot)br>
To: "'pgsql-general-unsubscribe(at)postgresql(dot)org'" <pgsql-general(at)postgresql(dot)org>
Subject: RES: PostgreSQL in Cluster
Date: 2004-02-27 21:44:26
Message-ID: 000301c3fd7a$df3a1930$b709a296@npd.ufsc.br
Views: Raw Message | Whole Thread | Download mbox | Resend email
Lists: pgsql-general

-----Mensagem original-----
De: pgsql-general-owner(at)postgresql(dot)org
[mailto:pgsql-general-owner(at)postgresql(dot)org] Em nome de Luiz Guilherme
Freitas de Paula
Enviada em: sexta-feira, 27 de fevereiro de 2004 17:14
Para: Richard Huxton; pgsql-general(at)postgresql(dot)org
Assunto: Re: [GENERAL] PostgreSQL in Cluster

Is there any way to use PostgreSQL in a cluster configuration or have
redundancy?
How can I have my DB to not stop on hardware failure?

Thank you,

Luiz

> On Friday 27 February 2004 18:31, Luiz Guilherme Freitas de Paula
wrote:
> > Hi everyone,
> >
> > Anyone have PostgreSQL running on a cluster?
> > I'm trying to run on a OpenMosix 2-machine cluster but the processes
are
> > not migrating. All the load is concentrating in one machine.
>
> I don't think openmosix allows shared memory to migrate. Since PG uses
shared
> memory to communicate between backends, this will cause you problems.
>
> > And, how can I have fail over?
>
> More information?
>
> --
> Richard Huxton
> Archonet Ltd
>
> ---------------------------(end of
broadcast)---------------------------
> TIP 3: if posting/reading through Usenet, please send an appropriate
> subscribe-nomail command to majordomo(at)postgresql(dot)org so that
your
> message can get through to the mailing list cleanly
>

---------------------------(end of broadcast)---------------------------
TIP 6: Have you searched our list archives?

http://archives.postgresql.org


From: Anton Nikiforov <Anton(dot)Nikiforov(at)loteco(dot)ru>
To: pgsql-general(at)postgresql(dot)org
Subject: Re: PostgreSQL in Cluster
Date: 2004-02-28 08:43:45
Message-ID: 404054C1.6010603@loteco.ru
Views: Raw Message | Whole Thread | Download mbox | Resend email
Lists: pgsql-general

> Hi everyone,
Hello!
>
> Anyone have PostgreSQL running on a cluster?
Yes. Someone :) Me :)
> I'm trying to run on a OpenMosix 2-machine cluster but the processes are
> not migrating.
The solution you are looking for is depending on what you want to get
srom it. I mean even oracle cluster solution do not allow to migrate
updates if while update is going on the hardware fail happend. It
migrate to a second node and all selects are starting from the beginning
and update and inserts are canselled (as far as i know).
So to find a solution you should know:
1. How much time your database could be unavailable (one second per year
or one hour per day)
2. Does your application could recoonect to a database if the problem arise.
3. Does your application is cappable to check data consistancy (after
insert, update whatever if fail happend)
............
1001.
As for me i answerred all that questions and have the following
configuration:
1. Two Intel SRKA4 machines with RAID1 for OS and RAID5 for databasee (i
know that RAID5 is too slow but for me it is just a solution)
2. Bouth computers connected to different power feeders via different UPSs.
3. I have 3 dedicated Gigabit ethernet connections established between
computers for data mirroring and two more for data access from the network.
4. Red Hat Linux8 installed it is a pitty thing because i'm using
FreeBSD on all other servers but DRBD is available only for linux.
5. All disks being mirrored over a network using DRBD software.
All database drives are configured to write data to remote node first
(Protocol C).
6. Hardware being monitored with heartbeat software that is configured
to send beats each second and if 2 heartbeats are missing it consider it
is as hardware mulfunction
7. Postgress migrating from one computer to another in 5 seconds.
8. There is a special daemon that controlls data consistancy.

Best regards,
Anton
> All the load is concentrating in one machine.
> And, how can I have fail over?
>
> Thank you,
>
> Luiz