Postgres-R source code release

Dear Hackers,

it has been two years, since I've presented my work on Postgres-R for
the first time to a broader audience in Toronto. I continued maintaining
that code in my spare time, but to be honest, I didn't have much time
for it.

As much as I'd like to change that, I now think the best thing for the
project itself is to open it up and release the source code. I'd very
much like to get others aboard and turn Postgres-R into a real community
project again. Of course, the recent core statement about wanting an
integrated replication solution also influenced my decision, even though
I realize that Postgres-R is way more ambitious path than a log shipping
solution.

As a first step towards a community project, I've cleaned up the code
and tried to comment and document it as good as I can. You are welcome
to download the latest patch from http://www.postgres-r.org/downloads/.
It expects to be applied against today's CVS HEAD. You'll find a README
and a pretty exhaustive TODO file under src/backend/replication/.

I plan to write a series of more technical mails following this one, to
start the discussion about the internals of Postgres-R and decisions I
made. That should give some starting points for those interested it the
project.

In case you are wondering: I've got married and I'm glad to tell you
that I changed my very German sounding name Schiltknecht to a more
pronounceable one: my new surname is Wanner.

Looking forward to inspiring discussions with fellow hackers.

Regards

Markus Wanner

On Mon, 2008-07-14 at 17:42 +0200, Markus Wanner wrote:
> As much as I'd like to change that, I now think the best thing for the
> project itself is to open it up and release the source code. I'd very
> much like to get others aboard and turn Postgres-R into a real
> community project again. Of course, the recent core statement about
> wanting an integrated replication solution also influenced my
> decision, even though I realize that Postgres-R is way more ambitious
> path than a log shipping solution.
>
> As a first step towards a community project, I've cleaned up the code
> and tried to comment and document it as good as I can. You are welcome
> to download the latest patch from
> http://www.postgres-r.org/downloads/.

That's good news, really.

> In case you are wondering: I've got married and I'm glad to tell you
> that I changed my very German sounding name Schiltknecht to a more
> pronounceable one: my new surname is Wanner.

Congrats :)
--
Devrim GÜNDÜZ
devrim~gunduz.org, devrim~PostgreSQL.org, devrim.gunduz~linux.org.tr
http://www.gunduz.org

On Mon, Jul 14, 2008 at 11:42 AM, Markus Wanner
<markus(dot)wanner(at)programmfabrik(dot)de> wrote:
> As a first step towards a community project, I've cleaned up the code and
> tried to comment and document it as good as I can. You are welcome to
> download the latest patch from http://www.postgres-r.org/downloads/. It
> expects to be applied against today's CVS HEAD. You'll find a README and a
> pretty exhaustive TODO file under src/backend/replication/.

Awesome!

> In case you are wondering: I've got married

Congratulations!

--
Jonah H. Harris, Sr. Software Architect | phone: 732.331.1324
EnterpriseDB Corporation | fax: 732.331.1301
499 Thornall Street, 2nd Floor | jonah(dot)harris(at)enterprisedb(dot)com
Edison, NJ 08837 | http://www.enterprisedb.com/

On Mon, Jul 14, 2008 at 05:42:21PM +0200, Markus Wanner wrote:
> Dear Hackers,
>
> it has been two years, since I've presented my work on Postgres-R for
> the first time to a broader audience in Toronto. I continued maintaining
> that code in my spare time, but to be honest, I didn't have much time
> for it.
>
> As much as I'd like to change that, I now think the best thing for the
> project itself is to open it up and release the source code. I'd very
> much like to get others aboard and turn Postgres-R into a real community
> project again. Of course, the recent core statement about wanting an
> integrated replication solution also influenced my decision, even though
> I realize that Postgres-R is way more ambitious path than a log shipping
> solution.
>
> As a first step towards a community project, I've cleaned up the code
> and tried to comment and document it as good as I can. You are welcome
> to download the latest patch from http://www.postgres-r.org/downloads/.
> It expects to be applied against today's CVS HEAD. You'll find a README
> and a pretty exhaustive TODO file under src/backend/replication/.

Would you mind if I were to make a git branch for it on
<http://git.postgresql.org/> ?

> In case you are wondering: I've got married

Congratulations!

Cheers,
David.
--
David Fetter <david(at)fetter(dot)org> http://fetter.org/
Phone: +1 415 235 3778 AIM: dfetter666 Yahoo!: dfetter
Skype: davidfetter XMPP: david(dot)fetter(at)gmail(dot)com

Remember to vote!
Consider donating to Postgres: http://www.postgresql.org/about/donate

David Fetter wrote:
> On Mon, Jul 14, 2008 at 05:42:21PM +0200, Markus Wanner wrote:

> Would you mind if I were to make a git branch for it on
> <http://git.postgresql.org/> ?

That's very likely wasted effort, since obviously Markus has got a
Monotone tree somewhere ...

--
Alvaro Herrera http://www.CommandPrompt.com/
PostgreSQL Replication, Consulting, Custom Development, 24x7 support

On Mon, Jul 14, 2008 at 05:35:28PM -0400, Alvaro Herrera wrote:
> David Fetter wrote:
> > On Mon, Jul 14, 2008 at 05:42:21PM +0200, Markus Wanner wrote:
>
> > Would you mind if I were to make a git branch for it on
> > <http://git.postgresql.org/> ?
>
> That's very likely wasted effort, since obviously Markus has got a
> Monotone tree somewhere ...

I'm curious as to your motive behind continual deriding any effort to
get git going on branches. Do you have some other alternative in mind?

Cheers,
David.
--
David Fetter <david(at)fetter(dot)org> http://fetter.org/
Phone: +1 415 235 3778 AIM: dfetter666 Yahoo!: dfetter
Skype: davidfetter XMPP: david(dot)fetter(at)gmail(dot)com

Remember to vote!
Consider donating to Postgres: http://www.postgresql.org/about/donate

David Fetter wrote:
> On Mon, Jul 14, 2008 at 05:35:28PM -0400, Alvaro Herrera wrote:
> > David Fetter wrote:
> > > On Mon, Jul 14, 2008 at 05:42:21PM +0200, Markus Wanner wrote:
> >
> > > Would you mind if I were to make a git branch for it on
> > > <http://git.postgresql.org/> ?
> >
> > That's very likely wasted effort, since obviously Markus has got a
> > Monotone tree somewhere ...
>
> I'm curious as to your motive behind continual deriding any effort to
> get git going on branches. Do you have some other alternative in mind?

That's not my intention. It's just that the two cases that have popped
up are not useful. The with-recursive one because upstream does not use
it. If that can be solved, then I have no objection and I think it
would be a good thing. This one because it would be messy. I think the
way to go here is to have Markus open up his Monotone repo, or convince
him to migrate it to Git, but I really doubt that's ever going to
happen.

--
Alvaro Herrera http://www.CommandPrompt.com/
The PostgreSQL Company - Command Prompt, Inc.

On Mon, 2008-07-14 at 14:41 -0700, David Fetter wrote:
> On Mon, Jul 14, 2008 at 05:35:28PM -0400, Alvaro Herrera wrote:
> > David Fetter wrote:
> > > On Mon, Jul 14, 2008 at 05:42:21PM +0200, Markus Wanner wrote:
> >
> > > Would you mind if I were to make a git branch for it on
> > > <http://git.postgresql.org/> ?
> >
> > That's very likely wasted effort, since obviously Markus has got a
> > Monotone tree somewhere ...
>
> I'm curious as to your motive behind continual deriding any effort to
> get git going on branches. Do you have some other alternative in mind?

Obviously monotone, but I think the point is, Git gives them nothing
Monotone doesn't. Of course, I am personally happy with SVN but hey :P

Joshua D. Drake

--
The PostgreSQL Company since 1997: http://www.commandprompt.com/
PostgreSQL Community Conference: http://www.postgresqlconference.org/
United States PostgreSQL Association: http://www.postgresql.us/
Donate to the PostgreSQL Project: http://www.postgresql.org/about/donate

On Mon, Jul 14, 2008 at 04:22:47PM -0700, Joshua D. Drake wrote:
> On Mon, 2008-07-14 at 14:41 -0700, David Fetter wrote:
> > On Mon, Jul 14, 2008 at 05:35:28PM -0400, Alvaro Herrera wrote:
> > > David Fetter wrote:
> > > > On Mon, Jul 14, 2008 at 05:42:21PM +0200, Markus Wanner wrote:
> > >
> > > > Would you mind if I were to make a git branch for it on
> > > > <http://git.postgresql.org/> ?
> > >
> > > That's very likely wasted effort, since obviously Markus has got
> > > a Monotone tree somewhere ...
> >
> > I'm curious as to your motive behind continual deriding any effort
> > to get git going on branches. Do you have some other alternative
> > in mind?
>
> Obviously monotone, but I think the point is, Git gives them nothing
> Monotone doesn't.

Apart from being able to interoperate with CVS, you mean? ;)

> Of course, I am personally happy with SVN but hey :P

You can't have tried a merge in SVN if that's so :P :P

Cheers,
David.
--
David Fetter <david(at)fetter(dot)org> http://fetter.org/
Phone: +1 415 235 3778 AIM: dfetter666 Yahoo!: dfetter
Skype: davidfetter XMPP: david(dot)fetter(at)gmail(dot)com

Remember to vote!
Consider donating to Postgres: http://www.postgresql.org/about/donate

On Jul 14, 2008, at 16:54, David Fetter wrote:

>> Of course, I am personally happy with SVN but hey :P
>
> You can't have tried a merge in SVN if that's so :P :P

Those of us who have been doing it for years, in CVS and in SVN,
aren't too worried about it.

Best,

David

On 15/07/2008, David E. Wheeler <david(at)kineticode(dot)com> wrote:
> > > Of course, I am personally happy with SVN but hey :P
> >
> > You can't have tried a merge in SVN if that's so :P :P
>
> Those of us who have been doing it for years, in CVS and in SVN, aren't too
> worried about it.
>

Follow the sandal! :D

--
Please don't top post, and don't use HTML e-Mail :} Make your quotes concise.

http://www.american.edu/econ/notes/htmlmail.htm

Hi,

Alvaro Herrera wrote:
> I think the
> way to go here is to have Markus open up his Monotone repo, or convince
> him to migrate it to Git, but I really doubt that's ever going to
> happen.

He he... good guess ;-)

However, as much as I personally like monotone and as much as I dislike
git for being a bad rip off of monotone, git certainly has its merits.
It has a much larger users base and is faster than monotone for some
operations.

Having used subversion, CVS and monotone for Postgres-R, I think I'm now
giving git a try. I'm about to setup the necessary repositories, but I'm
still having a hard time grokking this tool set. (And yes, I'm missing
some features compared to monotone. In our case, the most obvious one is
'mtn diff --context' ;-) )

Regards

Markus

Hi,

David Fetter wrote:
> Would you mind if I were to make a git branch for it on
> <http://git.postgresql.org/> ?

I've set up a git-daemon with the Postgres-R patch here:

git://postgres-r.org/repo

Since it's a distributed VCS, you should be able to mirror that to
git.postgtresql.org somehow (if you figure out how, please tell me!).

Please note that I'm still struggling with git and I cannot promise to
keep using it.

Regards

Markus

On Wed, Jul 16, 2008 at 09:35:28PM +0200, Markus Schiltknecht wrote:
> Hi,
>
> David Fetter wrote:
>> Would you mind if I were to make a git branch for it on
>> <http://git.postgresql.org/> ?
>
> I've set up a git-daemon with the Postgres-R patch here:
>
> git://postgres-r.org/repo
>
> Since it's a distributed VCS, you should be able to mirror that to
> git.postgtresql.org somehow (if you figure out how, please tell me!).

I've merged the latest Postgres in. Care to see whether it runs?
http://git.postgresql.org/?p=~davidfetter/pgr/.git;a=summary

> Please note that I'm still struggling with git and I cannot promise
> to keep using it.

I'm struggling, too, but the cheapness of experimenting is making it
easier and easier :)

Cheers,
David.
--
David Fetter <david(at)fetter(dot)org> http://fetter.org/
Phone: +1 415 235 3778 AIM: dfetter666 Yahoo!: dfetter
Skype: davidfetter XMPP: david(dot)fetter(at)gmail(dot)com

Remember to vote!
Consider donating to Postgres: http://www.postgresql.org/about/donate