Skip site navigation (1) Skip section navigation (2)

Peripheral Links

Header And Logo

PostgreSQL
| The world's most advanced open source database.

Site Navigation

Search for
  Advanced Search

number of tables limited over time (not simultaneous)?


  • From: dave crane <lists(at)slipt(dot)net>
  • To: PostgreSQL General <pgsql-general(at)postgresql(dot)org>
  • Subject: number of tables limited over time (not simultaneous)?
  • Date: Tue, 20 Feb 2007 22:02:36 -0500
  • Message-id: <45DBB64C(dot)1030908(at)slipt(dot)net>

We've settled upon a method for gathering raw statistics from widely scattered data centers of creating one sequence per-event, per minute.

Each process (some lapp, some shell, some python, some perl etc) can call a shell script which calls ssh->psql to execute a nextval('event') sequence. Periodically (every 2-10 minutes, depending on other factors) Another process picks up the value and inserts it into a permanent home.

We're only talking a few 7-10k calls per minute, but going to this from a query that does an update has saved a *huge* amount of overhead.

If I needed to a periodic dump and restore would only take a minute. This data is highly transient. More frequently than biweekly or so would be annoying though.

Aside from security concerns, did we miss something? Should I be worried we're going through ~60,000 sequences per day?

TIA,
dave






Home | Main Index | Thread Index

Privacy Policy | PostgreSQL Archives hosted by Command Prompt, Inc. | Designed by tinysofa
Copyright © 1996 – 2008 PostgreSQL Global Development Group