From: Christopher Browne <cbbrowne@mail.libertyrms.com>
To: pgsql-admin@postgresql.org
Subject: Re: Need Scheduling Support for Your Databases?
Date: Sun, 01 Jul 2007 01:33:37 +0000
Message-ID: <60sl886h72.fsf@dba2.int.libertyrms.com> (raw)
References: <1183241520.220859.227020@u2g2000hsc.googlegroups.com>
carl <carlwkemp@gmail.com> writes:
> Greetings All,
>
> I'm working on a specification for an Enterprise-class Open Source
> batch scheduler, and I really would like some expert commentary from
> experienced database people. Please have a look at:
>
> http://openjcs.sourceforge.net
>
> and the specification to date at:
>
> http://openjcs.sourceforge.net/doc/OpenJCS-arch.pdf
>
> Frankly, I'm of two minds about it. Half of me thinks it's massive
> overkill, and the other half thinks I must be missing something really
> important. Let me know what you think. I really do want your honest
> opinion, good, bad or indifferent.
>
> Also, it has been suggested that the specification might be useful if
> ported to Windows. For those of you who administer databases on both
> Windows and *nix, how useful would a tool like this be to you in your
> day-to-day operations? Do you think there is a big enough market to
> warrant cross-platform support?
It's not so much a DBMS issue as it is one for people running a lot of
heterogeneous applications (e.g. - DBMS bits, systems administration
bits, application bits, ...) across a bunch of hosts.
The best overview document I have seen about "enterprise job
scheduling" is the following one which is actually a Microsoft "white
paper." (I found it when Googling for "vms job scheduling.")
http://download.microsoft.com/download/2/7/2/272DB1B6-209A-4AEC-A231-105B35DC0271/Job_Sch_Final.doc
I don't know that I necessarily would want *all* the features that
they mention; they describe 3 'generations' of batch scheduling
features, and the items in the 3rd generation seem rather abstruse.
But plenty of the features in the first couple of "generation lists"
seem pretty useful. You may well find features in that document that
you'll want to add.
I'll note that you almost certainly want to use a full scale DBMS
(probably PostgreSQL!) to robustly store and help validate the rather
large amount of metadata that you will have around. That is the usual
way that "enterprise" job scheduler systems are implemented.
For instance, one feature you almost certainly want (that a proper
DBMS would help support) is the notion of supporting work calendars.
There are jobs to run every workday, based on some calendar. And
there may be multiple of those, as sets of holidays vary from place to
place. Indeed, this week contains the (different) national holidays
for Canada and the US. My employer has offices in both countries, so
that there is the potential to need to schedule things to evade some
*or both* sets of holidays. Monday and Wednesday are crummy days to
plan meetings (even ignoring the factor that a lot of staff are taking
extra time off).
--
(format nil "~S@~S" "cbbrowne" "cbbrowne.com")
http://linuxfinances.info/info/sgml.html
Rules of the Evil Overlord #151. "I will not set myself up as a
god. That perilous position is reserved for my trusted lieutenant."
<http://www.eviloverlord.com/;
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Reply to all the recipients using the --to and --cc options:
reply via email
To: pgsql-admin@postgresql.org
Cc: cbbrowne@mail.libertyrms.com
Subject: Re: Need Scheduling Support for Your Databases?
In-Reply-To: <60sl886h72.fsf@dba2.int.libertyrms.com>
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
This inbox is served by DDX for PostgreSQL; see mirroring instructions
for how to clone and mirror all data and code used for this inbox