Fwd: Grid Engine: ongoing and future work
Ron Chen
ron_chen_123 at yahoo.com
Sat Sep 22 11:07:34 PDT 2001
If you are interested in HPC, Linux clusters, batch
systems, please join this opensource project.
http://gridengine.sunsource.net/
(See below for the top 8 projects)
-Ron
--- Fritz Ferstl <Friedrich.Ferstl at Sun.COM> wrote:
> Reply-to: dev at gridengine.sunsource.net
> Date: Tue, 18 Sep 2001 15:17:42 +0200 (MEST)
> From: Fritz Ferstl <Friedrich.Ferstl at Sun.COM>
> To: Grid Engine dev alias
> <dev at gridengine.sunsource.net>
> CC: Grid Engine users alias
> <users at gridengine.sunsource.net>
> Subject: [GE dev] ongoing and future work
>
> Hi (and sorry for cross-posting),
>
> the Grid Engine project is now in the open source
> since 6 weeks and it is
> time to make better use of the dev mailing list.
> Those of you, who
> are on the users mailing list and not on dev, but
> who would wish to be
> kept up-to-date on Grid Engine development issue,
> might want to register
> to the dev alias by sending e-mail to
>
> dev-subscribe at gridengine.sunsource.net
>
>
> Some of you may not know that Grid Engine has a
> history as a commercial
> distributed resource management product: first
> CODINE, then GRD and later
> Sun Grid Engine - see also
>
>
>
http://gridengine.sunsource.net/project/gridengine/background.html
>
> As a result, a group of developers has been working
> on Grid Engine already
> when it was still proprietary. Also several
> development projects have been
> initiated before the project became open source.
> These projects are still
> ongoing.
>
> We should try to use the dev mailing list for
> exchanging information
> between those who are new to Grid Engine and those
> who have more
> experience. We also should try to get as much
> community feedback as
> possible on the already ongoing development
> projects.
>
> Here is a brief description of the currently active
> projects. I would like
> to ask all who have questions or feedback to any of
> them to respond. In
> particular, I would ask developers working on them
> to provide information
> on their status shortly:
>
> 1. Grid Engine Enhanced Edition Dispatch Algorithm
>
> Development in this project is close to be
> finished. The corresponding
> changes will be checked in within the next few
> weeks. The result will be
> an improved algorithm for making dispatch
> decisions in the Enhanced
> Edition case being better aligned with the
> (share-tree, functional,
> etc.) policies. The corresponding mail from
> Shannon in the users archive
>
>
>
http://gridengine.sunsource.net/servlets/ReadMsg?msgId=880&listName=users
>
> provides a good overview.
>
> 2. Array Jobs
>
> Several improvements are to come in the context
> of the array job
> facility. The first part concerns a more
> efficient file spooling for
> array jobs. It is going to be checked in within
> the next few days.
>
> 3. Scalability, Performance Tuning
>
> Scalability and performance tuning, in particular
> with respect to the
> scheduler, are a topic of ongoing efforts. Some
> modifications in this
> area have been checked in recently, more is to
> come.
>
> 3. Security
>
> Efforts are underway to include a security system
> into the Grid Engine
> framework, which provides state-of-the-art
> protection against malicious
> use and doesn't require any outside
> administrative security measures
> such as DCE, Kerberos or reserved port
> installations.
>
> 4. Monitoring/Accounting
>
> There is a project which aims at providing more
> information in the areas
> of Grid Engine monitoring and accounting to the
> administrator and user.
> The first draft of a project spec will be
> available within the next 2
> weeks.
>
> 5. Job Interface and other DRM Interfaces
>
> We intend to start a discussion on interfaces to
> DRM software in general
> and interfaces for the manipulation of jobs
> (submission, monitoring,
> control) in particular. A discussion paper is
> currently developed and
> will be presented in a few weeks.
>
> 6. Communication System
>
> Concepts are being developed to improve and
> redesign the Grid Engine
> communication system. A draft of the new concepts
> is under construction
> currently. It will be posted within a few weeks.
> All feed-back and
> information in advance is highly appreciated.
>
> 7. Multi-Threading
>
> This project explores further possibilities to
> use multi-threading
> approaches in the Grid Engine daemons for better
> scalability and for
> more efficient memory usage. The project is not
> far advanced yet and any
> early input is very welcome.
>
> 8. Cluster Queues
>
> The cluster queue project aims at introducing the
> notion of cluster
> queues into Grid Engine as an abstraction of the
> current host orient
> queue definition and for more ease of
> administration as well as better
> scalability. The project is in an early
> specification stage. Please send
> feed-back and comments in advance.
>
> There are a number of smaller development efforts
> always ongoing in
> parallel to the above more long ranging and larger
> projects. Such small
> development efforts are usually in response to bug
> reports or enhancement
> requests, which can be found in IssueZilla
>
(http://gridengine.sunsource.net/servlets/ProjectIssues).
>
> I have taken the action to prepare a short list of
> top priority issues
> regularly, which I will post soon for the first time
> to the dev alias.
> Input on which Issue to put on this list or on the
> prioritization of
> individual issues therein is very welcome.
>
> Beyond all those ongoing efforts, there is a (long)
> list of potential
> development projects, of course, to enhance Grid
> Engine in a wide variety
> of ways. The following is a short snippet of this
> list, touching some of
> the areas in which work has been performed in the
> past:
>
> - Integration with existing schedulers, e.g. MAUI,
> RWTH-Aachen, ...
> - Interfaces/GUIs, e.g. Web, Java, Perl, Windows,
> ...
> - Grid framework integration (Globus, Legion, Punch
> - some work already
> done for all)
> - Advanced scheduler policies (e.g., resource
> reservation in combination with
> preemption or policy driven management of
> arbitrary resources)
> - Hierarchical configuration and policy
> administration
> - ...
>
> Please send your input on these topics or add
> further items to this list by
> sending your contributions to the dev alias.
>
> Thanks,
>
> Fritz
>
>
>
---------------------------------------------------------------------
> To unsubscribe, e-mail:
> dev-unsubscribe at gridengine.sunsource.net
> For additional commands, e-mail:
> dev-help at gridengine.sunsource.net
>
__________________________________________________
Do You Yahoo!?
Get email alerts & NEW webcam video instant messaging with Yahoo! Messenger. http://im.yahoo.com
More information about the Beowulf
mailing list