gLite Workload Management System

1. Release Description

This release contains the gLite Workload Management System module v. 2.0.2. The following sections provide additional information about the release content, the module dependencies, the know bugs and issues and a list of bugs closed since the previous release. For information about installing and using the gLite Workload Management System, please refer to the gLite Installation and User Guides.

2. Changes in this Release

This release introduces the following changes:

Use a new security model in the authentication/authorization with CE servers based
New option to discover existing pool accounts created with external systems
New option to avoid pre-configuring the pool accounts when the home directories are on shared file systems (inaccessible to the root user) (it should be used together with a relocation of the glite_setenv.sh file to /etc/profile.d). This functionality is activated using the modify.user.env parameter in the glite-global.cfg.xml file
The configuration script now has a new --configure command line switch to execute the configuration steps only without starting the services. The --start switch must be used to start the services. Running the script without options print usage instructions
R-GMA Service Publisher parameters updated to use new common conventions (please make sure you use the new configuration templates)
Added the following new configuration parameters:
account.discovery                                                    (advanced parameters)
condor.CLASSAD_LIFETIME                               (advanced parameters)
condor.NEGOTIATOR_UPDATE_INTERVAL           (advanced parameters)
condor.MASTER_UPDATE_INTERVAL              (advanced parameters)
condor.UPDATE_INTERVAL                               (advanced parameters)
condor.NEGOTIATOR_INTERVAL                      (advanced parameters)
condor.HIGHPORT                                                      (advanced parameters)
condor.LOWPORT                                                 (advanced parameters)
disable.gris.purchasing                                             (advanced parameters)
Bug fixes (please refer to the bug fixes list below)

3. Release contents

The gLite Workload Management System v. 2.0.2 is composed of the following gLite components:

Component name	Description	Version	File
org.glite.ce-monitor-client-api.c	Gsoap api for CE monitor client	1.2.0	../../../../../../../glite-web/egee/packages/R1.2/R20050715/bin/rhel30/i386/RPMS/glite-ce-monitor-client-api-c-1.2.0-1.i386.rpm
org.glite.ce.wsdl	CE wsdl	1.2.0	../../../../../../../glite-web/egee/packages/R1.2/R20050715/bin/rhel30/noarch/RPMS/glite-ce-wsdl-1.2.0-1.noarch.rpm
glite-config	gLite configuration scripts	1.2.1	../../../../../../../glite-web/egee/packages/R1.2/R20050715/bin/rhel30/noarch/RPMS/glite-config-1.2.1-1.noarch.rpm
org.glite.lb.client	L&B client API and tools	1.0.5	../../../../../../../glite-web/egee/packages/R1.2/R20050715/bin/rhel30/i386/RPMS/glite-lb-client-1.0.5-1.i386.rpm
org.glite.lb-client.interface	L&B client library header files	1.0.3	../../../../../../../glite-web/egee/packages/R1.2/R20050715/bin/rhel30/i386/RPMS/glite-lb-client-interface-1.0.3-1.i386.rpm
org.glite.lb.common	L&B common subroutines library	1.1.6	../../../../../../../glite-web/egee/packages/R1.2/R20050715/bin/rhel30/i386/RPMS/glite-lb-common-1.1.6-1.i386.rpm
org.glite.lb.logger	L&B local logger	1.0.3	../../../../../../../glite-web/egee/packages/R1.2/R20050715/bin/rhel30/i386/RPMS/glite-lb-logger-1.0.3-1.i386.rpm
org.glite.rgma-api-java	Java API for R.GMA	4.1.5	../../../../../../../glite-web/egee/packages/R1.2/R20050715/bin/rhel30/noarch/RPMS/glite-rgma-api-java-4.1.5-1.noarch.rpm
org.glite.rgma-base	R.GMA basic configuration and documentation	4.1.19	../../../../../../../glite-web/egee/packages/R1.2/R20050715/bin/rhel30/noarch/RPMS/glite-rgma-base-4.1.19-1.noarch.rpm
org.glite.rgma-common.config	gLite rgma common configuration items installation	5.0.0	../../../../../../../glite-web/egee/packages/R1.2/R20050715/bin/rhel30/noarch/RPMS/glite-rgma-common-config-5.0.0-1.noarch.rpm
org.glite.rgma-servicetool	R.GMA service tool	4.1.19	../../../../../../../glite-web/egee/packages/R1.2/R20050715/bin/rhel30/noarch/RPMS/glite-rgma-servicetool-4.1.19-3.noarch.rpm
org.glite.rgma-servicetool-config	gLite R.GMA servicetool installation	5.0.0	../../../../../../../glite-web/egee/packages/R1.2/R20050715/bin/rhel30/noarch/RPMS/glite-rgma-servicetool-config-5.0.0-1.noarch.rpm
org.glite.rgma-stubs-servlet-java	Java client implementation stubs for R.GMA	4.1.12	../../../../../../../glite-web/egee/packages/R1.2/R20050715/bin/rhel30/noarch/RPMS/glite-rgma-stubs-servlet-java-4.1.12-1.noarch.rpm
org.glite.security.proxyrenewal	Proxy renewal daemon	1.0.13	../../../../../../../glite-web/egee/packages/R1.2/R20050715/bin/rhel30/i386/RPMS/glite-security-proxyrenewal-1.0.13-1.i386.rpm
org.glite.security.trustmanager	The java certificate path checkin for proxy certs in SSL with plugins for tomcat and axis.	1.7.3	../../../../../../../glite-web/egee/packages/R1.2/R20050715/bin/rhel30/noarch/RPMS/glite-security-trustmanager-1.7.3-1.noarch.rpm
org.glite.security-util.java	The java utilities library for security	1.1.2	../../../../../../../glite-web/egee/packages/R1.2/R20050715/bin/rhel30/noarch/RPMS/glite-security-util-java-1.1.2-2.noarch.rpm
org.glite.security-utils.config	gLite Security Utilities configuration files	1.0.2	../../../../../../../glite-web/egee/packages/R1.2/R20050715/bin/rhel30/noarch/RPMS/glite-security-utils-config-1.0.2-2.noarch.rpm
org.glite.security-voms-api.c	VOMS API for C	1.5.9	../../../../../../../glite-web/egee/packages/R1.2/R20050715/bin/rhel30/i386/RPMS/glite-security-voms-api-c-1.5.9-2.i386.rpm
org.glite.wms.broker		1.0.1	../../../../../../../glite-web/egee/packages/R1.2/R20050715/bin/rhel30/i386/RPMS/glite-wms-broker-1.0.1-1.i386.rpm
org.glite.wms.brokerinfo		1.2.4	../../../../../../../glite-web/egee/packages/R1.2/R20050715/bin/rhel30/i386/RPMS/glite-wms-brokerinfo-1.2.4-1.i386.rpm
org.glite.wms-brokerinfo.access	Brokerinfo access	1.0.1	../../../../../../../glite-web/egee/packages/R1.2/R20050715/bin/rhel30/i386/RPMS/glite-wms-brokerinfo-access-1.0.1-1.i386.rpm
org.glite.wms.classad_plugin		1.0.0	../../../../../../../glite-web/egee/packages/R1.2/R20050715/bin/rhel30/i386/RPMS/glite-wms-classad_plugin-1.0.0-1.i386.rpm
org.glite.wms.common		1.1.5	../../../../../../../glite-web/egee/packages/R1.2/R20050715/bin/rhel30/i386/RPMS/glite-wms-common-1.1.5-1.i386.rpm
org.glite.wms.config	gLite Workload Management System node configuration files	2.0.0	../../../../../../../glite-web/egee/packages/R1.2/R20050715/bin/rhel30/noarch/RPMS/glite-wms-config-2.0.0-2.noarch.rpm
org.glite.wms.config	gLite Workload Management System node configuration files	2.0.1	../../../../../../../glite-web/egee/packages/R1.2/R20050715/bin/rhel30/noarch/RPMS/glite-wms-config-2.0.1-1.noarch.rpm
org.glite.wms.config	gLite Workload Management System node configuration files	2.0.2	../../../../../../../glite-web/egee/packages/R1.2/R20050715/bin/rhel30/noarch/RPMS/glite-wms-config-2.0.2-1.noarch.rpm
org.glite.wms.configuration		1.0.4	../../../../../../../glite-web/egee/packages/R1.2/R20050715/bin/rhel30/i386/RPMS/glite-wms-configuration-1.0.4-1.i386.rpm
org.glite.wms.helper		1.0.8	../../../../../../../glite-web/egee/packages/R1.2/R20050715/bin/rhel30/i386/RPMS/glite-wms-helper-1.0.8-1.i386.rpm
org.glite.wms.interactive		1.0.0	../../../../../../../glite-web/egee/packages/R1.2/R20050715/bin/rhel30/i386/RPMS/glite-wms-interactive-1.0.0-1.i386.rpm
org.glite.wms.ism		1.3.2	../../../../../../../glite-web/egee/packages/R1.2/R20050715/bin/rhel30/i386/RPMS/glite-wms-ism-1.3.2-1.i386.rpm
org.glite.wms.jdl		1.1.5	../../../../../../../glite-web/egee/packages/R1.2/R20050715/bin/rhel30/i386/RPMS/glite-wms-jdl-1.1.5-2.i386.rpm
org.glite.wms.jobsubmission	WMS job submission module	1.1.0	../../../../../../../glite-web/egee/packages/R1.2/R20050715/bin/rhel30/i386/RPMS/glite-wms-jobsubmission-1.1.0-1.i386.rpm
org.glite.wms.manager	WMS manager service	1.2.3	../../../../../../../glite-web/egee/packages/R1.2/R20050715/bin/rhel30/i386/RPMS/glite-wms-manager-1.2.3-1.i386.rpm
org.glite.wms-manager-ns.commands		1.0.3	../../../../../../../glite-web/egee/packages/R1.2/R20050715/bin/rhel30/i386/RPMS/glite-wms-manager-ns-commands-1.0.3-1.i386.rpm
org.glite.wms-manager-ns.common		1.0.0	../../../../../../../glite-web/egee/packages/R1.2/R20050715/bin/rhel30/i386/RPMS/glite-wms-manager-ns-common-1.0.0-1.i386.rpm
org.glite.wms-manager-ns.daemon		1.0.6	../../../../../../../glite-web/egee/packages/R1.2/R20050715/bin/rhel30/i386/RPMS/glite-wms-manager-ns-daemon-1.0.6-2.i386.rpm
org.glite.wms.matchmaking		1.1.1	../../../../../../../glite-web/egee/packages/R1.2/R20050715/bin/rhel30/i386/RPMS/glite-wms-matchmaking-1.1.1-1.i386.rpm
org.glite.wms.purger		1.0.4	../../../../../../../glite-web/egee/packages/R1.2/R20050715/bin/rhel30/i386/RPMS/glite-wms-purger-1.0.4-1.i386.rpm
org.glite.wms.rls		1.0.0	../../../../../../../glite-web/egee/packages/R1.2/R20050715/bin/rhel30/i386/RPMS/glite-wms-rls-1.0.0-1.i386.rpm
org.glite.wms-thirdparty.bypass		2.5.3	../../../../../../../glite-web/egee/packages/R1.2/R20050715/bin/rhel30/i386/RPMS/glite-wms-thirdparty-bypass-2.5.3-9.i386.rpm
org.glite.wms-thirdparty.globus_gridftp_server		1.5.2	../../../../../../../glite-web/egee/packages/R1.2/R20050715/bin/rhel30/i386/RPMS/glite-wms-thirdparty-globus_gridftp_server-1.5.2-1.i386.rpm
org.glite.wms-utils.exception		1.0.1	../../../../../../../glite-web/egee/packages/R1.2/R20050715/bin/rhel30/i386/RPMS/glite-wms-utils-exception-1.0.1-1.i386.rpm
org.glite.wms-utils.jobid		1.0.0	../../../../../../../glite-web/egee/packages/R1.2/R20050715/bin/rhel30/i386/RPMS/glite-wms-utils-jobid-1.0.0-1.i386.rpm
org.glite.wms-utils.tls		1.0.1	../../../../../../../glite-web/egee/packages/R1.2/R20050715/bin/rhel30/i386/RPMS/glite-wms-utils-tls-1.0.1-1.i386.rpm

4. Dependencies

The gLite Workload Management System module v. 2.0.2 has the following dependencies:

Component name	Version	RPM file name
gLite Security Utilities	1.0.1	../../../../../../../glite-web/egee/packages/R1.1/R20050430/installers/glite-security-utils_installer.sh
gLite R-GMA Service Publisher	4.2.0	../../../../../../../glite-web/egee/packages/R1.1/R20050430/installers/glite-security-utils_installer.sh
gLite C/C++ Essentials	1.1.1	../../../../../../../glite-web/egee/packages/externals/bin/rhel30/RPMS/glite-essentials-cpp-1.1.1-1_EGEE.i386.rpm
Ares	1.1.1	../../../../../../../glite-web/egee/packages/externals/bin/rhel30/RPMS/ares-1.1.1-EGEE.i386.rpm
Condor	6.7.9	../../../../../../../glite-web/egee/packages/externals/bin/rhel30/RPMS/condor-6.7.9-1.i386.rpm
EDG Replica Manager Client Suite	2.3.1	../../../../../../../glite-web/egee/packages/externals/bin/rhel30/RPMS/edg-replica-manager-client-cpp_gcc3_2_2-norgma_suite-2.3.1-1_sl3_EGEE.i386.rpm
GPT	VDT 1.2.2	../../../../../../../glite-web/egee/packages/externals/bin/rhel30/RPMS/gpt-VDT1.2.2rh9-1.i386.rpm
Java SDK/JRE	1.4.2	http://java.sun.com/j2se/1.4.2/download.html
myproxy	1.14	../../../../../../../glite-web/egee/packages/externals/bin/rhel30/RPMS/myproxy-1.14-EGEE.i386.rpm
MySQL-client	4.1.11	../../../../../../../glite-web/egee/packages/externals/bin/rhel30/RPMS/MySQL-client-4.1.11-0.i386.rpm
perl-Expect.pm	1.01	../../../../../../../glite-web/egee/packages/externals/bin/rhel30/RPMS/per-Expect.pm-1.01-9.i386.rpm
VDT Globus Essentials	VDT 1.2.2	../../../../../../../glite-web/egee/packages/externals/bin/rhel30/RPMS/vdt_globus_essentials-VDT1.2.2rh9-1.i386.rpm
VDT Globus Information Service Essentials	VDT 1.2.2	../../../../../../../glite-web/egee/packages/externals/bin/rhel30/RPMS/vdt_globus_info_essentials-VDT1.2.2rh9-1.i386.rpm
VDT Globus SDK	VDT 1.2.2	../../../../../../../glite-web/egee/packages/externals/bin/rhel30/RPMS/vdt_globus_sdk-VDT1.2.2rh9-1.i386.rpm

5. Known bugs and issues

This release has the following known bugs and issues. Bug numbers refer to the gLite Bug Tracking system database hosted on the CERN Savannah system at https://savannah.cern.ch/bugs/?group=jra1mdw .

Jobs submitted with RetryCount set to 0 are resubmitted multiple times without visible reason. Currently being investigated.
The current release doesn’t support submission of batch jobs and shallow resubmission. This will be added in future releases
Relevance unclear as most services don’t recognize limited proxies. Cou
No removal procedure is provided with this release apart from the removal of the RPMS. Any account, group or other resource created during the module configuration must be manually cleaned.
The WMS system cannot at the moment submit jobs to a CE using Condor as a batch system (‘vanilla’ universe). This will be fixed in a future release

Known open bugs:

Bug number	Description
#8536	jobs remain in a ready state for ever, until the proxy expires and they abort
#8540	job sumbission error "Got a job held event, reason: "
#8600	glite-job-submi Error: UI_NO_NS_CONTACT
#8759	Jobs submitted with RetryCount set to 0 are resubmitted multiple times without visible reason
#8786	Support for shallow resubmission
#8942	WMS establishes continuous connections to all the CEs in the BDII
#8997	IOException when submitting jobs in a loop
#8998	Job gets Aborted by WMS many times without obvious reason
#9016	Job remains in Running state for long time after termination.
#9040	org.glite.wms.client: Segmentation fault in case of unrecognized option
#9087	memory error in VOMSAuthZ instance creation
#9194	Missing information from logs
#9256	Incompatibility between gLite jobwrapper and LCG WNs - wrong env. variable
#9391	Aborted jobs stay a long time in the CE queues
#9522	WMProxy purge operation doesn't properly log PURGED event for DAG nodes
#9541	jdl4java: special attributes removed from the jdl
#9545	Log monitor crashes on failed DAG removal.
#9609	Jobs should be rejected if proxy renewal can't succeed
#9628	Empty BrokerInfo file created by the WM for parametric and DAG job submissions
#9634	JDL for collections:node descriptions are not loaded from files

Fixed in this release, but not yet tested:

Bug number	Description
#8499	WMS UI links different flavors of the same Globus libs
#8500	Long DAGs fail with Cannot Parse ClassAd error on WMS
#8628	WMS: Configuration script fails (only the first run) after changing the glite.user.name
#8637	the system doesn't tell you where you find the output of a DAG job
#8640	WMS: running process mixed-up after change in upgrade of 'glite.user.name'
#8663	intermittent availability of CEs in the WMS system
#8681	gsoap exception in Match-Making with the StorageIndex ( InputData)
#8852	glite-job-list-match is stuck
#8899	Step Weight is ignored by the NS ( unknown)
#9030	api-cpp subission&status cascade crashes
#9031	secure connection to data catalog during list match
#9136	glite-wms-job-cancel : the same question twice
#9137	glite-wms-job-output/cancel: wrong check of the jobid syntax
#9139	glite-wms-job-list-match: error message for jobs that are not supported
#9140	glite-wms-job-cancel: - - input option
#9588	CEmon/WMS loosing CEIds

6. Bugs closed since last release

This release fixes the following bugs and issues. Bug numbers refer to the gLite Bug Tracking system database hosted on the CERN Savannah system at https://savannah.cern.ch/bugs/?group=jra1mdw

Bug number	Description
#4631	conflicting files in packages
#4893	WMS UI crashes with edg-job-status -all
#5089	Use of LCG-2 UI with glite does not work with pbs/blah CE
#5094	condor_master should be started as edguser
#5095	Condor config file has incorrect hardwired values
#5361	Cannot submit job to gundam
#6397	WMS Network Server daemon has a non standard name
#6558	Jobs on the prototype fail
#6580	output of glite-job-submit still uses "edg-job-id"
#6586	JDL & Datamanagement
#6596	Transient problems with VOMS proxies on the WMS UI
#6613	Missing time zone in job logging info
#6614	The lastUpdateTime value in job status report is using timezone CEST
#6650	glite-wms-ns status returns error code 0 when it's not running
#6651	glite-wms-lm status returns error code 0 when it's not running
#6652	The glite-wms-check-daemons.sh script contains various problems
#6715	Possible wrong tag of org.glite.wms-ui.cli-python module used for Ibuild
#6793	Cannot specify JDL with access to StorageIndex
#6813	Failed to submit a job
#7083	API_NATIVE_ERROR occurs when executing glite-job-submit
#7110	Spurions log file from glite-job-submit
#7209	no man pages for WMS commands
#7210	in-line help broken for glite-job-logging-info and -job-output
#7211	WMS in-line help pager produces bad page breaks and poor formatting
#7232	Codor problem with DAGs
#7464	job-list-macth hangs
#7991	rpms needed for interactive jobs support are not installed by the WMS deployment module
#8740	glite-job-list-match refuses to match a dag even if the dag can be run without problems
#8999	Jobs are running at WNs, but cannot be accessed by WMS UI
#9000	Several 'zombie' jobs on gLite/WMS prototype testbed
#9227	Wring exit code reported by glite-job-status
#9415	job submission fragile with respect to unexpected output