gLite > gLite 3.1 > glite-WMS > Update to glite-WMS 3.1.1-0  
 
 

 

 

gLite 3.1

glite-WMS - Update to version 3.1.1-0


Date 29.05.08
Priority Normal

Description

glite-WMS

This update introduces the first release of the gLite 3.1 WMS service for SL4 platform. All sites running the gLite 3.0 WMS versions (SL3) are encouraged to replace their instances with this newer version. Changes with respect to the current production version (SL3) are the following:
  • General performances and robustness improvements
  • Several bugs fixed
  • Bottlenecks analyzed and fixed
  • Improved job submission rate and service stability
  • Experimental support for JobDir, a mailbox-based persistent communication mechanism between local processes.
The new release also brings about certain deprecations:
  • Partitionable/Checkpointable jobs are deprecated.
  • NS server and client deprecated and removed from the distribution. This implies that the commands: glite-job-submit, glite-job-list-match, glite-job-output, glite-job-cancel and glite-job-get-chkpt are no more available. [Please, note that the wmproxy counterparts of those commands (glite-wms-job-*) can be used instead.]
  • Also the client APIs for JAva and c++ in the packages org.glite.wms-ui.api-cpp, org.glite.wms-ui.api-java and org.glite.wms-ui.wrap-java, which depended on NS have been deprecated. [Please, note that the wmproxy counterparts provided in the packages org.glite.wms.wmproxy-api-* can be used instead.]
  • Support for the multi-protocol sandbox file transfer: gsiftp, https.
The update introduces, among others, the following improvements of the WMS server:
  • Bulk Matchmaking for job collections: single matchmaking for all similar jobs of a collection.
  • Asynchronous WMProxy Job Start operation: upon job submission context is returned to user as soon as the request has been accepted by the system. Time consuming operations are carried out behind the scene.
  • Direct management of collections instead of relying on DAGMan.
The following improvements have been introduced in the WMS client side :
  • Added logging-info /status new query options
  • Added glite-wms-job-info command: allows getting job information available at the WMS (JDL, associated delegation Id, time to expiration of the associated delegated proxy, etc).
  • new query options added to glite-job-logging-info/glite-job-status commands
The following improvements have been introduced for the Job Wrapper:
  • VO hook (selection of the middleware version).
  • Customization points (for resource admins).
  • OSB limit and truncation mechanism.
  • Allowing interoperability with OSG.
As a main hardware requirement, 4GB of RAM is recommended for the production WMS servers.

Recommendations for release and deployment

There is need for extra configuration (special indexes) for certain Virtual Organizations, such as Atlas and CMS, on the LB and WMS services. For details, please see the following document (by Yvan Calas):

https://twiki.cern.ch/twiki/bin/view/FIOgroup/ScLCGWms31ConfigVO

IMPORTANT There are the following Known Issues in this release:
  • DAG job doesn't work
  • As reported in the bug #35244, job submission fails when using voms proxies with multiple roles. The workaround is to change the line 24 of the file /opt/glite/etc/lcmaps/lcmaps.db.gridftp from " -mapmin 1" to " -mapmin 0" and the line 33 from " -override_inconsistency" to " -do_not_use_secondary_gids".
  • As reported in the bug #36982, the value of IsmBlackList in the WorkloadManager section of /opt/glite/etc/glite_wms.conf has to be changed to avoid submissions to CREAM CE. Please set 'IsmBlackList = {".*8443\/cream.*"};'. This will be fixed in the next WMS configuration (glite-yaim-wms-4.0.1-9).
  • As reported in the bug #36669, if the user proxy is mapped to a static account instead of a pool account, the job-list-match command would work, but the job-submit command would fail. As a workaround, only pool accounts should be used. As a configuration example, please have a look into the /opt/glite/yaim/examples/users.conf file provided by the glite-yaim-core package.
  • As reported in the bug #35357, if only one file is specified in the OutputSandbox, the method getOutputFileList of WMProxy API Python returns an empty list instead of the file as expected.
  • As reported in the bug #36432, on a WMS or LB 3.1 node, the execution of the "/etc/init.d/gLite start" command modifies the terminal setting for the special character erase in the following way:
    Before the execution: erase = ^?; After the execution: erase = ^H;


Please also have a look at the list of known issues.

This update fixes various bugs. For the full list of bugs, please see list below.

Fixed bugs

Number Description
 #14453 Nodes without JDL...
 #14744 lbserver and lbproxy service status checks always fail
 #15569 obsolete local logger start message....(European DataGrid...2002....)
 #21935 glite-job-status -all dosn't work with longer proxy chain
 #25379 missing LB man pages
 #26811 Please update the L&B WS interface in production to the glite_3.1 version
 #27555 glite-lb-bkserverd processes can hog CPU and memory with transactional DB
 #27664 glite-lb-interlogd logs with wrong daemon name
 #28266 LB-client - free() invalid pointer error
 #28668 Interoperability problems between LB locallogger on VDT 1.2 and bkserver on VDT 1.6
 #28842 Wrong glite::lb::Event::DONE_* enumeration values
 #30256 edg_wll_Purge(): Transport endpoint is not connected
 #31954 All jobs finished but the (parametric) node is Running
 #34416 ReallyRunning event not logged by LRMS
 #36476 IsmUpdateRate default value too high
 #7324 lb-bkserver is running with no pid

Updated rpms

Name Version Full RPM name Description
bdii 3.9.1-5 bdii-3.9.1-5.noarch.rpm bdii
c-ares 1.3.0-4.slc4 c-ares-1.3.0-4.slc4.i386.rpm c-ares-1.3.0-4.slc4.i686.rpm c-ares v. 1.3.0 c-ares is a C library that performs DNS requests and name resolves asynchronously
classads 0.9.8-2.slc4 classads-0.9.8-2.slc4.i386.rpm classads-0.9.8-2.slc4.i686.rpm classads v. 0.9.8-2 C++ implementation of Condor Classified Advertisements used for describing jobs, workstations, and other resources.
condor-lcg 1.1.0-1 condor-lcg-1.1.0-1.i386.rpm Condor components modified by LCG
condor 6.8.4-1 condor-6.8.4-1.rhel3.i386.rpm Condor 6.8.4
fcgi 2.4.0-1_EGEE.slc4 fcgi-2.4.0-1_EGEE.slc4.i386.rpm fcgi v. 2.4.0
fetch-crl 2.6.3-1 fetch-crl-2.6.3-1.noarch.rpm Tool for periodic retrieval of Certificate Revocation Lists
glite-WMS 3.1.1-0 glite-WMS-3.1.1-0.i386.rpm gLite metapackage (glite-WMS)
glite-info-generic 2.0.2-3 glite-info-generic-2.0.2-3.noarch.rpm glite-info-generic
glite-info-templates 1.0.0-8 glite-info-templates-1.0.0-8.noarch.rpm glite-info-templates
glite-initscript-globus-gridftp 1.0.2-1 glite-initscript-globus-gridftp-1.0.2-1.noarch.rpm glite-initscript-globus-gridftp
glite-jdl-api-cpp 3.1.14-1.slc4 glite-jdl-api-cpp-3.1.14-1.slc4.i386.rpm org.glite.jdl.api-cpp v. 3.1.14-1
glite-lb-client-interface 3.1.1-1.slc4 glite-lb-client-interface-3.1.1-1.slc4.i386.rpm org.glite.lb.client-interface
glite-lb-client 3.1.5-1.slc4 glite-lb-client-3.1.5-1.slc4.i386.rpm org.glite.lb.client
glite-lb-common 6.1.1-2.slc4 glite-lb-common-6.1.1-2.slc4.i386.rpm org.glite.lb.common
glite-lb-logger 1.4.9-2.slc4 glite-lb-logger-1.4.9-2.slc4.i386.rpm org.glite.lb.logger
glite-lb-proxy 1.5.2-2.slc4 glite-lb-proxy-1.5.2-2.slc4.i386.rpm org.glite.lb.proxy
glite-lb-server-bones 2.2.6-1.slc4 glite-lb-server-bones-2.2.6-1.slc4.i386.rpm org.glite.lb.server-bones
glite-rgma-api-cpp 5.0.15-5.slc4 glite-rgma-api-cpp-5.0.15-5.slc4.i386.rpm org.glite.rgma.api-cpp v. 5.0.15
glite-rgma-api-c 5.0.10-6.slc4 glite-rgma-api-c-5.0.10-6.slc4.i386.rpm org.glite.rgma.api-c v. 5.0.10
glite-rgma-base 5.0.7-1 glite-rgma-base-5.0.7-1.noarch.rpm R-GMA basic configuration and documentation
glite-security-gsoap-plugin 1.5.2-1.slc4 glite-security-gsoap-plugin-1.5.2-1.slc4.i386.rpm org.glite.security.gsoap-plugin
glite-security-lcas-interface 1.3.6-2.slc4 glite-security-lcas-interface-1.3.6-2.slc4.i386.rpm org.glite.security.lcas-interface v. 1.3.6-2
glite-security-lcas-lcmaps-gt4-interface 0.0.13-2.slc4 glite-security-lcas-lcmaps-gt4-interface-0.0.13-2.slc4.i386.rpm This component implements the GT4 mapping_and_authz interface for the globus gatekeeper, gridftpd and gsi-opensshd to use the LCAS and LCMAPS frameworks
glite-security-lcas-plugins-basic 1.3.2-2.slc4 glite-security-lcas-plugins-basic-1.3.2-2.slc4.i386.rpm This package contains three basic authorization plugins for LCAS: 1) allow-user module (currently the gridmapfile is used) 2) ban-user module 3) timeslots availability module
glite-security-lcas-plugins-voms 1.3.4-3.slc4 glite-security-lcas-plugins-voms-1.3.4-3.slc4.i386.rpm org.glite.security.lcas-plugins-voms v. 1.3.4-3
glite-security-lcas 1.3.7-1.slc4 glite-security-lcas-1.3.7-1.slc4.i386.rpm org.glite.security.lcas v. 1.3.7-1
glite-security-lcmaps-plugins-basic 1.3.7-3.slc4 glite-security-lcmaps-plugins-basic-1.3.7-3.slc4.i386.rpm This package provides the timeslot (fabric openings hours), poolaccount selection, localaccount selection, LDAP enforcement and POSIX enforcement (changing the process ownership to the mapped user
glite-security-lcmaps-plugins-voms 1.3.7-3.slc4 glite-security-lcmaps-plugins-voms-1.3.7-3.slc4.i386.rpm This package provides the LCMAPS plugins for specialised VOMS handling: voms_localaccount, voms_localgroup, voms_poolgroup and voms_poolacount. (It is recommended to use the voms_localgroup and voms_poolaccount)
glite-security-lcmaps-without-gsi 1.4.2-1.slc4 glite-security-lcmaps-without-gsi-1.4.2-1.slc4.i386.rpm LCMAPS build without GSI (and also without OpenSSL features)
glite-security-lcmaps 1.4.2-1.slc4 glite-security-lcmaps-1.4.2-1.slc4.i386.rpm org.glite.security.lcmaps v. 1.4.2-1
glite-security-proxyrenewal 1.3.4-2.slc4 glite-security-proxyrenewal-1.3.4-2.slc4.i386.rpm org.glite.security.proxyrenewal v. 1.3.4-2
glite-security-voms-api-cpp 1.8.3-3.slc4 glite-security-voms-api-cpp-1.8.3-3.slc4.i386.rpm org.glite.security.voms-api-cpp v. 1.8.3.3
glite-security-voms-api-c 1.8.3-3.slc4 glite-security-voms-api-c-1.8.3-3.slc4.i386.rpm org.glite.security.voms-api-c v. 1.8.3_3
glite-service-discovery-api-c 2.2.2-2.slc4 glite-service-discovery-api-c-2.2.2-2.slc4.i386.rpm gLite Service Discovery core API and library
glite-service-discovery-bdii-c 2.2.2-2.slc4 glite-service-discovery-bdii-c-2.2.2-2.slc4.i386.rpm Command line interface for Service Discovery library.
glite-service-discovery-rgma-c 2.0.5-2.slc4 glite-service-discovery-rgma-c-2.0.5-2.slc4.i386.rpm gLite Service Discovery R-GMA plug-in
glite-version 3.1.0-1.slc4 glite-version-3.1.0-1.slc4.i386.rpm glite-version
glite-wms-brokerinfo 3.1.10-1.slc4 glite-wms-brokerinfo-3.1.10-1.slc4.i386.rpm org.glite.wms.brokerinfo v. 3.1.10-1
glite-wms-broker 3.1.5-3.slc4 glite-wms-broker-3.1.5-3.slc4.i386.rpm org.glite.wms.broker v. 3.1.5-1
glite-wms-checkpointing 3.1.2-3.slc4 glite-wms-checkpointing-3.1.2-3.slc4.i386.rpm org.glite.wms.checkpointing v. 3.1.2-1
glite-wms-classad_plugin 3.1.8-2.slc4 glite-wms-classad_plugin-3.1.8-2.slc4.i386.rpm org.glite.wms.classad_plugin v. 3.1.8-1
glite-wms-common 3.1.19-3.slc4 glite-wms-common-3.1.19-3.slc4.i386.rpm org.glite.wms.common v. 3.1.19-3
glite-wms-configuration 3.1.10-1.slc4 glite-wms-configuration-3.1.10-1.slc4.i386.rpm org.glite.wms.configuration v. 3.1.10-1
glite-wms-helper 3.1.17-7.slc4 glite-wms-helper-3.1.17-7.slc4.i386.rpm org.glite.wms.helper v. 3.1.17-7_MPI-2
glite-wms-interactive 3.1.5-1.slc4 glite-wms-interactive-3.1.5-1.slc4.i386.rpm org.glite.wms.interactive v. 3.1.5-1
glite-wms-ism 3.1.15-2.slc4 glite-wms-ism-3.1.15-2.slc4.i386.rpm org.glite.wms.ism v. 3.1.15
glite-wms-jobsubmission 3.1.9-2.slc4 glite-wms-jobsubmission-3.1.9-2.slc4.i386.rpm org.glite.wms.jobsubmission v. 3.1.9-1
glite-wms-manager 3.1.30-1.slc4 glite-wms-manager-3.1.30-1.slc4.i386.rpm org.glite.wms.manager v. 3.1.30
glite-wms-matchmaking 3.1.5-1.slc4 glite-wms-matchmaking-3.1.5-1.slc4.i386.rpm org.glite.wms.matchmaking v. 3.1.5-1
glite-wms-partitioner 3.1.2-2.slc4 glite-wms-partitioner-3.1.2-2.slc4.i386.rpm org.glite.wms.partitioner v. 3.1.2-1
glite-wms-purger 3.1.8-3.slc4 glite-wms-purger-3.1.8-3.slc4.i386.rpm org.glite.wms.purger v. 3.1.8-3
glite-wms-thirdparty-bypass 3.1.3-3.slc4 glite-wms-thirdparty-bypass-3.1.3-3.slc4.i386.rpm org.glite.wms.thirdparty-bypass v. 3.1.3-3
glite-wms-utils-classad 3.1.6-1.slc4 glite-wms-utils-classad-3.1.6-1.slc4.i386.rpm org.glite.wms-utils.classad v. 3.1.6
glite-wms-utils-exception 3.1.3-1.slc4 glite-wms-utils-exception-3.1.3-1.slc4.i386.rpm org.glite.wms-utils.exception v. 3.1.3
glite-wms-utils-jobid 3.1.3-1.slc4 glite-wms-utils-jobid-3.1.3-1.slc4.i386.rpm org.glite.wms-utils.jobid v. 3.1.3
glite-wms-utils-tls 3.1.3-1.slc4 glite-wms-utils-tls-3.1.3-1.slc4.i386.rpm org.glite.wms-utils.tls
glite-wms-wmproxy 3.1.30-4.slc4 glite-wms-wmproxy-3.1.30-4.slc4.i386.rpm Custom Spec file / libtar linked dynamically
glite-yaim-core 4.0.4-2 glite-yaim-core-4.0.4-2.noarch.rpm glite-yaim-core
glite-yaim-wms 4.0.1-8 glite-yaim-wms-4.0.1-8.noarch.rpm glite-yaim-wms
glue-schema 1.3.0-3 glue-schema-1.3.0-3.noarch.rpm glue-schema
gpt VDT1.6.0x86_rhas_4-1 gpt-VDT1.6.0x86_rhas_4-1.i386.rpm The Grid Packaging Toolkit (GPT)
gridsite-apache 1.1.18.1-1 gridsite-apache-1.1.18.1-1.i386.rpm GridSite mod_gridsite module for Apache httpd
gridsite-shared 1.1.18.1-1 gridsite-shared-1.1.18.1-1.i386.rpm GridSite shared library and core documentation
lcg-expiregridmapdir 2.0.0-1 lcg-expiregridmapdir-2.0.0-1.noarch.rpm lcg-expiregridmapdir
lcg-vomscerts 5.0.0-1 lcg-vomscerts-5.0.0-1.noarch.rpm lcg-vomscerts
log4cxx 0.9.7-1.slc4 log4cxx-0.9.7-1.slc4.i386.rpm log4cxx-0.9.7-1.slc4.i686.rpm log4cxx v. 0.9.7 log4cxx is library of C++ classes for flexible logging. Log4cxx is a port to C++ of the Log4j project.
mod_fastcgi 2.4.3-1.slc4 mod_fastcgi-2.4.3-1.slc4.i386.rpm mod_fastcgi v. 2.4.3
myproxy VDT1.6.0x86_rhas_4-1 myproxy-VDT1.6.0x86_rhas_4-1.i386.rpm Virtual Data Toolkit
vdt_globus_data_server VDT1.6.1x86_rhas_4-5 vdt_globus_data_server-VDT1.6.1x86_rhas_4-5.i386.rpm Virtual Data Toolkit
vdt_globus_essentials VDT1.6.1x86_rhas_4-6 vdt_globus_essentials-VDT1.6.1x86_rhas_4-6.i386.rpm Virtual Data Toolkit
vdt_globus_info_essentials VDT1.6.0x86_rhas_4-1 vdt_globus_info_essentials-VDT1.6.0x86_rhas_4-1.i386.rpm Virtual Data Toolkit
xerces-c 2.7.0-1.slc4 xerces-c-2.7.0-1.slc4.i386.rpm xerces-c-2.7.0-1.slc4.i686.rpm xerces-c v. 2.7.0 High performance, fully compliant XML parser.

The RPMs can be updated using yum via

Service reconfiguration after update

Service must be reconfigured.

Service restart after update

Service must be restarted.

How to apply the fix

  1. Update the RPMs (see above)
  2. Update configuration (see above)
  3. Restart the service if necessary (see above)