gLite Data Management Single Catalog (Fireman) for Oracle

1. Release Description

This release contains the gLite Data Management Single Catalog (Fireman) for Oracle module v. 2.0.2. The following sections provide additional information about the release content, the module dependencies, the know bugs and issues and a list of bugs closed since the previous release. For information about installing and using the gLite Data Management Single Catalog for Oracle, please refer to the gLite Installation and User Guides.

2. Changes in this Release

2.1. Changes in functionality

This release doesn’t contain any functional change, but the database schema has changed. If the service must be upgraded from gLite 1.3 to 1.4, the database must be completely removed with

glite-data-single-catalog-oracle-config.py --remove

and then a standard installation with

glite-data-single-catalog-oracle-config.py --configure

must be done.

2.2. Changes in Configuration

The following new parameters have been added to the glite-data-single-catalog-oracle.cfg.xml file:

Parameter name	Default value	Description
catalog-service-fr.ADMIN_VOMS_ATTRIBUTES	<empty>	ADMIN/superuser settings. Note that the extra priviliges defined by the settings below are combined in an OR fashion - a VOMS match OR a mapfile match will result in the client being given the extra authorisation. If both of these are empty there is no superuser defined for the service and certain functionality iss unavailable (i.e. if permissions on global default permissions are not tweaked, nobody can change them or create directories in the ROOT path. If a user's certificate contains this VOMS attribute, they are additionally permitted to do any operation upon the service including metadata bits operations. If a user's certificate contains any of these VOMS attributes, they are additionally permitted to do any operation upon the service including creating channel and VO managers. Default: <empty>
catalog-service-fr.ADMIN_MAPFILE	<empty>	If a client's certificate subject name is listed in this file, they are additionally permitted to do any operation upon the service including manage channels. Default: <empty>

The following parameters have been changed in the glite-data-single-catalog-oracle.cfg.xml file:

Parameter name

Old value

New value

Description

The following parameters have been removed from the glite-data-single-catalog-oracle.cfg.xml file:

Parameter name

Comment

3. Release contents

3.1. Glite sub-deployment modules

The gLite Single Catalog for Oracle module includes the following sub-modules:

- gLite Security Utilities

- gLite R-GMA Servicetool

The sub-modules are automatically installed with the Fireman module unless differently specified. For more information about these sub-modules please refer to the specific release notes and installation instructions.

3.2. Glite RPMS

This release of the Data Management Single Catalog (Fireman) for Oracle includes the following modules:

Component name		Version	File
glite-config	gLite configuration scripts	1.4.5	../../../../../../../glite-web/egee/packages/R1.4/R20050916/bin/rhel30/noarch/RPMS/glite-config-1.4.5-1.noarch.rpm
glite-data-catalog-service-fr	gLite Data Catalog Service (Oracle version)	2.1.8	../../../../../../../glite-web/egee/packages/R1.4/R20050916/bin/rhel30/noarch/RPMS/glite-data-catalog-service-fr-2.1.8-3.noarch.rpm
glite-data-common	common files for gLite Data Management web-services	1.3.0	../../../../../../../glite-web/egee/packages/R1.4/R20050916/bin/rhel30/noarch/RPMS/glite-data-common-1.3.0-1.noarch.rpm
glite-data-single-catalog-oracle-config	gLite Fireman Catalog for Oracle node configuration files	2.0.2	../../../../../../../glite-web/egee/packages/R1.4/R20050916/bin/rhel30/noarch/RPMS/glite-data-single-catalog-oracle-config-2.0.2-1.noarch.rpm
glite-rgma-api-java	Java API for R-GMA	4.1.5	../../../../../../../glite-web/egee/packages/R1.4/R20050916/bin/rhel30/noarch/RPMS/glite-rgma-api-java-4.1.5-1.noarch.rpm
glite-rgma-base	R-GMA basic configuration and documentation	4.1.19	../../../../../../../glite-web/egee/packages/R1.4/R20050916/bin/rhel30/noarch/RPMS/glite-rgma-base-4.1.19-1.noarch.rpm
glite-rgma-common-config	gLite rgma common configuration items installation	5.0.0	../../../../../../../glite-web/egee/packages/R1.4/R20050916/bin/rhel30/noarch/RPMS/glite-rgma-common-config-5.0.0-1.noarch.rpm
glite-rgma-servicetool	R-GMA service tool	4.1.19	../../../../../../../glite-web/egee/packages/R1.4/R20050916/bin/rhel30/noarch/RPMS/glite-rgma-servicetool-4.1.19-3.noarch.rpm
glite-rgma-servicetool-config	gLite R-GMA servicetool installation	5.1.0	../../../../../../../glite-web/egee/packages/R1.4/R20050916/bin/rhel30/noarch/RPMS/glite-rgma-servicetool-config-5.1.0-1.noarch.rpm
glite-rgma-stubs-servlet-java	Java client implementation stubs for R-GMA	4.1.13	../../../../../../../glite-web/egee/packages/R1.4/R20050916/bin/rhel30/noarch/RPMS/glite-rgma-stubs-servlet-java-4.1.13-1.noarch.rpm
glite-security-trustmanager	The java certificate path checkin for proxy certs in SSL with plugins for tomcat and axis.	1.7.3	../../../../../../../glite-web/egee/packages/R1.4/R20050916/bin/rhel30/noarch/RPMS/glite-security-trustmanager-1.7.3-1.noarch.rpm
glite-security-util-java	The java utilities library for security	1.1.2	../../../../../../../glite-web/egee/packages/R1.4/R20050916/bin/rhel30/noarch/RPMS/glite-security-util-java-1.1.2-2.noarch.rpm
glite-security-utils-config	gLite Security Utilities configuration files	1.0.6	../../../../../../../glite-web/egee/packages/R1.4/R20050916/bin/rhel30/noarch/RPMS/glite-security-utils-config-1.0.6-1.noarch.rpm

4. Dependencies

The gLite Data Management Single Catalog for Oracle module v. 2.0.2 has the following dependencies:

Component name	Version	RPM file name
Tomcat	5.0.28	../../../../../../../glite-web/egee/packages/externals/bin/rhel30/RPMS/tomcat5-5.0.28-10_EGEE.i386.rpm
Java SDK	1.4.2	http://java.sun.com/j2se/1.4.2/download.html
Oracle InstantClient	>=10.1.0.3	http://www.oracle.com/technology/software/tech/oci/instantclient/htdocs/linuxsoft.html

Java and the Oracle InstantClient cannot be freely redistributed with gLite and have to be installed before installing the gLite Data Mamagement Single Catalog for Oracle. Please consult the Sun and Oracle web sites for more information on licencing issues.

5. Known bugs and issues

This release has the following known bugs and issues. Bug numbers refer to the gLite Bug Tracking system database hosted on the CERN Savannah system at https://savannah.cern.ch/bugs/?group=jra1mdw .

Oracle FireMan timeouts with large number of clients. The issue is being investigated. So far it could be only randomly reproduced. It may be related to a race-condition in axis
glite-catalog-ls fails, the installation script doesn't seem to report any problems and nevertheless the \'ls\' instruction does not work. This is due to the need of setting correctly the codepage on Oracle. This is a pre-requisite, there's known issue with db pool library Tomcat uses and oracle jdbc drivers, the supported codepage of the database must be unicode based, i.e. WE8ISO8859P1.
The SEIndex service fails with an InternalException error. This means that data location cannot be done against an Oracle Fireman catalog (for example when submitting jobs with data input requirements)
No removal procedure is provided with this release apart from the removal of the RPMS. Any account, group or other resource created during the module configuration must be manually cleaned.

Known open bugs:

Bug number	Description
#7730	Fireman: glite-catalog-ls returns different message for MySQL and Oracle catalog when dir doesn’t exist
#10492	SC-ORA: after running –remove the schema cannot be re-created
#10491	SC-ORA: glite-catalog-ls fails
#10493	SC-ORA: if two Vos use the same back-end the configuration of the second fails
#10501	SC-ORA: The db PASSWORD is shipped in clear in the log files
#10535	Fireman Documentation: Examples in DM catalog c and c++ api do not work
#10544	SC-ORA: If the connection parameters are wrong the installation script gets stuck

Bugs fixed in this or previous releases, but not yet tested:

Bug number	Description
#5581	Cannot remove files from the catalog
#5633	Fireman catalog: "java.lang.reflect.InvocationTargetException" during bulk creation of entries
#5723	Fireman catalog: "500 Internal Server Error" response to readDir call after killing a client during a bulk create call
#5923	Fireman catalog: Exceptions while creating entries (via bulks) with 10 clients simultaneously
#6465	services/FileCatalog automatically added to the Fireman endpoint
#7785	FR_TEST.PERMISSION_UTIL not found in oracle catalogue installation
#7993	option parsing of glite-catalog-find
#8052	Problem with glite-catalog-mkdir with -p option
#8053	Problem with glite-catalog-create with -S option
#8060	Problem with glite-catalog-chkperm
#8728	SC-ORA: database password shipped in clear in command line
#9535	Fireman Oracle: glite-catalog-mkdir ignores -p parameter and returns \'Invalid parent specified\'
#9727	SC Oracle deployment: 3 fixes needed
#10312	In the release notes of the glite data single catalog for oracle there is no mention of the new parameters
#10550	glite-catalog-getattr segfaults for non-existent attributes
#10551	glite-catalog-getattr -r option not recogniseed

6. Bugs closed since last release

This is the first public release of this module. Bug numbers refer to the gLite Bug Tracking system database hosted on the CERN Savannah system at https://savannah.cern.ch/bugs/?group=jra1mdw

Bug number	Description
#6730	LFN normalisation needs to be done in Fireman catalogs
#6861	Incorrect error message from glite-catalog-ls command
#6936	glite-catalog-ls doesn't works for Oracle server?
#7089	glite-catalog-mkdir error message has a typo
#7238	glite-catalog-rmdir doesn't produce a exception when directory is not empty
#7690	problem with glite-catalog-ls
#7763	minor error in the final printout of the Oracle SC install script
#7775	missing template for the siteconfig in the Oracle SC deployment
#7784	oracle catalog deployment module should check that the java sdk is there
#7795	Single Catalog ORACLE config script does not modify tomcat5.conf file
#7796	False successful Oracle Single Catalog serv ice start message
#7833	Problem with glite-catalog-mv
#7928	Entries created in Oracle catalog are all owned by the user's group instead of the user's certificate subject
#8057	Problem with glite-catalog-chmod
#8416	glite-catalog-find returns all entries
#8437	Not possible to create dirs/files in Fireman catalog in secure mode
#8726	SC-ORA: config script fails, because CATALINA_HOME is not defined
#8982	Unable use of Oracle Fireman catalog from UI
#10538	glite-catalog commands segfault without valid VOMS proxy
#10669	Fireman Oracle: glite-catalog-create creates the entry but displays SOAP fault at getInterfaceVersion
#10770	glite-catalog-setacl passes exisiting acl in when run with '-m' option
#10857	glite-catalog-ls crashes if no proxy init

7. Previous Releases

7.1. Release 1.0.0

7.1.1. Release Description

This release contains the gLite Data Management Single Catalog for Oracle module v. 1.0.0. The following sections provide additional information about the release content, the module dependencies, the know bugs and issues and a list of bugs closed since the previous release. For information about installing and using the gLite Data Management Single Catalog for Oracle, please refer to the gLite Installation and User Guides.

7.1.2. Changes in this Release

This release doesn’t introduce any new features, just bug fixes

7.1.3. Release contents

The gLite Data Management Single Catalog for Oracle v. 1.0.0 is composed of the following gLite components:

Component name	Version	File
org.glite.deployment.data-single-catalog-oracle-config	1.0.0	../../../../../../../glite-web/egee/packages/R1.0/R20050331/installers/glite-data-local-transfer-service_installer.sh ../../../../../../../glite-web/egee/packages/R1.0/R20050331/bin/rhel30/noarch/RPMS/glite-data-single-catalog-oracle-config-1.0.0-1.noarch.rpm
org.glite.deployment.config	1.0.0	../../../../../../../glite-web/egee/packages/R1.0/R20050331/bin/rhel30/noarch/RPMS/glite-config-1.0.0-1.noarch.rpm
glite-data-catalog-service-fr	2.0.14	../../../../../../../glite-web/egee/packages/R1.0/R20050331/bin/rhel30/noarch/RPMS/glite-data-catalog-service-fr-2.0.14-1.noarch.rpm
glite-data-common	1.1.8	../../../../../../../glite-web/egee/packages/R1.0/R20050331/bin/rhel30/noarch/RPMS/glite-data-common-1.1.8-1.noarch.rpm

7.1.4. Dependencies

The gLite Data Management Single Catalog for Oracle module v. 1.0.0 has the following dependencies:

Component name	Version	RPM file name
gLite R-GMA Service Publisher	4.2.0	../../../../../../../glite-web/egee/packages/R1.0/R20050331/installers/glite-security-utils_installer.sh
Tomcat	5.0.28	../../../../../../../glite-web/egee/packages/externals/bin/rhel30/RPMS/tomcat5-5.0.28-4_EGEE.i386.rpm
Java SDK	1.4.2	http://java.sun.com/j2se/1.4.2/download.html
Oracle JDBC Drivers	10.1.0.4	http://www.oracle.com/technology/software/tech/java/sqlj_jdbc/htdocs/jdbc101040.html

Java and the Oracle JDBC drivers cannot be freely redistributed with gLite and have to be installed before installing the gLite Data Mamagement Single Catalog for Oracle. Please consult the Sun and Oracle web sites for more information on licencing issues.

7.1.5. Known bugs and issues

This release has the following known bugs and issues. Bug numbers refer to the gLite Bug Tracking system database hosted on the CERN Savannah system at https://savannah.cern.ch/bugs/?group=jra1mdw .

No removal procedure is provided with this release apart from the removal of the RPMS. Any account, group or other resource created during the module configuration must be manually cleaned.

Known open bugs:

Bug number	Description
#5581	Cannot remove files from the catalog
#6730	LFN normalisation needs to be done in Fireman catalogs
#6755	Fireman catalog - Oracle - seems top be down
#7277	glite-data-single-catalog-config v. 0.1.3 scratches my DB

Bugs fixed in this or previous releases, but not yet tested:

Bug number	Description
#5633	Fireman catalog: "java.lang.reflect.InvocationTargetException" during bulk creation of entries
#5723	Fireman catalog: "500 Internal Server Error" response to readDir call after killing a client during a bulk create call
#5923	Fireman catalog: Exceptions while creating entries (via bulks) with 10 clients simultaneously
#6465	services/FileCatalog automatically added to the Fireman endpoint

7.1.6. Bugs closed since last release

This is the first public release of this module. Bug numbers refer to the gLite Bug Tracking system database hosted on the CERN Savannah system at https://savannah.cern.ch/bugs/?group=jra1mdw

Bug number	Description
#5037	Cannot retrieve file newly added to the catalog (on lxb1432.cern.ch)
#5755	Fireman catalog: "500 Internal Server Error" response to readDir after simultaneous bulk create from multiple clients
#5820	Fireman catalog: "500 (Internal Server Error) read timeout" when calling readDir
#6573	Where is the Fireman Catalog ????
#6811	Cannot create directories in Oracle Fireman Catalog
#7063	Unable to create directory in /tmp (Oracle catalog)
#7482	catalog gives strange message if endpoint is malformed