gLite R-GMA SERVER

1. Release Description

This release contains the gLite R-GMA Server module v. 4.3.4. The following sections provide additional information about the release content, the module dependencies, the know bugs and issues and a list of bugs closed since the previous release. For information about installing and using the gLite R-GMA Server, please refer to the gLite Installation and User Guides.

2. Changes in this release

This release introduces the following changes:

The parameter rgma.site-publisher.sitename has been moved to the the Advanced Parameters section with the default value of ${HOSTNAME}. However, setting this parameter to a different value (for example a friendly name) is also possible
Bug fixes (please refer to the complete list later in these notes)

3. Release contents

The gLite R-GMA Server v. 4.3.4 is composed of the following gLite components:

Component name	Version	File
org.glite.deployment.rgma-server	4.3.4	../../../../../../../glite-web/egee/packages/R1.1/R20050430/installers/glite-rgma-server_installer.sh ../../../../../../../glite-web/egee/packages/R1.1/R20050430/bin/rhel30/noarch/RPMS/glite-rgma-config-4.3.3-1.noarch.rpm
org.glite.deployment.rgma-common	4.2.0	../../../../../../../glite-web/egee/packages/R1.1/R20050430/bin/rhel30/noarch/RPMS/glite-rgma-common-config-4.2.0-1.noarch.rpm
org.glite.deployment.config	1.1.1	../../../../../../../glite-web/egee/packages/R1.1/R20050430/bin/rhel30/noarch/RPMS/glite-config-1.1.1-3.noarch.rpm
org.glite.rgma.api-java	4.1.3	../../../../../../../glite-web/egee/packages/R1.1/R20050430/bin/rhel30/noarch/RPMS/glite-rgma-api-java-4.1.3-1.noarch.rpm
org.glite.rgma.base	4.1.14	../../../../../../../glite-web/egee/packages/R1.1/R20050430/bin/rhel30/noarch/RPMS/glite-rgma-base-4.1.14-1.noarch.rpm
org.glite.rgma.server-servlet	4.1.15	../../../../../../../glite-web/egee/packages/R1.1/R20050430/bin/rhel30/noarch/RPMS/glite-rgma-server-servlet-4.1.15-1.noarch.rpm
org.glite.rgma.standard-tables	4.1.6	../../../../../../../glite-web/egee/packages/R1.1/R20050430/bin/rhel30/noarch/RPMS/glite-rgma-standard-tables-4.1.6-1.noarch.rpm
org.glite.rgma.stubs-servlet-java	4.1.6	../../../../../../../glite-web/egee/packages/R1.1/R20050430/bin/rhel30/noarch/RPMS/glite-rgma-stubs-servlet-java-4.1.6-1.noarch.rpm
org.glite.rgma.flexible-archiver	4.1.12	../../../../../../../glite-web/egee/packages/R1.1/R20050430/bin/rhel30/noarch/RPMS/glite-rgma-flexible-archiver-4.1.12-2.noarch.rpm
org.glite.rgma.publish-site	4.1.11	../../../../../../../glite-web/egee/packages/R1.1/R20050430/bin/rhel30/noarch/RPMS/glite-rgma-publish-site-4.1.11-1.noarch.rpm
org.glite.security.trustmanager	1.6.4	../../../../../../../glite-web/egee/packages/R1.1/R20050430/bin/rhel30/i386/RPMS/glite-security-trustmanager-1.6.4-1.i386.rpm
org.glite.security.util-java	1.0.1	../../../../../../../glite-web/egee/packages/R1.1/R20050430/bin/rhel30/noarch/RPMS/glite-security-util-java-1.0.1-2.noarch.rpm

4. Dependencies

The gLite R-GMA Server module v. 4.3.3 has the following dependencies:

Component name	Version	RPM file name
gLite Security Utilities	1.0.1	../../../../../../../glite-web/egee/packages/R1.1/R20050430/installers/glite-security-utils_installer.sh
gLite R-GMA Service Publisher	4.2.0	../../../../../../../glite-web/egee/packages/R1.1/R20050430/installers/glite-rgma-servicetool_installer.sh
gLite-essentials-java	1.2.0	../../../../../../../glite-web/egee/packages/externals/bin/rhel30/RPMS/glite-essentials-java-1.2.0-2_EGEE.noarch.rpm
MySQL client	4.0.20	../../../../../../../glite-web/egee/packages/externals/bin/rhel30/RPMS/MySQL-client-4.0.20-0.i386.rpm
MySQL server	4.0.20	../../../../../../../glite-web/egee/packages/externals/bin/rhel30/RPMS/MySQL-server-4.0.20-0.i386.rpm
Tomcat5	5.0.28	../../../../../../../glite-web/egee/packages/externals/bin/rhel30/RPMS/tomcat5-5.0.28-6_EGEE.noarch.rpm
SUN Java JDK/JRE	1.4.2	http://java.sun.com

5. Known bugs and issues

This release has the following known bugs and issues. Bug numbers refer to the gLite Bug Tracking system database hosted on the CERN Savannah system at https://savannah.cern.ch/bugs/?group=jra1mdw .

Under certain conditions (under investigation), Tomcat runs out of memory when running the R-GMA server. The error may appear after 20-30 minutes of operations and requires restarting Tomcat and the R-GMA web application
Performance is poor when querying large datasets
Many error messages are very poor. This is especially a problem with the command line tool due to messages being lost in too many layers of software. Error messages are also inconsistent between API’s.
Table and column names are currently case sensitive in RGMA. To get consistent results always respect case.
Only a subset of SQL 92 is currently supported by RGMA, and continuous queries are even more restricted.
Some operations of the command line tool try to access the schema and registry directly rather than just the local RGMA server. This access may be blocked by a firewall.
The C, C++, and Python APIs and the command line tool make a new connection to the server for each API operation. When connecting to a secure server this adds a substantial overhead, so multiple API calls (e.g. lots of inserts) will run slowly. The Java API is not affected.
All VOs share the same name space and information.
Authentication is enabled by default. To use the RGMA Browser you must load your certificate into the web browser.
No removal procedure is provided with this release apart from the removal of the RPMS. Any account, group or other resource created during the module configuration must be manually cleaned.

Know open bugs:

Bug number	Description
#4438	R-GMA doesn't check types
#5703	case sensitive varchar's when creating an archiver
#6287	add a predefined query to the browser to query the new log4 table
#6288	HTTP proxy support is inconsistent
#6475	Case sensitivity for table names is problematic
#6479	csv and tsv output has vanished
#6510	Case sensitivity depends on query type
#6511	Syntax checking could be better
#6512	More parsing errors
#6514	Case sensitivity error with a secondary producer
#6977	Printable version of the APIs would be nice
#6990	Manual should refer to RC1 code
#7024	Additions to the manuals
#7188	Bad messages if a port isn't open
#7189	How do you know the primary key?
#7282	Site has disappeared from R-GMA Browser
#7349	glite-rgma-base-4.1.10-1 fails to install in LB installer
#7437	performance tests show problems when result set is big
#7449	Bad behaviour with misconfigured registry
#7542	Overriding the rgma.conf
#7600	servlet check doesn't spot time sync problem
#7631	No results returned from R-GMA
#7635	Problems with registry configuration
#7644	Need explanation of how to get info out of result sets
#7654	Detection of an error with TRUSTFILE
#7664	Bad service names?
#7676	Need to find out server limits on parameters
#7726	Bad error message in web browser
#7838	Spell checkers are good!
#7854	Clickable links in browser
#8099	Archivers are inconsistent
#8100	Slow response at CERN
#8102	RGMA test 10 is dumping core
#8106	Test 12 should not check GlueHost
#8107	Erratic test failures
#8425	Cleanup problem when using 1 registry
#8439	Components deadlocks when Registry down and do not resume
#8457	R-GMA does not remove illegal XML characters
#8479	Reassigned item: RGMA crashes on IA64
#8509	The GRRP thread ignores 'connection timed out' messages
#8518	rgma server dies frequently with OutOfMemoryError

Bugs fixed in this or previous releases, but not yet tested:

Bug number	Description
#4568	Flexible archiver dies regularly
#4646	RGMA on the SE
#4698	RGMA logging fills up /var
#4822	running start on started service is not an error.
#4823	--config on service script is not an option on flexible-archiver
#4853	rgma-servlet-status.py -pa sets up entries for the registry and schema when they are not installed
#4887	allow RetentionPeriod as a parameter in the conf file of the flexi
#5143	Too many open files using MySQL
#5251	missing error message if the service tool fails to start
#5301	R-GMA: intermittent problem with producer->archiver chain
#5411	http://hepunx.rl.ac.uk/egee/jra1-uk/glite/index.html has various errors
#5412	No provision for not being port 8080
#5425	Deleted items should be replicated
#5475	log4j jar location is hardwired
#5510	need for DB indices for DBProducer in underlying DBMS
#5809	Inserting '\'s into latest producers
#6391	Wrong cron.hourly entry
#7018	Manuals should mention case-sensitivity issues
#7090	rgma-server-setup.py ignores --registrydb and --schemadb option
#7091	rgma-install-schema.py non-intuitive to use
#7156	C++ SecondaryProducer example doesn't behave as expected
#7235	glite-rgma-server-config.py does not modify tomcat5.conf
#7292	glite-rgma-server-config.py --stop crashes if some R-GMA process is not running
#7400	R-GMA Server config script fails if no host certificates are installed
#7442	Remove redundant tables
#7446	Site name not tied to the site publisher?
#7524	R-GMA server configuration scripts need "--silent" option
#7526	R-GMA flexible archiver scripts needs --silent flag
#7541	Problems with the rgma man page
#7622	Comments on the quickstart web page
#7624	Predicate doesn\'t work?
#7655	declareTable fails with invalid predicate, but table is still declared
#7692	How one can check whether his jobs do not start because of lack of resources, or because of problem
#7703	Unclear default for the site name
#7823	rgma-flexible-archiver fails frequently due to tomcat servlets hanging
#8004	update to tomcat configuration in r-gma server deployment module

6. Bugs closed since last release

This release fixes the following bugs and issues. Bug numbers refer to the gLite Bug Tracking system database hosted on the CERN Savannah system at https://savannah.cern.ch/bugs/?group=jra1mdw

Bug number	Description
#4364	R-GMA null pointer exception
#4429	R-GMA producers dying
#4549	Flexy.log file written to /root
#4820	Request directory configuration for services files.
#4821	Cron jobs for service publishing
#4824	Could not (easily) run rgma-server-setup.py non - interactivly
#5293	Database producer URL in rgma.conf is wrong
#6046	Incorrect dependencies on log4j in rgma rpms
#6249	gLite Installation Guide - corrections for rgma
#6403	glite-rgma-server-config assumes MySQL is running.
#6917	R-GMA server logs to /tmp instead of /var/log/glite
#6980	Distribute the code examples
#6981	Missing link to manual?
#7179	RGMA depl mod. : flex archiver pid file to be removed before restart attempt
#7350	In the release notes for the RGMA server the bug #7235 is said to be fixed and ready for testing
#7409	RGMA security
#7572	rgma_flexible_archive_user_id not defined
#7593	Documentation web page
#7601	Connection not recovered after registry failure
#7689	Parsing problem + test case of the rgma server configuration script
#7701	rgma.war omitted

7. Previous Releases

7.1. release 4.3.3

7.1.1. Release Description

This release contains the gLite R-GMA Server module v. 4.3.3. The following sections provide additional information about the release content, the module dependencies, the know bugs and issues and a list of bugs closed since the previous release. For information about installing and using the gLite R-GMA Server, please refer to the gLite Installation and User Guides.

7.1.2. Changes in this release

This release introduces the following changes:

The R-GMA Server module now includes the flexible archiver service as built-in functionality. There is not anymore a separate flexible archiver module
The R-GMA Server module now includes the site publisher service as built-in functionality. There is not anymore a separate site publisher module
The R-GMA Server module now calls the service publisher module to register its own services
The common parameters required by all R-GMA modules have been moved to a separate R-GMA Common module called internally by the R-GMA Server installer (and packaged as a separate RPM)

7.1.3. Release contents

The gLite R-GMA Server v. 4.3.3 is composed of the following gLite components:

Component name	Version	File
org.glite.deployment.rgma-server	4.3.3	../../../../../../../glite-web/egee/packages/R1.0/R20050331/installers/glite-rgma-server_installer.sh ../../../../../../../glite-web/egee/packages/R1.0/R20050331/bin/rhel30/noarch/RPMS/glite-rgma-config-4.3.3-1.noarch.rpm
org.glite.deployment.rgma-common	4.2.0	../../../../../../../glite-web/egee/packages/R1.0/R20050331/bin/rhel30/noarch/RPMS/glite-rgma-common-config-4.2.0-1.noarch.rpm
org.glite.deployment.config	1.0.0	../../../../../../../glite-web/egee/packages/R1.0/R20050331/bin/rhel30/noarch/RPMS/glite-config-1.0.0-1.noarch.rpm
org.glite.rgma.api-java	4.1.3	../../../../../../../glite-web/egee/packages/R1.0/R20050331/bin/rhel30/noarch/RPMS/glite-rgma-api-java-4.1.3-1.noarch.rpm
org.glite.rgma.base	4.1.12	../../../../../../../glite-web/egee/packages/R1.0/R20050331/bin/rhel30/noarch/RPMS/glite-rgma-base-4.1.12-1.noarch.rpm
org.glite.rgma.server-servlet	4.1.14	../../../../../../../glite-web/egee/packages/R1.0/R20050331/bin/rhel30/noarch/RPMS/glite-rgma-server-servlet-4.1.14-1.noarch.rpm
org.glite.rgma.standard-tables	4.1.5	../../../../../../../glite-web/egee/packages/R1.0/R20050331/bin/rhel30/noarch/RPMS/glite-rgma-standard-tables-4.1.5-1.noarch.rpm
org.glite.rgma.stubs-servlet-java	4.1.6	../../../../../../../glite-web/egee/packages/R1.0/R20050331/bin/rhel30/noarch/RPMS/glite-rgma-stubs-servlet-java-4.1.6-1.noarch.rpm
org.glite.rgma.flexible-archiver	4.1.11	../../../../../../../glite-web/egee/packages/R1.0/R20050331/bin/rhel30/noarch/RPMS/glite-rgma-flexible-archiver-4.1.11-2.noarch.rpm
org.glite.rgma.publish-site	4.1.11	../../../../../../../glite-web/egee/packages/R1.0/R20050331/bin/rhel30/noarch/RPMS/glite-rgma-publish-site-4.1.11-1.noarch.rpm
org.glite.security.trustmanager	1.6.4	../../../../../../../glite-web/egee/packages/R1.0/R20050331/bin/rhel30/i386/RPMS/glite-security-trustmanager-1.6.4-1.i386.rpm
org.glite.security.util-java	1.0.0	../../../../../../../glite-web/egee/packages/R1.0/R20050331/bin/rhel30/noarch/RPMS/glite-security-util-java-1.0.0-2.noarch.rpm

7.1.4. Dependencies

The gLite R-GMA Server module v. 4.3.3 has the following dependencies:

Component name	Version	RPM file name
gLite Security Utilities	1.0.0	../../../../../../../glite-web/egee/packages/R1.0/R20050331/installers/glite-security-utils_installer.sh
gLite R-GMA Service Publisher	4.1.5	../../../../../../../glite-web/egee/packages/R1.0/R20050331/installers/glite-rgma-servicetool_installer.sh
gLite-essentials-java	1.2.0	../../../../../../../glite-web/egee/packages/externals/bin/rhel30/RPMS/glite-essentials-java-1.2.0-2_EGEE.noarch.rpm
MySQL client	4.0.20	../../../../../../../glite-web/egee/packages/externals/bin/rhel30/RPMS/MySQL-client-4.0.20-0.i386.rpm
MySQL server	4.0.20	../../../../../../../glite-web/egee/packages/externals/bin/rhel30/RPMS/MySQL-server-4.0.20-0.i386.rpm
Tomcat5	5.0.28	../../../../../../../glite-web/egee/packages/externals/bin/rhel30/RPMS/tomcat5-5.0.28-4_EGEE.noarch.rpm
SUN Java JDK/JRE	1.4.2	http://java.sun.com

7.1.5. Known bugs and issues

This release has the following known bugs and issues. Bug numbers refer to the gLite Bug Tracking system database hosted on the CERN Savannah system at https://savannah.cern.ch/bugs/?group=jra1mdw .

Many error messages are very poor. This is especially a problem with the command line tool due to messages being lost in too many layers of software. Error messages are also inconsistent between API’s.
Table and column names are currently case sensitive in RGMA. To get consistent results always respect case.
Only a subset of SQL 92 is currently supported by RGMA, and continuous queries are even more restricted.
Some operations of the command line tool try to access the schema and registry directly rather than just the local RGMA server. This access may be blocked by a firewall.
There is a known issue with Java 1.4.2 running with the Scientific Linux 3 SMP kernel on dual processor machines, where the Java Virtual Machine can crash without warning. The current solution is to use a non-SMP kernel. We believe this will be fixed in Java 1.4.2 08, but there is no release date for this yet. The problem does not seem to occur in RH7.3 or RHEL4.
The C, C++, and Python APIs and the command line tool make a new connection to the server for each API operation. When connecting to a secure server this adds a substantial overhead, so multiple API calls (e.g. lots of inserts) will run slowly. The Java API is not affected.
All VOs share the same name space and information.
Authentication is enabled by default. To use the RGMA Browser you must load your certificate into the web browser.
No removal procedure is provided with this release apart from the removal of the RPMS. Any account, group or other resource created during the module configuration must be manually cleaned.

Know open bugs:

Bug number	Description
#4275	R-GMA needs a setup script to be run
#4284	RGMA: error message for a non existent table is misleading
#4290	Another message that could be improved
#4364	R-GMA null pointer exception
#4438	R-GMA doesn't check types
#4634	RGMA scripts from EDG still present
#5148	error message for non local schema and registry are misleading
#5301	R-GMA: intermittent problem with producer->archiver chain
#5703	case sensitive varchar's when creating an archiver
#6287	add a predefined query to the browser to query the new log4 table
#6288	HTTP proxy support is inconsistent
#6475	Case sensitivity for table names is problematic
#6479	csv and tsv output has vanished
#6481	Bad error message from show
#6493	Bad case sensitivity for insert
#6495	insert does not check the column name
#6496	Bad/missing error messages with select
#6498	Error message could be more helpful
#6501	Range checking on the date stamp leaves something to be desired
#6506	Tab completion doesn't pick up "from"
#6510	Case sensitivity depends on query type
#6511	Syntax checking could be better
#6512	More parsing errors
#6514	Case sensitivity error with a secondary producer
#6568	Could log commands to a file
#6977	Printable version of the APIs would be nice
#7024	Additions to the manuals
#7149	Formatting strings for output
#7188	Bad messages if a port isn't open
#7189	How do you know the primary key?
#7218	Finding the configured registry and schema
#7219	Selects on different UIs give different results
#7220	Bad error message with ssl error
#7225	All client interactions should go via the local servlet box
#7226	rgma client configuration succeds, but a client test fails
#7276	Bad error message for expired proxy
#7282	Site has disappeared from R-GMA Browser
#7283	Inserting '\'s
#7349	glite-rgma-base-4.1.10-1 fails to install in LB installer
#7384	Proxy should default to the standard location
#7397	r-gma command-line documentation feature request
#7398	C API check fails with centos?
#7399	API errors with expired proxy
#7437	performance tests show problems when result set is big
#7442	Remove redundant tables
#7449	Bad behaviour with misconfigured registry
#7451	CTRL-C not properly trapped in python API
#7452	Inconsistent use of stdout and stderr in java API
#7487	the rgma client and it does not use the X509_CERT_DIR to look for the certificates of the CAs
#7524	R-GMA server configuration scripts need "--silent" option
#7526	R-GMA flexible archiver scripts needs --silent flag
#7537	Minor problems with read command
#7541	Problems with the rgma man page
#7542	Overriding the rgma.conf
#7543	Add a comment "command"?
#7593	Documentation web page
#7600	servlet check doesn't spot time sync problem
#7601	Connection not recovered after registry failure
#7622	Comments on the quickstart web page
#7623	Missing documentation in command line help
#7624	Predicate doesn\'t work?
#7625	Insert gives unclear warning
#7626	YABEM (Yet Another Bad Error Message)
#7627	Missing help for show properties
#7631	No results returned from R-GMA
#7633	Would be useful to query the configured registries
#7635	Problems with registry configuration
#7640	Crash if create/drop is used
#7642	create_table fails
#7644	Need explanation of how to get info out of result sets
#7654	Detection of an error with TRUSTFILE
#7655	declareTable fails with invalid predicate, but table is still declared
#7664	Bad service names?
#7676	Need to find out server limits on parameters
#7699	Need a tool to unpublish a service
#7705	Defaults for publication rate and LRP are wrong?
#7711	Service Names need to be unique

Bugs fixed in this or previous releases, but not yet tested:

Bug number	Description
#4429	R-GMA producers dying
#4568	Flexible archiver dies regularly
#4646	RGMA on the SE
#4698	RGMA logging fills up /var
#4820	Request directory configuration for services files.
#4821	Cron jobs for service publishing
#4822	running start on started service is not an error.
#4823	--config on service script is not an option on flexible-archiver
#4824	Could not (easily) run rgma-server-setup.py non - interactivly
#4853	rgma-servlet-status.py -pa sets up entries for the registry and schema when they are not installed
#4887	allow RetentionPeriod as a parameter in the conf file of the flexi
#5143	Too many open files using MySQL
#5251	missing error message if the service tool fails to start
#5293	Database producer URL in rgma.conf is wrong
#5306	Use GLITE_LOCATION not RGMA_HOME
#5411	http://hepunx.rl.ac.uk/egee/jra1-uk/glite/index.html has various errors
#5412	No provision for not being port 8080
#5425	Deleted items should be replicated
#5475	log4j jar location is hardwired
#5510	need for DB indices for DBProducer in underlying DBMS
#5694	Service publisher needs to trap errors
#5809	Inserting '\'s into latest producers
#6391	Wrong cron.hourly entry
#6403	glite-rgma-server-config assumes MySQL is running.
#6477	Unclear error messages
#6480	Bad error message for unknown "set"
#6507	Help for select doesn't mention "order by"
#6509	Make commands case-insensitive
#6516	Weird behaviour with -f option
#6917	R-GMA server logs to /tmp instead of /var/log/glite
#6980	Distribute the code examples
#6981	Missing link to manual?
#6990	Manual should refer to RC1 code
#7012	Problem in C++ manual example
#7014	C++ manual does not tell you the compiler options
#7018	Manuals should mention case-sensitivity issues
#7090	rgma-server-setup.py ignores --registrydb and --schemadb option
#7091	rgma-install-schema.py non-intuitive to use
#7147	Response to ctrl-c could be better
#7156	C++ SecondaryProducer example doesn't behave as expected
#7179	RGMA depl mod. : flex archiver pid file to be removed before restart attempt
#7245	Error messages should be on stderr
#7308	Changed behaviour with ctrl-D
#7310	Client doesn't know about multiple registries
#7409	RGMA security
#7446	Site name not tied to the site publisher?
#7572	rgma_flexible_archive_user_id not defined

7.1.6. Bugs closed since last release

This release fixes the following bugs and issues. Bug numbers refer to the gLite Bug Tracking system database hosted on the CERN Savannah system at https://savannah.cern.ch/bugs/?group=jra1mdw

Bug number	Description
#4437	R-GMA csv output format not quite right
#5665	The Browser has a link to developers, which points to the old datagridwp3 mailing list - not the current jra1-uk one.
#6359	update gin to work in secure mode
#6361	update sitePublisher to work in secure mode
#6364	update flexible archiver to work in secure mode
#6383	The org.glite.rgma.log4cpp component creates binary and source tarballs with different version numbers
#6414	R-GMA Site Publisher fails with an unknown error
#6443	problem with rgma init.d scripts
#6513	Return code is not set
#6754	glite-rgma-server-config.py failed
#7115	R-GMA server installation documentation error
#7178	RGMA deployment module fails. (tomcat5.py)
#7234	glite-rgma-server-conf.py --start does not read the R-GMA configuration
#7268	RGMA unable to read proxy certificate file
#7301	RGMA still needs j2sdk - is this really on purpose like this ?
#7342	rgma-gin script "pretends" being server setup script
#7344	R-GMA gin config script does not support glite-ce
#7481	R-GMA server stalled
#7672	glite-rgma-base does not get installed