Distributed setup with TeamForge, Oracle Database (including Datamart) and EventQ installed on separate servers.

In this setup, TeamForge, Oracle database and other services are distributed across three servers, server-01 through server-03 as illustrated in the following table.

You can install TeamForge on both RHEL/CentOS 7.5 and 6.10. In this distributed setup, all the following services are installed on RHEL/CentOS 7.5 servers.

server-01 server-02 server-03
TeamForge Application Server Oracle Database Server EventQ Server
ctfcore ctfcore-database eventq
mail ctfcore-datamart rabbitmq
etl   mongodb
search   redis
codesearch    
gerrit    
gerrit-database    
subversion    
cvs    
reviewboard    
reviewboard-database    
reviewboard-adapter1    
binary    
binary-database    
cliserver    

Dos and Don’ts

Here’s a list of dos, don’ts and points to remember when you install or upgrade TeamForge.

Dos

  • Understand TeamForge installation requirements and plan your installation or upgrade.
  • Get your TeamForge license key and keep it handy.
  • Verify your basic networking setup before installing or upgrading TeamForge. See Set Up Networking for TeamForge.
  • Look for new or modified site-options.conf tokens and update your site-options.conf file as required during the upgrade process. See Site Options Change Log.
  • Set up a TeamForge Stage Server before you upgrade your Production Server.
  • Stop TeamForge services on all servers in a distributed setup while upgrading to TeamForge 18.2.
  • Uninstall hot fixes and add-ons, if any, before you start the TeamForge 18.2 upgrade procedure.
  • As a result of changes to the logging framework in Java 9, the PrintGCDetails and PrintGCTimeStamps logging options are no longer supported. Remove these options from the following tokens while upgrading to TeamForge 18.1 or later. TeamForge provision fails otherwise.

    • JBOSS_JAVA_OPTS
    • PHOENIX_JAVA_OPTS
    • INTEGRATION_JAVA_OPTS
    • ETL_JAVA_OPTS
    • ELASTICSEARCH_JAVA_OPTS

Don'ts

  • Do not customize your operating system installation. Select only the default packages list.
  • While upgrading TeamForge, whether in place or on new hardware, always reuse the old site-options.conf file and make changes as necessary. Do not try to start with a new site-options.conf file. Reusing the old site-options.conf avoids many potential problems, particularly around the management of usernames and passwords.
  • Do not manually modify TeamForge-managed site option tokens such as the AUTO_DATA token. See AUTO_DATA for more information.
  • If you are creating symlinks, note that you must create symlinks only to the TeamForge data directory (/opt/collabnet/teamforge/var). You should not create symlinks to TeamForge application directories (such as /opt/collabnet).

Points to Remember

  • Installing or upgrading TeamForge needs root privileges. You must log on as root or use a root shell to install or upgrade TeamForge.
  • SSL is enabled by default and a self-signed certificate is auto-generated. However, you can use a few site-options.conf tokens to adjust this behavior. To generate the SSL certificates, see Generate SSL Certificates.
  • For the ETL service to run as expected in a distributed TeamForge installation, all servers must have the same time zone.
  • If you have Git integration on a separate server, both TeamForge and Git servers must have their time and date synchronized.
  • While you can run both EventQ and TeamForge on the same server, CollabNet recommends such an approach only for testing purposes. It’s always recommended to run EventQ on a separate server for optimal scalability.
  • It’s highly recommended that you install the TeamForge Baseline services on a separate server as the baselining process can consume considerable CPU and database resources. For more information, see Install TeamForge in a Distributed Setup.
  • No backup is required for same hardware upgrades. However, you can create a backup as a measure of caution. See Back up and Restore TeamForge for more information.
  • Always use compatible JDBC drivers meant for specific database versions. See JDBC Drivers Reference for more information. Also see: Why do ETL jobs fail post TeamForge upgrade?
  • You can run the initial load job any time after the installation of TeamForge. We recommend that you run it before you hand over the site to the users. For more information, see ETL Initial Load Jobs.
  • SOAP50 APIs and event handlers are no longer supported in TeamForge 16.10 and later. Use the latest TeamForge SOAP/REST APIs.
  • TeamForge 18.2 installer expects the system locale to be LANG=en_US.UTF-8. TeamForge create runtime (teamforge provision) fails otherwise.
  • Installing TeamForge with service-specific FQDNs (instead of machine-specific host/domain names) is highly recommended so that you will be able to change the system landscape at a later point in time without having any impact on the URLs (in other words, end users do not have to notice or change anything). For example, you can create FQDNs specifically for services such as Subversion, Git, mail, Codesearch and so on. For more information, see Service-specific FQDNs.
  • All such service-specific FQDNs must be long to a single sub domain and it is recommended to create a new sub domain for TeamForge.
  • If you are using service-specific FQDNs
    • A wildcard SSL cert is required. SNI SSL cert cannot be used.
    • When SSL is enabled and no custom SSL certificates are provided, a self-signed wildcard cert is generated for the sub domain.
    • When SSL is enabled and a custom SSL certificate is provided, the CN of the certificate is verified to be a wildcard CN.
  • You cannot have a separate PUBLIC_FQDN for EventQ.
  • The ability to run separate PostgreSQL instances for TeamForge database and datamart on the same server is being deprecated in TeamForge 17.11. If you have TeamForge database and datamart on separate PostgreSQL instances on the same server and if you are upgrading on a new hardware, you must Create a Single Cluster for Both Database and Datamart while upgrading to TeamForge 18.2 or later.

Back up Your Oracle Database

Uninstall Custom Event Handlers, Hot Fixes and Add-ons

Log on to the TeamForge Application Server.

  1. SOAP 50 is no longer supported. Back up all your custom event handlers and remove all the event handler JAR files before starting your TeamForge upgrade process.
    1. Go to My Workspace > Admin.
    2. Click System Tools from the Projects menu.
    3. Click Customizations.
    4. Select the custom event handler and click Delete.
  2. Uninstall hotfixes and add-ons, if any, installed on your site.

Uninstall Review Board

  1. Log on to the TeamForge Application Server and uninstall Review Board.
    cd /opt/collabnet/RBInstaller-18.1.xx
    python ./install.py -u
    

yum upgrade

  1. Stop TeamForge.

    • If you are upgarding from TeamForge 16.7 or earlier releases:
      /etc/init.d/collabnet stop
      
    • If you are upgrading from TeamForge 16.10, 17.1, or 17.4 releases:
      /opt/collabnet/teamforge/bin/teamforge stop
      
    • If you are upgrading from TeamForge 17.8 or later releases:
      teamforge stop
      
  2. Log on to the EventQ Server. Stop EventQ.

    • If you are upgrading from TeamForge 16.3:
      /etc/init.d/orchestrate stop
      
    • If you are upgrading from TeamForge 16.7, 16.10, or 17.1 release:
      /etc/init.d/eventq stop
      /etc/init.d/collabnet-rabbitmq-server stop
      /etc/init.d/collabnet-mongod stop
      
    • If you are upgrading from TeamForge 17.4 release:
      /opt/collabnet/teamforge/bin/teamforge stop
      
    • If you are upgrading from TeamForge 17.8 or later releases:
      teamforge stop
      
  3. Upgrade the operating system packages.

    yum upgrade
    

Configure the TeamForge Installation Repository

  1. TeamForge Installation Repository Configuration for Sites with Internet Access

    1. Contact the CollabNet Support and download the TeamForge 18.2 installation repository package to /tmp.
    2. Install the repository package.
      yum install -y /tmp/collabnet-teamforge-repo-18.2-0-noarch.rpm
      
    3. Refresh your repository cache.
      yum clean all
      

    TeamForge Installation Repository Configuration for Sites without Internet Access

    1. Contact the CollabNet Support to get the auxiliary installer package for TeamForge 18.2 disconnected installation and save it in /tmp.
      • RHEL/CentOS 6.10 64 bit: CTF-Disconnected-media-18.2.562-1215.rhel6.x86_64.rpm
      • RHEL/CentOS 7.5 64 bit: CTF-Disconnected-media-18.2.562-1215.rhel7.x86_64.rpm
      • In addition to the above CentOS 7.5 64 bit RPM package, you must get the following CentOS 7.5 compatibility RPM, which is required for TeamForge 18.2 disconnected media installation on CentOS 7.5 profile: compat-ctf-dc-media-1.0-1.el7.centos.noarch.rpm.
    2. Unpack the disconnected installation package.
      rpm -Uvh <package-name>
      
    3. Unpack the compat-ctf-dc-media-1.0-1.el7.centos.noarch.rpm package if you are installing TeamForge 18.2 on CentOS 7.5.
      rpm -ivh compat-ctf-dc-media-1.0-1.el7.centos.noarch.rpm
      
    4. If not mounted already, mount the RHEL/CentOS installation DVD.

      The DVD contains the necessary software and utilities required for installing TeamForge without internet access. In the following commands, replace “cdrom” with the identifier for your server’s CD/DVD drive, if necessary.

      cd /media/
      mkdir cdrom
      mount /dev/cdrom ./cdrom/
      

      If there are any spaces in the automount, unmount it first and mount it as a filepath, with no spaces.

    5. Create a yum configuration file that points to the RHEL/CentOS installation DVD.
      vi /etc/yum.repos.d/cdrom.repo
      

      Here’s a sample yum configuration file.

      [RHEL-CDROM]
      name=RHEL CDRom 			
      baseurl=file:///media/cdrom/Server/
      gpgfile=file:///media/cdrom/RPM-GPG-KEY-redhat-release 
      enabled=1
      gpgcheck=0
      
    6. Verify your yum configuration files.
      yum list httpd
      yum list apr
      

Upgrade the TeamForge Services

  1. Upgrade the TeamForge and Review Board application services on the TeamForge Application Server (server-01).
    yum install teamforge
    
  2. Upgrade the EventQ services on the EventQ Server (server-03).
    yum install teamforge-eventq CN-eventq collabnet-nginx collabnet-passenger
    

Back up the TeamForge Data Directories

On sites running TeamForge 16.7 or earlier versions:

  1. Back up the following data directories.
    Directory Contents
    /opt/collabnet/teamforge/var User-created data, such as artifact attachments
    /opt/collabnet/reviewboard Review Board data
    /svnroot Subversion source code repositories
    /sf-svnroot Subversion repository for branding data
    /cvsroot CVS source code repositories (required only if you have CVS)
    /gitroot Git source code repositories
    cp -Rpf /svnroot /sf-svnroot /cvsroot /gitroot /opt/collabnet/teamforge/var /opt/collabnet/reviewboard /tmp/backup_dir
    
  2. Back up the /opt/collabnet/gerrit directory if you have Git integration.
    mkdir /tmp/backup_dir/gerrit
    cp -Rpfv /gitroot /tmp/backup_dir
    cp -Rpfv /opt/collabnet/gerrit/ /tmp/backup_dir/gerrit
    
  3. Back up the EventQ YAML files and directories if you have EventQ installed.
    cp -Rpfv /opt/collabnet/eventq/config/*.yml /opt/collabnet/mongodb /opt/collabnet/rabbitmq /tmp/backup_dir
    

On sites running TeamForge 16.10 or later versions:

  1. Back up the /opt/collabnet/teamforge/var directory.
    mkdir -p /tmp/backup_dir
    cp -Rpfv /opt/collabnet/teamforge/var /tmp/backup_dir
    
  2. Back up the /opt/collabnet/gerrit directory if you have Git integration.
    mkdir /tmp/backup_dir/gerrit
    cp -Rpfv /opt/collabnet/gerrit/ /tmp/backup_dir/gerrit
    
  3. Back up the EventQ YAML files and directories if you have EventQ installed.
    cp -Rpfv /opt/collabnet/eventq/config/*.yml /opt/collabnet/mongodb /opt/collabnet/rabbitmq /tmp/backup_dir
    

Back up and Restore Review Board Database and Data Directories

See Back up and Restore Review Board Database and Data Directories

Set up the site-options.conf File and Provision Services

  1. Log on to the TeamForge Application Server (server-01), set up the site-options.conf file, and provision the services.
    vi /opt/collabnet/teamforge/etc/site-options.conf
    

    host:SERVICES Token

    server-01:SERVICES=ctfcore mail etl search subversion cvs codesearch cliserver gerrit gerrit-database  binary binary-database reviewboard reviewboard-database reviewboard-adapter cliserver
    server-02:SERVICES=ctfcore-database ctfcore-datamart
    server-03:SERVICES=eventq mongodb redis rabbitmq
    

    host:PUBLIC_FQDN Token

    server-01:PUBLIC_FQDN=my.app.domain.com
    

    Configure the Oracle Database Tokens

    Configure the Oracle database name, usernames and passwaords as configured on the Oracle Database Server.

    • Database type is oracle by default (DATABASE_TYPE=oracle)
    • Database service name is the host name of the Oracle Database Server (for example, DATABASE_SERVICE_NAME=cu349.maa.collab.net)
    • Reports database service name is the host name of the server where the datamart is (for example, REPORTS_DATABASE_SERVICE_NAME=cu349.maa.collab.net)
    DATABASE_TYPE=oracle
    
    # Adjust usernames/passwords to match what has been configured on the database server.
    DATABASE_USERNAME=ctfuser
    DATABASE_PASSWORD=ctfpwd
    DATABASE_READ_ONLY_USER=ctfrouser
    DATABASE_READ_ONLY_PASSWORD=ctfropwd
    DATABASE_NAME=orcl
    DATABASE_SERVICE_NAME=
    ​
    # Adjust usernames/passwords to match what has been configured on the database server.
    REPORTS_DATABASE_USERNAME=ctfrptuser
    REPORTS_DATABASE_PASSWORD=ctfrptpwd
    REPORTS_DATABASE_NAME=orcl
    REPORTS_DATABASE_READ_ONLY_USER=ctfrptrouser
    REPORTS_DATABASE_READ_ONLY_PASSWORD=ctfrptropwd
    REPORTS_DATABASE_SERVICE_NAME=
    

    Save the site-options.conf file.

    For further customization of your site configuration (SSL settings, password policy settings, PostgreSQL settings, LDAP settings and so on):

    SSL Tokens

    SSL is enabled by default and a self-signed certificate is auto-generated. Use the following tokens to adjust this behavior.

    SSL_CERT_FILE=
    SSL_KEY_FILE=
    SSL_CHAIN_FILE=
    
    • To generate the SSL certificates, see Generate SSL certificates.
    • Have the custom SSL certificate and private key for custom SSL certificate in place and provide their absolute paths in these tokens. SSL_CHAIN_FILE (intermediate certificate) is optional.

    Password Tokens

    Prevent Cross-site Scripting

    An attacker could potentially upload an HTML page to TeamForge that contains active code, such as JavaScript. This active code would then be executed by clients’ browsers when they view the page, which can harm the system.

    To prevent an attack of this sort, you can specify whether or not HTML code is displayed in TeamForge. This flag applies to all documents, tracker, task, and forum attachments, and files in the file release system.

    Set the SAFE_DOWNLOAD_MODE token according to your requirements. For more information, see SAFE_DOWNLOAD_MODE.

    JAVA_OPTS

    Configure the JBOSS_JAVA_OPTS site-options.conf token. See JBOSS_JAVA_OPTS.

    TeamForge 18.1 (and later) supports Java 9. As a result of changes to the logging framework in Java 9, the PrintGCDetails and PrintGCTimeStamps logging options are no longer supported. Remove these options from the following tokens while upgrading to TeamForge 18.1 or later.

    • JBOSS_JAVA_OPTS
    • PHOENIX_JAVA_OPTS
    • INTEGRATION_JAVA_OPTS
    • ETL_JAVA_OPTS
    • ELASTICSEARCH_JAVA_OPTS

    TeamForge provision fails on sites that use these options post upgrade to TeamForge 18.1.

    Save the site-options.conf file.

  2. Provision services.
    teamforge provision
    
    TeamForge 18.2 installer expects the system locale to be LANG=en_US.UTF-8. TeamForge create runtime (teamforge provision) fails otherwise.

Set up the EventQ Server (server-03)

Log on to the EventQ Server (server-03), set up the site-options.conf file, and provision the services.

  1. Copy the /opt/collabnet/teamforge/etc/site-options.conf file from the TeamForge Application Server to the EventQ Server’s /opt/collabnet/teamforge/etc/ directory.

  2. Provision services.

    teamforge provision
    
    TeamForge 18.2 installer expects the system locale to be LANG=en_US.UTF-8. TeamForge create runtime (teamforge provision) fails otherwise.

Verify TeamForge Upgrade

  1. Verify TeamForge upgrade.
    1. Reboot the server and make sure all services come up automatically at startup.
    2. Log on to the TeamForge web application using the default Admin credentials.
      • Username: admin
      • Password: admin
    3. If your site has custom branding, verify that your branding changes still work as intended. See Customize TeamForge.
    4. Let your site’s users know they’ve been upgraded. See Create a Site-wide Broadcast.

Post Upgrade Tasks


  1. reviewboard-adapter must always be installed on the TeamForge Application Server. 

Tags for this page: installation