Clustered enterprise installation on GKE

You will need to copy the above installation files to the home directory “~/ “ into target Unix box creating as part of pre-requisite.

This activity can be carried out using WinSCP or scp

Installation Steps

1. Provision resources on GCP

1. Copy or move the cloud_sql_proxy file to:

   ~/GCP/installation_scripts

2. Run the following commands to begin provisioning resources

   cd ~/GCP/installation_scripts
   . gcloud-resource.sh

3. Complete the following steps:

   1. Copy the generated url and allow Google SDK to login

      

   2. Copy the generated token from your browser and paste it in your terminal window
      

   3. Enter your project id when prompted

   4. Enter the zone for your project when prompted

   5. Enter your GKE Service Account email when prompted

   6. Enter your username when prompted

2. Add Node Pool IP Addresses to SQL Instance

1. Open console.cloud.google.com in your browser

2. Navigate to your Project

3. In the left-hand resource panel select SQL
   

    

4. Click on the prod-instance SQL instance

5. Select connections in the left-hand PRIMARY INSTANCE navigation panel

6. Scroll down to Authorised Networks and click on Add Network for each of the provided IP’s in the console

   1. Provided GKE IP Addresses Example

      

   2. Adding IP addresses to Authorised Networks

      

7. Click on Save at the bottom of the page and wait for it to update

3. Populating the databases

The below script will run a set of CREATE commands to generate the DDLs for the Zetaris metastore

1. Run the following command to populate the databases:

. database-configuration.sh

4. Configuring the RHEL-VM

The RHEL-VM is a standalone Red hat box used for investigation of logs or inspection of pods using kubectl. This box contains the installation scripts for kubernetes and includes helm charts , configurations and secrets for the kubernetes deployments.

1. Run the following command:

   gcloud compute ssh new-rhel-vm --command=”. configvm-1.sh” -- -t  --zone=<the same zone as provided in step 1.2.d>

   1. Please select yes on any prompts for package installation to allow for a working installation

   2. The script will do the following:

      1. Install the latest epel release for rhel 8

      2. Install snapd

      3. Create system link between snapd and snap

2. When the script has finished, Run the following command:

   gcloud compute ssh new-rhel-vm --zone=<the same zone as provided in step 1.2.d> --command=”. configvm-2.sh” -- -t

   1. As above, please select y on any prompts for package installation to allow for a working installation

   2. The script will do the following packages:

      1. Update any installed gcloud components to the latest version

      2. Install helm

      3. Install kubectl

      4. Install the gcloud auth plugin

      5. Add the gcloud auth plugin to ~/.bashrc to be used by the environment

5. Deploy Lightning on GKE

In this step , the helm charts are applied to the previously created GKE (in step 1) and all secrets and configurations are applied to the services.

1. Run the following command to deploy Lightning on GKE:

   gcloud compute ssh new-rhel-vm --zone=<the same zone as provided in step 1.2.d> --command=”. config-kubernetes.sh” -- -t

2. As in Step 1.2. complete the following

   1. Copy the generated url and allow Google SDK to login

   2. Copy the generated token from your browser and paste it in your terminal window

3. When prompted provide your docker username and docker password

4. Once completed you will be provided with a list of the services running on Kubernetes. Please copy the External IP from the following services:

   1. lightning-gui-svc

   2. lightning-rest-svc

6. Associate your LoadBalancer IP addresses with an A DNS record set

To create a standard web url , the loadbalancer IPs will need to be associated with a DNS record set.

1. On your DNS provider, Create an A record set for each of the copied IP addresses from steps 5.4.a and 5.4.b

   1. lightning-gui-svc: ui.<subdomain>.<domain>
      i.e. ui.trial.enterprise.zetaris.com

   2. lightning-rest-svc: rest.<subdomain>.<domain>
      i.e. rest.trial.enterprise.zetaris.com

7. Add certificate

In case the web url is required to have a signed certificate then use the steps mentioned in the reference document below to create a certificate: Quickstart: Create a certificate by using the Google Cloud console  |  Certificate Authority Service

8. Connecting to your environment

1. Once you have the DNS pointing towards the IP addresses copied from step 5.4.1 and 5.4.2

   1. This can be checked using the following link: https://dnschecker.org/

2. Using your browser, connect to the URL you designated for the UI

3. Login into the Lightning GUI

---

Installation Videos