Verrazzano Enterprise Container Platform – Setup

Docs: Prerequisites

Mon, 01 Jan 0001 00:00:00 +0000

Verrazzano requires the following:

A Kubernetes cluster and a compatible kubectl.
dev profile - At least two CPUs, 100 GB disk storage, and 16 GB RAM available on the Kubernetes worker nodes. Depending on the resource requirements of the applications you deploy, this may or may not be sufficient.
prod profile - At least four CPUs, 100 GB disk storage, and 32 GB RAM available on the Kubernetes worker nodes. Depending on the resource requirements of the applications you deploy, this may or may not be sufficient.

NOTE

To avoid conflicts with Verrazzano system components, we recommend installing Verrazzano into an empty cluster.

Supported hardware

Verrazzano requires x86-64; other architectures are not supported.

Supported software versions

Verrazzano supports the following software versions.

Kubernetes

You can install Verrazzano on the following Kubernetes versions.

Verrazzano	Kubernetes Versions
1.4	1.21, 1.22, 1.23, 1.24
1.3	1.21, 1.22, 1.23
1.2	1.19, 1.20, 1.21
1.1	1.19, 1.20, 1.21
1.0	1.18, 1.19, 1.20

For more information, see Kubernetes Release Documentation. For platform specific details, see Verrazzano platform setup.

WebLogic Server

The supported versions of WebLogic Server are dependent on the WebLogic Kubernetes Operator version. See the WebLogic Server versions supported here.

Coherence

The supported versions of Coherence are dependent on the Coherence Operator version. See the Coherence versions supported here.

Helidon

Verrazzano supports all versions of Helidon. For more information, see Helidon and Helidon Commercial Offerings.

Installed components

Verrazzano installs a curated set of open source components. The following table lists each component, its version, and a brief description.

Component	Version	Description
alert-manager	0.24.0	Handles alerts sent by client applications, such as the Prometheus server.
cert-manager	1.7.1	Automates the management and issuance of TLS certificates.
Coherence Operator	3.2.9	Assists with deploying and managing Coherence clusters.
ExternalDNS	0.10.2	Synchronizes exposed Kubernetes Services and ingresses with DNS providers.
Fluentd	1.14.5	Collects logs and sends them to OpenSearch.
Grafana	7.5.17	Tool to help you examine, analyze, and monitor metrics.
Istio	1.14.3	Service mesh that layers transparently onto existing distributed applications.
Jaeger	1.34.1	Distributed tracing system for monitoring and troubleshooting distributed systems.
Jaeger Operator	1.34.1	Provides management for Jaeger tools.
Keycloak	15.0.2	Provides single sign-on with Identity and Access Management.
Kiali	1.42.0	Management console for the Istio service mesh.
kube-state-metrics	2.4.2	Provides metrics about the state of Kubernetes API objects.
MySQL	8.0.29	Open source relational database management system used by Keycloak.
NGINX Ingress Controller	1.1.1	Traffic management solution for cloud‑native applications in Kubernetes.
Node Exporter	1.3.1	Prometheus exporter for hardware and OS metrics.
OAM Kubernetes Runtime	0.3.0	Plug-in for implementing the Open Application Model (OAM) control plane with Kubernetes.
OpenSearch	1.2.3	Provides a distributed, multitenant-capable full-text search engine.
OpenSearch Dashboards	1.2.0	Provides search and data visualization capabilities for data indexed in OpenSearch.
Prometheus	2.34.0	Provides event monitoring and alerting.
Prometheus Adapter	0.9.1	Provides metrics in support of pod autoscaling.
Prometheus Operator	0.55.1	Provides management for Prometheus monitoring tools.
Prometheus Pushgateway	1.4.2	Allows ephemeral and batch jobs to expose their metrics to Prometheus.
Rancher	2.6.8	Manages multiple Kubernetes clusters.
Rancher Backup Operator	2.1.3	Manages backup and restore of Rancher configurations and data.
Velero	1.9.1	Manages backup and restore of Kubernetes configurations and data.
WebLogic Kubernetes Operator	3.4.10	Assists with deploying and managing WebLogic domains.
WebLogic Monitoring Exporter	2.1.5	Exports Prometheus-compatible metrics from WebLogic instances.

Docs: CLI Setup

Mon, 01 Jan 0001 00:00:00 +0000

The Verrazzano command-line tool, vz, is available for Linux and Mac systems. Download the binary you want from the Releases page.

Install the `vz` CLI

These instructions demonstrate installing the CLI on Linux AMD64 machines.

Download the latest release

 $ curl -LO https://github.com/verrazzano/verrazzano/releases/download/v1.4.8/verrazzano-1.4.8-linux-amd64.tar.gz

Validate the binary (optional)

Download the checksum file.

 $ curl -LO https://github.com/verrazzano/verrazzano/releases/download/v1.4.8/verrazzano-1.4.8-linux-amd64.tar.gz.sha256

Validate the binary against the checksum file.

 $ sha256sum -c verrazzano-1.4.8-linux-amd64.tar.gz.sha256

Unpack and copy the `vz` binary

 $ tar xvf verrazzano-1.4.8-linux-amd64.tar.gz

The following command needs to be run as root.

 $ sudo cp verrazzano-1.4.8/bin/vz /usr/local/bin

Test to ensure that the version you installed is up-to-date

 $ vz version

The resulting output should be similar to the following.

Version: v1.4.0
BuildDate: 2022-09-23T21:32:57Z
GitCommit: a34d6473a4296b8cfe64ad7851d1dcd0f18e9669

Use the `vz` CLI

Verrazzano provides a command-line tool for managing a Verrazzano environment using the Verrazzano and Kubernetes API.

Common use cases include installing, upgrading, and uninstalling Verrazzano, as well as analyzing failures in a running Verrazzano environment.

Usage information

Use the following syntax to run vz commands from your terminal window.

vz [command] [flags]

Available commands

Command	Definition
`analyze`	Analyze cluster
`bug-report`	Collect information from the cluster to report an issue
`help`	Help about any command
`install`	Install Verrazzano
`status`	Status of the Verrazzano installation and access endpoints
`uninstall`	Uninstall Verrazzano
`upgrade`	Upgrade Verrazzano
`version`	Verrazzano version information

Available Flags

These flags apply to all the commands.

Flag	Definition
`--context string`	The name of the kubeconfig file context to use.
`-h`, `--help`	Help for `vz`.
`--kubeconfig string`	Path to the kubeconfig file to use.

Docs: Platform Setup

Mon, 01 Jan 0001 00:00:00 +0000

Docs: Install

Mon, 01 Jan 0001 00:00:00 +0000

Docs: Use a Private Registry

Mon, 01 Jan 0001 00:00:00 +0000

Installing Verrazzano using a private Docker-compliant container registry requires the following:

Loading all the required Verrazzano container images into your own registry and repository.
Installing the Verrazzano platform operator with the private registry and repository used to load the images.

You must have the following software installed:

Docker
kubectl
Helm (version 3.x+)
jq

Verrazzano distributions are available in two variations:

The Verrazzano Lite Distribution contains Kubernetes manifests to deploy Verrazzano, client binaries, and various other utilities. This distribution is provided for Linux and MacOS operating systems on AMD and ARM architectures.
The Verrazzano Full Distribution contains Kubernetes manifests to deploy Verrazzano, client binaries and various utilities for Linux and MacOS operating systems on AMD and ARM architectures. This full distribution also includes the Linux AMD container images required for Verrazzano.

Both the distributions include:

Verrazzano CLI
Installation Profiles
Helper scripts to download the images from the bill of materials (BOM) and to upload the Verrazzano images to a private registry
Helm charts for the Verrazzano platform operator
README.md which provides the layout of the respective distribution

Set up a private registry using the following instructions, depending on your distribution.

Load the images

Download the desired Verrazzano distribution from the GitHub releases page.

a. In your browser, go to Verrazzano releases.

b. Download the distribution TAR file, verrazzano-<major>.<minor>.<patch>-<operating system>-<architecture>.tar.gz, and the corresponding checksum file.

c. In the downloaded directory, validate that the checksum and TAR files match. For example, if you have downloaded verrazzano-1.4.8-linux-amd64.tar.gz:
```
$ sha256sum -c verrazzano-1.4.8-linux-amd64.tar.gz.sha256
# Sample output
verrazzano-1.4.8-linux-amd64.tar.gz: OK
```
NOTE: Use the sha256sum command on Linux and shasum on MacOS.

d. Expand the TAR file to access the release artifacts.

The following example, extracts the distribution archive verrazzano-1.4.8-linux-amd64.tar.gz into the current directory.
```
$ tar xvf verrazzano-1.4.8-linux-amd64.tar.gz
```
After a successful extraction, the release artifacts will be under the verrazzano-1.4.8 directory.

e. Define an environment variable DISTRIBUTION_DIR.
```
$ DISTRIBUTION_DIR=<path to the current directory>/verrazzano-1.4.8
```
Download the Verrazzano images defined in the BOM, ${DISTRIBUTION_DIR}/manifests/verrazzano-bom.json, using the script, ${DISTRIBUTION_DIR}/bin/vz-registry-image-helper.sh.
```
$ sh ${DISTRIBUTION_DIR}/bin/vz-registry-image-helper.sh -b ${DISTRIBUTION_DIR}/manifests/verrazzano-bom.json -f ${DISTRIBUTION_DIR}/images  
```
The previous command downloads all the images to the ${DISTRIBUTION_DIR}/images directory.

Load the images

Download the Verrazzano ZIP file.
- Download the Verrazzano ZIP file from the Oracle Software Delivery Cloud for major or minor releases.
  
  a. In your browser, go to the Oracle Software Delivery Cloud and log in with your credentials.
  
  b. In the drop-down menu preceding the search bar, select All Categories.
  
  c. In the search bar, enter Verrazzano Enterprise Container Platform and click Search.
  
  d. Select the REL: Verrazzano Enterprise Container Platform 1.4.0.0.0 link. This will add it to your download queue.
  
  e. At the top of the page, select the Continue link.
  
  f. Review the Download Queue, then click Continue.
  
  g. Accept the license agreement and click Continue.
  
  h. Download the file:
  - To download the ZIP file directly, select the file link in the list.
  - To download the ZIP file using Oracle Download Manager, click Download and run the Oracle Download Manager executable.
- Download the Verrazzano ZIP file from My Oracle Support for cumulative patches.
  
  a. In your browser, go to My Oracle Support and log in with your credentials.
  
  b. Select the Patches & Updates tab.
  
  c. In the Patch Search panel, select the link Product or Family (Advanced).
  
  d. In the search bar for Product is, enter Oracle Verrazzano Enterprise Container Platform.
  
  e. The previous step populates the available releases for Verrazzano in the drop-down menu Release is. Select the desired release(s) and click Search.
  
  f. A new panel with Patch Advanced Search Results will open listing all the patches for the release. Select the link for the desired patch, under the Patch Name.
  
  g. From the page providing details about the patch, click Download.
  
  h. Download the ZIP file by selecting the file link.
Prepare to do the private registry installation.

a. Extract the ZIP archive to a desired directory location. There will be two files: a compressed TAR file containing the product files and a checksum file.

b. Define an environment variable DISTRIBUTION_DIR.
```
$ DISTRIBUTION_DIR=<path to the current directory>/verrazzano-1.4.8
```
c. In the expanded archive directory, validate that the checksum and TAR files match. For example,
```
$ sha256sum -c verrazzano-1.4.8.tar.gz.sha256
# Sample output
verrazzano-1.4.8.tar.gz: OK
```
NOTE: Use the sha256sum command on Linux and shasum on MacOS.

Load the product images into your private registry.

a. To log in to the Docker registry, run docker login <SERVER> with your credentials.

b. For use with the examples in this document, define the following variables with respect to your target registry and repository: MYREG, MYREPO, VPO_IMAGE.

These identify the target Docker registry and repository, and the Verrazzano platform operator image, as defined in the BOM file. For example, using a target registry of myreg.io and a target repository of myrepo/v8o:
```
 $ MYREG=myreg.io
 $ MYREPO=myrepo/v8o
 $ VPO_IMAGE=$(cat ${DISTRIBUTION_DIR}/manifests/verrazzano-bom.json | jq -r '.components[].subcomponents[] | select(.name == "verrazzano-platform-operator") | "\(.repository)/\(.images[].image):\(.images[].tag)"')
```
c. Run the ${DISTRIBUTION_DIR}/bin/vz-registry-image-helper.sh script to push the images to the registry:
```
$ sh ${DISTRIBUTION_DIR}/bin/vz-registry-image-helper.sh -t $MYREG -r $MYREPO -l ${DISTRIBUTION_DIR}/images
```
d. Although most images can be protected using credentials stored in an image pull secret, some images must be public. Use the following commands to get the list of public images:
- All the Rancher images in the rancher/additional-rancher subcomponent.
```
$ cat ${DISTRIBUTION_DIR}/manifests/verrazzano-bom.json | jq -r '.components[].subcomponents[] | select(.name == "additional-rancher") | .images[] | "\(.image):\(.tag)"'
```
- The Fluentd Kubernetes daemonset image.
```
$ cat ${DISTRIBUTION_DIR}/manifests/verrazzano-bom.json | jq -r '.components[].subcomponents[].images[] | select(.image == "fluentd-kubernetes-daemonset") | "\(.image):\(.tag)"'
```
- The Istio proxy image.
```
$ cat ${DISTRIBUTION_DIR}/manifests/verrazzano-bom.json | jq -r '.components[].subcomponents[] |  select(.name == "istiod") | .images[] | select(.image == "proxyv2") | "\(.image):\(.tag)"'
```
- The WebLogic Monitoring Exporter image.
```
$ cat ${DISTRIBUTION_DIR}/manifests/verrazzano-bom.json | jq -r '.components[].subcomponents[].images[] | select(.image == "weblogic-monitoring-exporter") | "\(.image):\(.tag)"'
```
- The Verrazzano platform operator image identified by $VPO_IMAGE, as defined previously.
- For all the Verrazzano Docker images in the private registry that are not explicitly marked public, you will need to create the secret verrazzano-container-registry in the default namespace, with the appropriate credentials for the registry, identified by $MYREG.
  For example:
```
$ kubectl create secret docker-registry verrazzano-container-registry \  
     --docker-server=$MYREG --docker-username=myreguser \  
     --docker-password=xxxxxxxx --docker-email=me@example.com
```

Install Verrazzano

Install the Verrazzano platform operator using the image defined by $MYREG/$MYREPO/$VPO_IMAGE.

$ helm template --include-crds ${DISTRIBUTION_DIR}/manifests/charts/verrazzano-platform-operator \
    --set image=${MYREG}/${MYREPO}/${VPO_IMAGE} --set global.registry=${MYREG} \
    --set global.repository=${MYREPO} --set global.imagePullSecrets={verrazzano-container-registry} | kubectl apply -f -

Wait for the deployment of the Verrazzano platform operator.

$ kubectl -n verrazzano-install rollout status deployment/verrazzano-platform-operator

# Sample output
  deployment "verrazzano-platform-operator" successfully rolled out

Confirm that the Verrazzano platform operator pod is running.

$ kubectl -n verrazzano-install get pods

# Sample output
  NAME                                            READY   STATUS    RESTARTS   AGE
  verrazzano-platform-operator-74f4547555-s76r2   1/1     Running   0          114s

The distribution archive includes the supported installation profiles under ${DISTRIBUTION_DIR}/manifests/profiles. Verrazzano supports customizing installation configurations. See Customize Verrazzano.

To create a Verrazzano installation using the provided profiles, run the following command:

$ kubectl apply -f $DISTRIBUTION_DIR/manifests/profiles/prod.yaml

For a complete description of Verrazzano configuration options, see the Reference API.

Configuring access to an insecure private registry

A private Docker registry is called an insecure registry when it is configured for access using a self-signed certificate or over an unencrypted HTTP connection. Depending on the platform, there could be some additional configuration required for installing Verrazzano with an insecure registry.

For example, for the Oracle Cloud Native Environment platform, insecure registries must be configured in /etc/containers/registries.conf as follows on the worker nodes:

[registries]
   [registries.insecure]
     registries = ["insecure-registry-1:1001/registry1","insecure-registry-2:1001/registry2"]

Verrazzano Enterprise Container Platform – Setup

Docs: Prerequisites

NOTE

Supported hardware

Supported software versions

Kubernetes

WebLogic Server

Coherence

Helidon

Installed components

Docs: CLI Setup

Install the vz CLI

Download the latest release

Validate the binary (optional)

Unpack and copy the vz binary

Test to ensure that the version you installed is up-to-date

Use the vz CLI

Usage information

Available commands

Available Flags

Docs: Platform Setup

Docs: Install

Docs: Use a Private Registry

Load the images

Load the images

Install Verrazzano

Configuring access to an insecure private registry

Install the `vz` CLI

Unpack and copy the `vz` binary

Use the `vz` CLI