GCP Marketplace Prerequisites

September 20, 2019 | 2 minute read

This article lists the prerequisites that should be in place before deploying Myelin on GCP marketplace.

Create a GKE cluster with Istio enabled:

gcloud beta container clusters create test-cluster --preemptible \
    --addons=Istio --istio-config=auth=MTLS_PERMISSIVE \
    --machine-type=n1-standard-4 --num-nodes=1 --disk-size=30 --issue-client-certificate \
    --enable-basic-auth --zone=europe-west2-c \
    --image-type=UBUNTU

Create a namespace:

kubectl create ns myelin-ns
kubectl label namespace myelin-ns istio-injection=enabled

Create two bucket for Myelin to save logs into.

gsutil mb -l europe-west2 gs://myelin-axon/ 
gsutil mb -l europe-west2 gs://myelin-deployer/

Create the necessary customer resource definitions:

kubectl apply -f "https://raw.githubusercontent.com/GoogleCloudPlatform/marketplace-k8s-app-tools/master/crd/app-crd.yaml"
kubectl apply -f "https://raw.githubusercontent.com/coreos/prometheus-operator/v0.30.1/example/prometheus-operator-crd/alertmanager.crd.yaml"
kubectl apply -f "https://raw.githubusercontent.com/coreos/prometheus-operator/v0.30.1/example/prometheus-operator-crd/prometheus.crd.yaml"
kubectl apply -f "https://raw.githubusercontent.com/coreos/prometheus-operator/v0.30.1/example/prometheus-operator-crd/prometheusrule.crd.yaml"
kubectl apply -f "https://raw.githubusercontent.com/coreos/prometheus-operator/v0.30.1/example/prometheus-operator-crd/servicemonitor.crd.yaml"
kubectl apply -f "https://raw.githubusercontent.com/myelinio/myelin-gcp-marketplace/master/myelin/crd/myelin.axon.crd.yaml"
kubectl apply -f "https://raw.githubusercontent.com/myelinio/myelin-gcp-marketplace/master/myelin/crd/myelin.deployer.crd.yaml"
kubectl apply -f "https://raw.githubusercontent.com/myelinio/myelin-gcp-marketplace/master/myelin/crd/myelin.workflow.crd.yaml"

Create the following cluster roles. These roles define a set of permissions that are required for Myelin controllers and additional components installed by default (Prometheus and NFS provisioner).

kubectl apply -f "https://raw.githubusercontent.com/myelinio/myelin-gcp-marketplace/master/myelin/deployer/role/axon-controller-role.yaml"
kubectl apply -f "https://raw.githubusercontent.com/myelinio/myelin-gcp-marketplace/master/myelin/deployer/role/prometheus-operator-role.yaml"
kubectl apply -f "https://raw.githubusercontent.com/myelinio/myelin-gcp-marketplace/master/myelin/deployer/role/nfs-provisioner-role.yaml"

Create a storage class. Myelin uses NFS filesystem to store metadata and models. A network disk gets attached to each instance to share data between pods and steps (we also support alternatives such as Ceph or HDFS).
```
kubectl apply -f "https://raw.githubusercontent.com/myelinio/myelin-gcp-marketplace/master/myelin/deployer/role/nfs-provisioner-storageclass.yaml"
```
Create a service account for the Myelin. This service account is used when Myelin executes its axons. The name of this service account (myelin-minimal) should be referred in the axon definition in spec.serviceAccountName:
```
kubectl apply -n myelin-ns -f "https://raw.githubusercontent.com/myelinio/myelin-gcp-marketplace/master/myelin/deployer/role/myelin-minimal-role.yaml"
```

After the initial setup, deploy the application from the marketplace: GCP Marketplace