Skip to content

Latest commit

 

History

History
600 lines (518 loc) · 18.7 KB

options.md

File metadata and controls

600 lines (518 loc) · 18.7 KB
Raw

SpinnakerService Options

You can find a skeleton of SpinnakerService at deploy/spinnaker/complete/spinnakerservice.yml

apiVersion: spinnaker.io/v1alpha2
kind: SpinnakerService
metadata:
  name: spinnaker
spec:
  # spec.spinnakerConfig - This section describes how to specify configurations spinnaker.
  spinnakerConfig:
    # spec.spinnakerConfig.config - This section contains the contents of a deployment found in a halconfig .deploymentConfigurations[0].
    config:
      version: 1.28.1   # - The version of Spinnaker that gets deployed.
      persistentStorage:
        persistentStoreType: s3
        s3:
          bucket: mybucket # - Change this to your bucket.
          rootFolder: front50

    # spec.spinnakerConfig.profiles - This section contains the YAML for each service's profile.
    profiles:
      clouddriver: {} # The contents of ~/.hal/default/profiles/clouddriver.yml
      # Deck has a special key "settings-local.js" for the contents of settings-local.js.
      deck:
        # settings-local.js - Contents of ~/.hal/default/profiles/settings-local.js.
        # Use the | YAML symbol to indicate a block-style multiline string.
        settings-local.js: |
          window.spinnakerSettings.feature.kustomizeEnabled = true;
          window.spinnakerSettings.feature.artifactsRewrite = true;
      echo: {}    # Contents of ~/.hal/default/profiles/echo.yml.
      fiat: {}    # Contents of ~/.hal/default/profiles/fiat.yml.
      front50: {} # Contents of ~/.hal/default/profiles/front50.yml.
      gate: {}    # Contents of ~/.hal/default/profiles/gate.yml.
      igor: {}    # Contents of ~/.hal/default/profiles/igor.yml.
      kayenta: {} # Contents of ~/.hal/default/profiles/kayenta.yml.
      orca: {}    # Contents of ~/.hal/default/profiles/orca.yml.
      rosco: {}   # Contents of ~/.hal/default/profiles/rosco.yml.

    # spec.spinnakerConfig.service-settings - This section contains the YAML of the service's service-setting.
    # See https://www.spinnaker.io/reference/halyard/custom/#tweakable-service-settings for available settings.
    service-settings:
      clouddriver: {}
      deck: {}
      echo: {}
      fiat: {}
      front50: {}
      gate: {}
      igor: {}
      kayenta: {}
      orca: {}
      rosco: {}

    # spec.spinnakerConfig.files - This section allows you to include any other raw string files not handled above.
    # The KEY is the filepath and filename of where it should be placed.
    #   - Files here will be placed into ~/.hal/default/ on halyard.
    #   - __ (double underscore) is used in place of / for the path separator.
    # The VALUE Contents of the file.
    #   - Use the | YAML symbol to indicate a block-style multiline string.
    #   - We currently only support string files.
    #   - NOTE: Kubernetes has a manifest size limitation of 1MB.
    files:
  #      profiles__rosco__packer__example-packer-config.json: |
  #        {
  #          "packerSetting": "someValue"
  #        }
  #      profiles__rosco__packer__my_custom_script.sh: |
  #        #!/bin/bash -e
  #        echo "hello world!"


  # spec.expose - This section defines how Spinnaker should be publicly exposed.
  expose:
    type: service  # Kubernetes LoadBalancer type (service/ingress). Note that only "service" is supported currently.
    service:
      type: LoadBalancer

      # Annotations to be set on Kubernetes LoadBalancer type
      # They only apply to spin-gate, spin-gate-x509, or spin-deck.
      annotations:
        service.beta.kubernetes.io/aws-load-balancer-backend-protocol: http
        # Uncomment the line below to provide an AWS SSL certificate to terminate SSL at the LoadBalancer.
        #service.beta.kubernetes.io/aws-load-balancer-ssl-cert: arn:aws:acm:us-west-2:9999999:certificate/abc-123-abc

      # Provide an override to the exposing KubernetesService
      overrides:
      # The following example is an example config for the Gate-X509 configuration
#        deck:
#          annotations:
#            service.beta.kubernetes.io/aws-load-balancer-ssl-cert: arn:aws:acm:us-west-2:9999999:certificate/abc-123-abc
#            service.beta.kubernetes.io/aws-load-balancer-backend-protocol: http
#        gate:
#          annotations:
#            service.beta.kubernetes.io/aws-load-balancer-ssl-cert: arn:aws:acm:us-west-2:9999999:certificate/abc-123-abc
#            service.beta.kubernetes.io/aws-load-balancer-backend-protocol: https  # X509 requires https from LoadBalancer -> Gate
#       gate-x509:
#         annotations:
#           service.beta.kubernetes.io/aws-load-balancer-backend-protocol: tcp
#           service.beta.kubernetes.io/aws-load-balancer-ssl-cert: null
#         publicPort: 443

  # Patching of generated service or deployment by Spinnaker service.
  # Like in Kustomize, several patch types are supported.
  kustomize: {}
    # An example to change Gate's image name using a strategic merge patch
#    gate:
#      deployment:
#        patchesStrategicMerge:
#          - |
#            spec:
#              template:
#                spec:
#                  containers:
#                  - name: gate
#                    image: gate:1.0.0

metadata.name

Name of your Spinnaker service. You'll use that name to view, edit, or delete Spinnaker.

Example with a prod name:

$ kubectl get spinsvc prod

Note: We use spinsvc for brevity. You can also use spinnakerservices.spinnaker.io.

.spec.spinnakerConfig.config

Same as the deployment content found in a halconfig .deploymentConfigurations[0].

For instance, given the following:

.~/.hal/config file

currentDeployment: default
deploymentConfigurations:
- name: default
  version: 1.28.1
  persistentStorage:
    persistentStoreType: s3
    s3:
      bucket: mybucket
      rootFolder: front50

We get the following spec.spinnakerConfig:

spec:
  spinnakerConfig:
    config:
      version: 1.28.1
      persistentStorage:
        persistentStoreType: s3
        s3:
          bucket: mybucket
          rootFolder: front50

.spec.spinnakerConfig.profiles

Configuration for each service profile. This is the equivalent of a ~/.hal/default/profiles/<service>-local.yml

For example:

spec:
  spinnakerConfig:
    config:
    ...
    profiles:
      gate:
        default:
          apiPort: 8085

NOTE: Deck's profile is a string under the key settings-local.js:

spec:
  spinnakerConfig:
    config:
    ...
    profiles:
      deck:
        settings-local.js: |
          window.spinnakerSettings.feature.artifactsRewrite = true;

spec.expose

Optional. Controls how Spinnaker gets exposed. If you omit this section, no load balancer gets created. If this section is removed, the Load Balancer does not deleted.

spec.expose.type

How Spinnaker gets exposed. Only service is currently supported for using Kubernetes services.

spec.expose.service

Service Configuration

spec.expose.service.type

Matches a valid kubernetes service type (i.e. LoadBalancer, NodePort, ClusterIP).

IMPORTANT: LoadBalancer is the only supported type currently.

spec.expose.service.annotations

Map containing any annotation to be added to Gate (API) and Deck (UI).

spec.expose.service.overrides

Map with key: Spinnaker service name (gate or deck) and value: structure for overriding the service type and specifying extra annotations. By default, all services receive the same annotations. You can override annotations for Deck (UI) or Gate (API).

spec.validation

Validation options that apply to all validations performed by the operator.

spec.validation.failOnError

Boolean. Defaults to true. If false, the validation runs and result get logged, but the service is always considered valid.

spec.validation.failFast

Boolean. Defaults to false. If true, validation stops at the first error.

spec.validation.frequencySeconds

Integer. Optional. Defines a grace period before a validation is re-run.

For instance, if you define a value of 120 and edit the SpinnakerService without changing an account within a 120 second window, the validation on that account does not run again.

Note: In the future, this will run validation while Spinnaker is running.

spec.validation.providers, spec.validation.ci, spec.validation.metricStores, spec.validation.persistentStorage, spec.validation.notifications

Optional. Maps of validation settings specific to certain providers/CI/etc. Supported settings are:

  • enabled: to turn off validation
  • failOnError
  • frequencySeconds

Example that disables all Kubernetes account validation:

spec:
  validation:
    providers:
      kubernetes:
        enabled: false

spec.accounts

Support for SpinnakerAccount CRD

spec.accounts.enabled

Defaults to false. If true, the SpinnakerService uses all SpinnakerAccount objects enabled.

Note: For now, accounts can be defined either in the config or as SpinnakerAccount. For instance, if you add a SpinnakerAccount of type kubernetes, accounts you've defined elsewhere won't be loaded.

spec.accounts.dynamic (experimental)

Boolean. Defaults to false. If true, SpinnakerAccount objects available to Spinnaker as the account is applied - without redeploying any service.

spec.kustomize

You can modify Deployment and Service manifests generated by the operator by applying patches - similarly to Kustomize. Patches are stored in the SpinnakerService and are applied in memory before manifests are saved.

Three types of patches are supported:

Type What is stored Order Applied
JSON merge patch List of patches as string (YAML or JSON) 1
JSON patch 6902 String representation of a list (YAML or JSON) - see http://jsonpatch.com 2
Strategic merge patch List of patches as string (YAML or JSON) 3

See examples.

Note: A lot of Kubernetes options can also be modified via Halyard settings. Halyard will be removed in the future and patches will remain the only way to customize manifests.

Expose Examples

Exposing Spinnaker with LoadBalancer services

apiVersion: spinnaker.io/v1alpha2
kind: SpinnakerService
metadata:
  name: spinnaker
spec:
  expose:
    type: service
    service:
      type: LoadBalancer
      annotations:
        "service.beta.kubernetes.io/aws-load-balancer-backend-protocol": "http"
        "service.beta.kubernetes.io/aws-load-balancer-ssl-ports": "80,443"
        "service.beta.kubernetes.io/aws-load-balancer-ssl-cert": "arn:aws:acm:us-west-2:xxxxxxxxxxxx:certificate/xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx"

Above manifest file generates these two services:

apiVersion: v1
kind: Service
metadata:
  annotations:
    service.beta.kubernetes.io/aws-load-balancer-backend-protocol: http
    service.beta.kubernetes.io/aws-load-balancer-ssl-ports: 80,443
    service.beta.kubernetes.io/aws-load-balancer-ssl-cert": arn:aws:acm:us-west-2:xxxxxxxxxxxx:certificate/xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx
  labels:
    app: spin
    cluster: spin-deck
  name: spin-deck
spec:
  ports:
 - name: deck-tcp
   nodePort: xxxxx
   port: 9000
   protocol: TCP
   targetPort: 9000
  selector:
   app: spin
   cluster: spin-deck
  sessionAffinity: None
  type: LoadBalancer
apiVersion: v1
kind: Service
metadata:
  annotations:
    service.beta.kubernetes.io/aws-load-balancer-backend-protocol: http
    service.beta.kubernetes.io/aws-load-balancer-ssl-ports: 80,443
    service.beta.kubernetes.io/aws-load-balancer-ssl-cert": arn:aws:acm:us-west-2:xxxxxxxxxxxx:certificate/xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx
  labels:
     app: spin
     cluster: spin-gate
  name: spin-gate
spec:
  ports:
  - name: gate-tcp
    nodePort: xxxxx
    port: 8084
    protocol: TCP
    targetPort: 8084
  selector:
    app: spin
    cluster: spin-gate
  sessionAffinity: None
  type: LoadBalancer

Exposing Spinnaker, different service types for Deck (UI) and Gate (API)

apiVersion: spinnaker.io/v1alpha2
kind: SpinnakerService
metadata:
  name: spinnaker
spec:
  expose:
    type: service
    service:
      type: LoadBalancer
      annotations:
        "service.beta.kubernetes.io/aws-load-balancer-backend-protocol": "http"
        "service.beta.kubernetes.io/aws-load-balancer-ssl-ports": "80,443"
        "service.beta.kubernetes.io/aws-load-balancer-ssl-cert": "arn:aws:acm:us-west-2:xxxxxxxxxxxx:certificate/xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx"
      overrides:
        gate:
          type: NodePort

Above manifest file generates these two services:

apiVersion: v1
kind: Service
metadata:
  annotations:
    service.beta.kubernetes.io/aws-load-balancer-backend-protocol: http
    service.beta.kubernetes.io/aws-load-balancer-ssl-ports: 80,443
    service.beta.kubernetes.io/aws-load-balancer-ssl-cert": arn:aws:acm:us-west-2:xxxxxxxxxxxx:certificate/xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx
  labels:
    app: spin
    cluster: spin-deck
  name: spin-deck
  spec:
  ports:
  - name: deck-tcp
    nodePort: xxxxx
    port: 9000
    protocol: TCP
    targetPort: 9000
  selector:
    app: spin
    cluster: spin-deck
  sessionAffinity: None
  type: LoadBalancer
apiVersion: v1
kind: Service
metadata:
  annotations:
    service.beta.kubernetes.io/aws-load-balancer-backend-protocol: http
    service.beta.kubernetes.io/aws-load-balancer-ssl-ports: 80,443
    service.beta.kubernetes.io/aws-load-balancer-ssl-cert": arn:aws:acm:us-west-2:xxxxxxxxxxxx:certificate/xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx
  labels:
    app: spin
    cluster: spin-gate
  name: spin-gate
spec:
  ports:
  - name: gate-tcp
    nodePort: xxxxx
    port: 8084
    protocol: TCP
    targetPort: 8084
  selector:
    app: spin
    cluster: spin-gate
  sessionAffinity: None
  type: NodePort

Exposing Spinnaker, different annotations for Deck (UI) and Gate (API)

apiVersion: spinnaker.io/v1alpha2
kind: SpinnakerService
metadata:
  name: spinnaker
spec:
  expose:
    type: service
    service:
      type: LoadBalancer
      annotations:
        "service.beta.kubernetes.io/aws-load-balancer-backend-protocol": "http"
        "service.beta.kubernetes.io/aws-load-balancer-ssl-ports": "80,443"
        "service.beta.kubernetes.io/aws-load-balancer-ssl-cert": "arn:aws:acm:us-west-2:xxxxxxxxxxxx:certificate/xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx"
      overrides:
        gate:
          annotations:
            "service.beta.kubernetes.io/aws-load-balancer-internal": "true"

Above manifest file generates these two services:

apiVersion: v1
kind: Service
metadata:
  annotations:
    service.beta.kubernetes.io/aws-load-balancer-backend-protocol: http
    service.beta.kubernetes.io/aws-load-balancer-ssl-ports: 80,443
    service.beta.kubernetes.io/aws-load-balancer-ssl-cert": arn:aws:acm:us-west-2:xxxxxxxxxxxx:certificate/xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx
  labels:
    app: spin
    cluster: spin-deck
  name: spin-deck
spec:
  ports:
  - name: deck-tcp
    nodePort: xxxxx
     port: 9000
     protocol: TCP
     targetPort: 9000
  selector:
     app: spin
     cluster: spin-deck
  sessionAffinity: None
  type: LoadBalancer
apiVersion: v1
kind: Service
metadata:
  annotations:
    service.beta.kubernetes.io/aws-load-balancer-backend-protocol: http
    service.beta.kubernetes.io/aws-load-balancer-ssl-ports: 80,443
    service.beta.kubernetes.io/aws-load-balancer-ssl-cert": arn:aws:acm:us-west-2:xxxxxxxxxxxx:certificate/xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx
    service.beta.kubernetes.io/aws-load-balancer-internal: true
  labels:
    app: spin
    cluster: spin-gate
  name: spin-gate
spec:
  ports:
 - name: gate-tcp
    nodePort: xxxxx
    port: 8084
    protocol: TCP
    targetPort: 8084
  selector:
    app: spin
    cluster: spin-gate
  sessionAffinity: None
  type: Loadbalancer

Exposing Spinnaker with X509

spec:
  config:
    profiles:
      gate:
        default:
          apiPort: 8085  
  expose:
    type: service
    service:
      type: LoadBalancer

      annotations:
        service.beta.kubernetes.io/aws-load-balancer-backend-protocol: http

      overrides:
      # Provided below is the example config for the Gate-X509 configuration
        deck:
          annotations:
            service.beta.kubernetes.io/aws-load-balancer-ssl-cert: arn:aws:acm:us-west-2:9999999:certificate/abc-123-abc
            service.beta.kubernetes.io/aws-load-balancer-backend-protocol: http
        gate:
          annotations:
            service.beta.kubernetes.io/aws-load-balancer-ssl-cert: arn:aws:acm:us-west-2:9999999:certificate/abc-123-abc
            service.beta.kubernetes.io/aws-load-balancer-backend-protocol: https  # X509 requires https from LoadBalancer -> Gate
       gate-x509:
         annotations:
           service.beta.kubernetes.io/aws-load-balancer-backend-protocol: tcp
           service.beta.kubernetes.io/aws-load-balancer-ssl-cert: null
         publicPort: 443

Kustomize examples

JSON merge patch

Add an initContainer to Spinnaker's Gate service.

apiVersion: spinnaker.io/v1alpha2
kind: SpinnakerService
spec:
  kustomize:
    gate:
      deployment:
        patches:
          - |
            spec:
              template:
                spec:
                  initContainers:
                  - name: init-myservice
                    image: busybox:1.28
                    command: ['sh', '-c', "sleep 10"]

Strategic Merge Patch

When a merge patch will just replace an array, a strategic merge patch will consider the structure being modified. The same as above could be done with a strategic merge patch. A more interesting example would be to change the image name of Gate. In that example, we could have one or more containers. We'll just change the one called gate:

apiVersion: spinnaker.io/v1alpha2
kind: SpinnakerService
spec:
  kustomize:
    gate:
      deployment:
        patchesStrategicMerge:
          - |
            spec:
              template:
                spec:
                  containers:
                  - name: gate
                    image: gate:1.0.0

JSON Patch 6902

This type of patching is done via operations (op, replace, remove) to manipulate the underlying document. We could for instance, remove Gate's deployment first volume mount:

apiVersion: spinnaker.io/v1alpha2
kind: SpinnakerService
spec:
  kustomize:
    gate:
      deployment:
        patchesJson6902: |
          - op: remove
            path: /spec/template/spec/containers/0/volumeMounts/1