Skip to main content
Version: v4.0.x

Release Notes

September 20, 2023 - Release 4.0.13​

This release contains minor bug fixes.

Bug Fixes​

  • An issue where etcd sometimes retained an incorrect state entry of cluster nodes during scaling operations is now resolved.

  • The issue where Palette does not display Helm Charts in third-party registries that contain charts without a logo URL is now resolved.

  • Longhorn and Cilium Helm Chart-based packs are fixed to deploy with correct values.

  • An issue where Palette was updating clusters when Pause Platform Updates was enabled at the project level is fixed. This issue did not cause nodes to repave or for clusters to become unhealthy.

September 1, 2023 - Release 4.0.8​

This release contains minor bug fixes.

Bug Fixes​

  • A bug that caused ARM64 Nvidia Jetson cluster deployment to fail has been resolved.

  • The problem with a blank drop-down Menu when trying to add a CoxEdge cloud account is resolved with a populated menu.

August 31, 2023 - Release 4.0.7​

This release contains minor bug fixes.

Bug Fixes​

  • A problem with Palette retaining original pack values in manifests after users apply modifications has been resolved.

August 27, 2023 - Release 4.0.0​

Palette 4.0.0 introduces new features and improvements, including Palette VerteX - a FIPS-compliant edition - and the Virtual Machine Orchestrator (VMO) which enables unified management of containerized applications and virtual machines in Kubernetes. Additionally, Palette 4.0.0 introduces a new Pack User Interface (UI) that improves the user experience for finding and installing packs. Check out the Upgrade Notes and release notes below to learn more about the new features and improvements in Palette 4.0.0.

Palette​

Breaking Changes​

  • Deploying Virtual Clusters directly into host clusters is no longer supported. Use Cluster Groups to deploy Virtual Clusters in host clusters. For guidance on deploying Virtual Clusters into a Cluster Group, check out the Add Virtual Clusters to a Cluster Group documentation.

Features​

  • The Virtual Machine Orchestrator (VMO) is now available in Palette. You can natively manage virtual machines from Palette. Palette uses kubevirt under the hood to facilitate the management of virtual machines. Review the VMO documentation to learn more.
  • Custom Pack registries now support the ability for you to upload your own SSL Certificate Authority (CA). You can use HTTPS to connect to your private registries by providing your SSL certificate. Refer to the Configure a Custom Pack Registry in Palette documentation to learn more.
  • A new Pack User Interface (UI) is available in Palette. This new UI allows you to search for packs across registries while providing you with important metadata. The new search experience improves the user experience for finding and installing packs.
  • Pack registries now support the Open Container Initiative (OCI) image format. This allows you to use OCI images in your custom pack registries instead of the previous Palette-specific format.
  • Palette now supports VMware vSphere 8.0. You can now deploy host clusters with VMware vSphere 8.0.
  • Host clusters deployed to VMware now support VMware NSX overlay networking.
  • Palette's internal message communication between components now uses the gRPC protocol. The previous usage of NATS has been deprecated and will be removed in a future release. You can review a network diagram of Palette's communication architecture on the Network Ports page. If you are using network proxies, we encourage you to review the gRPC and Proxies documentation for potential issues.
  • Pack deprecated status is now available in the Palette UI. This lets you identify which packs are deprecated and will be removed in future releases. Review the Maintenance Policy documentation to learn more.
  • Self-hosted Palette now provides a new installation method using the Palette CLI. You can now install a self-hosted Palette through the Palette CLI. The CLI provides an interactive installation experience allowing you to configure Palette's installation parameters. Check out the Install Enterprise Cluster documentation to learn more. The previous installation method using the Palette OVA Installer is deprecated and unavailable in this release.
  • Private Cloud Gateway (PCG) deployments are now available through the Palette CLI. You can now install a PCG through the Palette CLI. The CLI provides an interactive installation experience allowing you to configure the PCG installation parameters. Check out the Palette CLI PCG install command documentation to learn more. The previous installation method using the PCG Docker image is deprecated and unavailable in this release.
  • You can now specify namespace labels and annotations in a Container Network Interface (CNI), Container Storage Interface (CSI), and Add-on pack's YAML configuration. This allows you to specify labels and annotations that are applied to specific namespaces in the cluster. To learn more about configuring labels and annotations, refer to the Add-on Profile documentation.

Improvements​

  • You can now download different kubeconfig files for your host clusters in Palette. You can download an admin kubeconfig file or a user kubeconfig file. The admin kubeconfig file allows you to perform all actions on the cluster. In contrast, the user kubeconfig file is only accessible to those with the proper Palette permissions to access the cluster. To learn more, check out the Palette kubeconfig documentation.
  • You can now install a self-hosted Palette through the Palette CLI. The CLI provides an interactive installation experience allowing you to configure Palette's installation parameters. Learn more about the Palette EC command documentation.
  • The login banner message in Palette is now also exposed in the Palette CLI. Users logging in to Palette through the CLI will receive the same message as those logging in through the UI. Refer to the Login Banner documentation to learn more.
  • You can now configure the logout timer for users in Palette. This allows you to set the time a user can be inactive before they are automatically logged out of Palette. The default value is 240 minutes.
  • Private Cloud Gateway (PCG) deployments and self-hosted Palette Enterprise Clusters (EC) are now deployed with Kubernetes version 1.25.
  • Palette now supports Kubernetes 1.27.x. You can deploy host clusters with Kubernetes 1.27.x.
  • The Cox Edge provider is upgraded to version 0.5.0.
  • You can now access Palette documentation directly from the Palette UI. This allows you to quickly access the documentation for the page you are currently on. You can find the documentation link in the top right corner of the Palette UI.
  • Palette now supports configuring the time interval for node repavement. The time interval is the amount of time that Palette waits before it starts the node replacement process on nodes in the cluster. The default time interval is 15 minutes. Refer to the Node Pool documentation to learn more.

Deprecations and Removals​

  • The Palette OVA Installer is deprecated and no longer provided as of this release. Self-hosted Palette now provides a new installation method using the Palette CLI. The CLI provides an interactive installation experience allowing you to configure Palette's installation parameters. Check out the Install Enterprise Cluster documentation to learn more.
  • The Palette PCG Docker installation method is deprecated and not available in this release. You can now install a PCG through the Palette CLI. The CLI provides an interactive installation experience allowing you to configure Palette's installation parameters. Check out the Palette CLI PCG install command documentation to learn more.

Known Issues​

  • With the deprecation of deploying Virtual Clusters directly into host clusters. The ability to specify an Add-on profile to a Palette Virtual Cluster is currently unavailable. This will be addressed in an upcoming release.

Edge​

Features​

  • Palette Edge now supports ARM64 architecture. This is a preview feature and still active in development. You can deploy Palette Edge on ARM64 architecture, such as Nvidia Jetson (Orin). Review the list of available ARM64 packs in Palette before deploying Palette Edge on ARM64 architecture.
  • Palette Edge now supports the ability for you to configure OIDC Identity Providers (IDP) at the Kubernetes layer of a Cluster Profile. Refer to the Kubernetes distributions pack documentation to learn more.

Improvements​

  • You can now assign dynamic tags to your edge hosts by specifying files or invoking a script that returns a JSON payload containing the tag values. This allows you to dynamically assign tags to your Edge hosts based on the host's local environment. Refer to the Edge Installer Configuration Tags documentation to learn more.
  • You can now skip the auto registration of Edge hosts in Palette. This allows you to manually register your Edge hosts in Palette by either using the QR code method or by providing the machine ID in Palette. Set the Edge Installer configuration parameter disableAutoRegister to true to turn off auto registration. Refer to the Edge Installer Configuration documentation to learn more.
  • You can configure the node drainage behavior for your Edge hosts. To learn more about configuring node drainage, refer to the Bring Your Own OS (BYOOS) pack documentation.

Known Issues​

  • Palette eXtended Kubernetes - Edge (PXKE) and RKE2 cannot be upgraded from version 1.26.4 to 1.27.2 in an active cluster. Create a new cluster profile with the latest version of PXKE or RKE2 to upgrade to version 1.27.2. This will be addressed in an upcoming release.

Palette Dev Engine (PDE)​

Features​

  • A Visual Studio Code (VS Code) extension is now available for Palette Dev Engine (PDE). This extension allows you to deploy and manage virtual clusters directly from VS Code. To learn more, you can review the Palette PDE Plugin documentation.
  • The Palette CLI now supports managing App Profiles and Apps in Palette Dev Engine (PDE). You can now create, update, and delete App Profiles and Apps directly from the CLI. Use the palette pde app-profile and palette pde app commands to manage App Profiles and Apps. Refer to the Palette CLI documentation or use the --help flag to learn more.

Virtual Machine Orchestrator (VMO)​

Features​

  • Host clusters supporting Virtual Machine (VM) workloads can now be placed in host maintenance mode, with the ability to choose which Kubernetes node to place in maintenance mode. When a node is placed in maintenance mode, also known as “cordoned”, the VM workload is automatically migrated without any disruptions to another healthy node in the cluster.
  • VMO supports the ability to import a VMware OVA template from VMware vSphere into Palette. This allows you to import a VM template from VMware vSphere into Palette and deploy it as a VM workload in a host cluster.
  • You can now migrate a VM from VMware vSphere to a host cluster in Palette through the Palette CLI. The CLI provides an interactive migration experience allowing you to configure the VM migration parameters.

VerteX​

Features​

  • Palette VerteX is now available and brings FIPS 140-2 cryptographic modules to the Palette management platform and deployed clusters. Palette VerteX is available to all government and private sector organizations that value strong data protection, backed by the Spectro Cloud Government practice, a growing ecosystem of specialist channel partners, and continental US technical support. Refer to the Palette VerteX documentation to learn more.
  • You can install Palette VerteX in a VMware environment through the Palette CLI. The CLI provides an interactive installation experience allowing you to configure Palette VerteX's installation parameters. To learn more, refer to the Palette VMware install instructions documentation. You can also install Palette VerteX in a FIPS-certified Kubernetes cluster. Check out the Kubernetes install instructions for more details.

Terraform​

Education​

  • A new Edge tutorial is available to learn how to deploy an Edge cluster using Palette with VMware. The Deploy an Edge Cluster on VMware provides an end-to-end tutorial that walks you through creating Edge artifacts, creating a Cluster Profile, and deploying an Edge cluster on VMware.
  • The documentation site for Palette now provides a chatbot capable of answering your questions about Palette. The chatbot is available in the bottom right corner of the documentation site. You can ask the chatbot questions about Palette, and it will provide you with relevant answers and documentation links.

Packs​

Pack Notes​

  • A new community pack repository is available. The Palette Community Repository allows partners and customers to contribute and share their packs. For more details, refer to the Palette Community Repository README.

  • The Spectro-VM-Dashboard pack is renamed to Virtual Machine Orchestrator.

  • This release introduces the start of a formal maintance policy for packs. Several packs are now marked as deprecated, disabled, and deleted. A completed list of packs that are deprecated, disabled, and deleted is available in the Deprecations and Removals section below. To learn more about the pack maintenance policy, refer to the Maintenance Policy documentation.

The following news packs are available in Palette 4.0.0.


Kubernetes​

PackNew Version
K3s1.27.2
Kubernetes AKS1.27.0
Kubernetes Coxedge1.25.10
Kubernetes Coxedge1.26.5
Kubernetes Coxedge1.27.2
Kubernetes EKS1.27.0
Kubernetes GKE1.24.14
Kubernetes GKE1.25.10
Kubernetes GKE1.26.5
Kubernetes GKE1.27.2
MicroK8s1.27.0
Palette eXtended Kubernetes1.24.14
Palette eXtended Kubernetes1.25.10
Palette eXtended Kubernetes1.26.5
Palette eXtended Kubernetes1.27.1
Palette eXtended Kubernetes - Edge1.27.2
RKE21.24.6
RKE21.25.10
RKE21.26.3
RKE21.26.5
RKE21.27.2

CNI​

PackNew Version
AWS VPC CNI1.13.0
AWS VPC CNI1.17.0
Calico3.25.1
Calico3.26.0
Cilium OSS1.14.0
Flannel0.22.0

CSI​

PackNew Version
AWS EBS CSI1.17.0
AWS EBS CSI1.20.0
AWS EFS CSI1.5.06
Azure Disk CSI1.26.3
Longhorn CSI1.4.1
Portworx CSI3.0.0
Rook Ceph1.11.9
vSphere CSI3.0.0
vSphere CSI3.0.2

Add-on Packs​

PackNew Version
AWS ALB2.5.1
AWS Cluster Autoscaler1.26.3
External Secrets Operator0.8.1
Image Swap1.5.2
MetalLB0.13.10
Nvidia GPU Operator23.3.2
Open Policy Agent3.12.0
Prometheus Grafana46.4.0
Vault0.25.0

Community Packs​

PackNew Version
Ngrok Ingerss Controller0.9.0

FIPS Packs​

PackNew Version
AWS EBS CSI1.17.0
AWS VPC CNI1.1.17
Calico3.25.1
Calico3.4.1
Longhorn CSI1.4.1
Palette eXtended Kubernetes1.24.10
Palette eXtended Kubernetes1.24.13
Palette eXtended Kubernetes1.24.14
Palette eXtended Kubernetes1.25.6
Palette eXtended Kubernetes1.25.9
Palette eXtended Kubernetes1.25.10
Palette eXtended Kubernetes1.26.3
Palette eXtended Kubernetes1.26.4
Palette eXtended Kubernetes1.26.5
Palette eXtended Kubernetes1.27.1
Palette eXtended Kubernetes1.27.2
Palette eXtended Kubernetes - Edge (PXKE)1.24.13
Palette eXtended Kubernetes - Edge (PXKE)1.25.9
Palette eXtended Kubernetes - Edge (PXKE)1.26.4
Palette eXtended Kubernetes - Edge (PXKE)1.27.2
RKE21.24.6
RKE21.25.0
RKE21.25.2
RKE21.25.10
RKE21.26.4
RKE21.26.5
RKE21.27.2
vSphere CSI3.0

Deprecations and Removals​

The following packs are marked as deprecated, disabled, or deleted. Refer to the Maintenance Policy for more details on the deprecation and removal process.


Operating Systems​

PackVersionStatus
OpenSuse Leap15.4Disabled
Ubuntu (For Edge)20.04Disabled
Ubuntu (For Edge)22.04Disabled

Kubernetes​

PackVersionStatus
MicroK8s1.23Deprecated
Konvoy1.19.10Deleted
Konvoy1.19.15Deleted
Konvoy1.20.8Deleted
Konvoy1.20.11Deleted
Konvoy1.21.6Deleted
Kubernetes AKS1.22Deleted
Kubernetes AKS1.23Deleted
Kubernetes AKS1.24Deleted
Kubernetes Coxedge1.21.14Deprecated
Kubernetes Coxedge1.22.12Deprecated
Kubernetes Coxedge1.23.9Deprecated
Kubernetes EKS1.17Deprecated
Kubernetes EKS1.18Deprecated
Kubernetes EKS1.18Deprecated
Kubernetes EKS1.19Deprecated
Kubernetes EKS1.20Deprecated
Kubernetes EKS1.21Deprecated
Kubernetes EKS1.22Deprecated
Kubernetes EKS1.23Deprecated
Kubernetes EKSD1.18.9Disabled
Kubernetes EKSD1.19.6Disabled
Kubernetes EKSD1.20.8Disabled
Kubernetes EKSD1.21.6Disabled
Kubernetes GKE1.24.10Deleted
Kubernetes GKE1.25.7Deleted
Kubernetes GKE1.26.4Deleted
K3s1.22.13Deprecated
K3s1.22.15Deprecated
K3s1.23.10Deprecated
K3s1.23.12Deprecated
K3s1.24.6Deprecated
Palette eXtended Kubernetes (PXK)1.19.0Deprecated
Palette eXtended Kubernetes (PXK)1.19.4Deprecated
Palette eXtended Kubernetes (PXK)1.19.5Deprecated
Palette eXtended Kubernetes (PXK)1.19.6Deprecated
Palette eXtended Kubernetes (PXK)1.19.7Deprecated
Palette eXtended Kubernetes (PXK)1.19.8Deprecated
Palette eXtended Kubernetes (PXK)1.19.9Deprecated
Palette eXtended Kubernetes (PXK)1.19.10Deprecated
Palette eXtended Kubernetes (PXK)1.19.11Deprecated
Palette eXtended Kubernetes (PXK)1.19.12Deprecated
Palette eXtended Kubernetes (PXK)1.19.13Deprecated
Palette eXtended Kubernetes (PXK)1.19.14Deprecated
Palette eXtended Kubernetes (PXK)1.19.15Deprecated
Palette eXtended Kubernetes (PXK)1.19.16Deprecated
Palette eXtended Kubernetes (PXK)1.20.0Deprecated
Palette eXtended Kubernetes (PXK)1.20.1Deprecated
Palette eXtended Kubernetes (PXK)1.20.2Deprecated
Palette eXtended Kubernetes (PXK)1.20.4Deprecated
Palette eXtended Kubernetes (PXK)1.20.5Deprecated
Palette eXtended Kubernetes (PXK)1.20.6Deprecated
Palette eXtended Kubernetes (PXK)1.20.7Deprecated
Palette eXtended Kubernetes (PXK)1.20.8Deprecated
Palette eXtended Kubernetes (PXK)1.20.9Deprecated
Palette eXtended Kubernetes (PXK)1.20.10Deprecated
Palette eXtended Kubernetes (PXK)1.20.11Deprecated
Palette eXtended Kubernetes (PXK)1.20.12Deprecated
Palette eXtended Kubernetes (PXK)1.20.14Deprecated
Palette eXtended Kubernetes (PXK)1.21.0Deprecated
Palette eXtended Kubernetes (PXK)1.21.1Deprecated
Palette eXtended Kubernetes (PXK)1.21.2Deprecated
Palette eXtended Kubernetes (PXK)1.21.3Deprecated
Palette eXtended Kubernetes (PXK)1.21.5Deprecated
Palette eXtended Kubernetes (PXK)1.21.6Deprecated
Palette eXtended Kubernetes (PXK)1.21.8Deprecated
Palette eXtended Kubernetes (PXK)1.21.10Deprecated
Palette eXtended Kubernetes (PXK)1.21.14Deprecated
Palette eXtended Kubernetes (PXK)1.22.7Deprecated
Palette eXtended Kubernetes (PXK)1.22.12Deprecated
Palette eXtended Kubernetes (PXK)1.23.4Deprecated
Palette eXtended Kubernetes (PXK)1.23.9Deprecated
Palette eXtended Kubernetes (PXK)1.23.16Deprecated
Palette eXtended Kubernetes (PXK)1.23.17Deprecated
Palette eXtended Kubernetes - Edge (PXKE)1.22.15Deprecated
Palette eXtended Kubernetes - Edge (PXKE)1.23.12Deprecated
Palette eXtended Kubernetes - Edge (PXKE)1.24.6Deprecated
RKE21.22.12Disabled
RKE21.22.13Deprecated
RKE21.22.15Deprecated
RKE21.23.9Disabled
RKE21.23.10Deprecated
RKE21.23.12Deprecated
RKE21.24.6Deprecated

CNI​

PackVersionStatus
Calico3.9Deprecated
Calico3.10Deprecated
Calico3.16Deprecated
Calico3.19Deprecated
Calico3.22Deprecated
Cilium OSS1.10.9Deprecated
Cilium OSS1.12.3Deprecated
Cilium OSS1.12.4Deprecated
Flannel CNI0.10.0Deprecated

CSI​

PackVersionStatus
AWS EBS CSI1.0.0Deprecated
AWS EBS CSI1.5.1Deprecated
AWS EBS CSI1.8.0Deprecated
AWS EBS CSI1.10.0Deprecated
AWS EBS CSI1.12.0Deprecated
AWS EFS CSI1.3.6Deprecated
Azure CSI Driver1.20.0Deprecated
Azure Disk1.0.0Deprecated
GCE Persistent Disk CSI1.7.1Deprecated
GCE Persistent Disk1.0.0Deprecated
Openstack Cinder1.18Deprecated
Openstack Cinder1.19Deprecated
Openstack Cinder1.20Deprecated
Openstack Cinder1.21Deprecated
Openstack Cinder1.22Deprecated
Openstack Cinder1.23Deprecated
Portworx CSI AWS2.9.0Deprecated
Portworx CSI AWS2.10Deprecated
Portworx CSI GCP2.6.1Deprecated
Portworx CSI Generic2.11.2Deprecated
Portworx CSI Generic2.11.4Deprecated
Portworx CSI Vsphere2.8.0Deprecated
Portworx CSI Vsphere2.9.0Deprecated
Portworx CSI Vsphere2.10Deprecated
Rook-Ceph CSI1.5.9Deprecated
VSphere CSI1.0.0Deprecated
VSphere CSI2.3.0Deprecated
VSphere CSI2.5.2Deprecated
VSphere Volume1.0.0Deprecated

Add-on​

PackVersionStatus
AWS Cluster Autoscaler1.0.0Deprecated
AWS EFS Addon1.3.6Deprecated
Dex2.21.0Deprecated
Dex2.25.0Deprecated
Dex2.28.0Deprecated
External DNS0.7.2Deprecated
External Secrets8.5.0Deprecated
External Secrets Operator0.5.6Deprecated
External Secrets Operator0.6.0Deprecated
Hashicorp Vault0.3.1Deprecated
Hashicorp Vault0.6.0Deprecated
Hashicorp Vault0.9.0Deprecated
Hashicorp Vault0.11.0Deprecated
Hashicorp Vault0.17.1Deprecated
Hashicorp Vault0.20.1Deprecated
Image Swap1.4.2Deprecated
Istio1.6.2Deprecated
Kong1.4Deprecated
Kubernetes Dashboard2.0.1Deprecated
Kubernetes Dashboard2.1.0Deprecated
Kubernetes Dashboard2.4.0Deprecated
Kubernetes Dashboard2.5.1Deprecated
MetalLB0.8.3Deprecated
MetalLB0.9.5Deprecated
Nginx0.26.1Deprecated
Nginx0.43.0Deprecated
Nginx1.0.4Deprecated
Nginx1.2.1Deprecated
Nginx1.3.0Deprecated
Nvidia GPU Operator1.9.1Deprecated
Open Policy Agent3.5.1Deprecated
Open Policy Agent3.6.0Deprecated
Palette Upgrader3.0.51Deprecated
Palette Upgrader3.0.70Deprecated
Palette Upgrader3.0.95Deprecated
Palette Upgrader3.1.26Deprecated
Portworx Generic Addon2.11.2Deprecated
Portworx Generic Addon2.11.4Deprecated
Prometheus Operator12.3.0Deprecated
Prometheus Operator19.2.3Deprecated
Prometheus Operator30.0.3Deprecated
Prometheus Operator30.2.0Deprecated
Prometheus Operator35.5.1Deprecated
Prometheus Operator37.2.0Deprecated
Reloader0.0.104Deprecated
Spectro Proxy1.0.0Deprecated
Spectro Proxy1.1.0Deprecated

September 21, 2023 - Release 3.4.114​

This release contains a minor bug fix.

Bug Fix​

  • The Throttling error that reports a failure to create, update, and reconcile Auto Scaling Groups (ASG) tags is fixed. Previously, Palette reconciled tags every two minutes regardless of differences. Palette now reconciles tags only when it detects differences.

May 22, 2023 - Release 3.4.0​

Palette 3.4.0 has various security upgrades, better support for multiple Kubernetes environments, a new cluster deployment platform, and increased user customization options for Palette, Edge, and Palette Dev Engine. Additionally, it includes updates for several packs and stops supporting Kubernetes 1.23 in Azure Kubernetes Service (AKS). You can find upgrade notes for self-hosted Palette 3.4 in the Upgrade Notes documentation.

Palette​

Breaking Changes​

  • Installations of self-hosted Palette in a Kubernetes cluster now require cert-manager to be available before installing Palette. Cert-manager is used to enable Mutual TLS (mTLS) between all of Palette's internal components. Refer to the prerequisites section of Installing Palette using Helm Charts guide for more details.
  • Self-hosted Palette for Kubernetes now installs Palette Ingress resources in a namespace that Palette manages. Prior versions of Palette installed internal components ingress resources in the default namespace. Review the Upgrade Notes to learn more about this change and how to upgrade.

Features​

  • Palette's tenant administrators now have the ability to set up a personalized login banner for both the system and tenant levels. Refer to the Login Banner reference page to learn more.
  • You can now access a customized Amazon Machine Image (AMI) in Palette for Amazon Elastic Kubernetes Service (Amazon EKS) with support for AWS Launch Template. This allows you to personalize your EKS nodes and EBS root volumes by creating your own custom AMI.
  • Palette now supports using IAM Roles for Service Accounts (IRSA) for AWS clusters. Enable the Palette managed policy Controllers EKS Policy to enable this feature. Refer to the AWS Required Policies for more information about the managed policy.
  • You can now deploy clusters in the Google Kubernetes Engine (GKE) environment with Palette. Use the Create and Managed GCP GKE Cluster guide to learn how to deploy clusters to GKE with Palette.
  • Palette now supports the ability for you to use image swap to override specific registries, images, or a combination of both. You can add an imageSwap configuration to the Kubernetes pack YAML to point to a different registry or image. Check out the Image Swap reference resource to learn more.
  • Deploying a host cluster to AWS with Red Hat Enterprise Linux (RHEL) as the Operating System (OS) is now possible. This can be done by utilizing the Bring Your Own Operating System (BYOOS) pack, which allows for the creation of a custom AMI based on RHEL.

Improvements​

  • OpenID Connect (OIDC) identity provider configuration has now moved to the Kubernetes layer. You can now select the desired OIDC setting when selecting a Kubernetes distribution and version during a cluster profile creation.
  • New macros for gathering attributes about a cluster profile, such as name, uid, and version, are now available. Refer to the Macros Supported Variables documentation to learn more.
  • Cluster profiles can now be filtered by scope such as Tenant and project.
  • The tenant administrator dashboard now displays the cluster usage and cost information at the tenant scope.
  • The Cox Edge cluster deployment wizard now populates a Point of Presence (PoP) list to help you select the geographical deployment target.
  • As a tenant administrator, you can now quickly review all Edge hosts that are deployed in your tenant and quickly identify which project they belong to.
  • The Cox Edge provider has been updated to support worker nodes' load balancers and customizable volume mounts for virtual machines.
  • The Metal as a Service (MAAS) provider has been updated to improve the node reconciliation behavior. In scenarios where the Machine Intelligent Platform Management Interface (IPMI) is powered off, the machine is powered on instead of provisioning a new node.

Bug Fixes​

  • A bug that caused issues with the deletion of a cluster's profile manifest has been successfully fixed. Manifests are now correctly deleted when removed from a cluster profile.
  • The problem with Palette not removing namespaces when removing a layer from a cluster profile has been resolved.
  • You can now configure the behavior of the Palette agent to disable sending workload reports to the Palette control plane. This addresses scenarios where large clusters with many nodes exceed the 1 MB payload threshold, resulting in agent failures. Refer to the Nodes Troubleshooting for guidance on disabling the workload report feature.

Edge​

Breaking Changes​

  • To enhance the security of Edge deployments, a tenant registration token created by the Tenant administrator is now required for pairing an Edge host with Palette. However, you can continue to use the auto registration, QR code, and manual registration methods available today. Refer to the Register Edge Host documentation to learn more about Edge registration methods.
  • Prior Edge Installer versions are incompatible with Palette 3.4 and newer versions due to product enhancements and security fixes. New Edge clusters deployed with an earlier Edge Installer version will not operate in Palette. Active Edge clusters in Palette will continue to work as expected. Use the latest version of the Edge Installer when creating Edge artifacts and deploying new Edge clusters.

Features​

  • You can now assign a static IP address to an Edge host during deployment. Previously, you could only assign a static IP address through the user-data configuration file. You can now set a static IP address by using the user-data configuration file, the Palette API, Terraform, or the Palette dashboard during the Edge host cluster creation wizard.
  • An Edge host ID can now be sourced directly from system files exposed by the BIOS or firmware via the Desktop Management Interface (DMI). Ensure that the system file is not empty and does not contain special characters, and the Edge installer will use the value in the file as the Edge host ID. This is an advanced feature and is not required for setting a device ID.
  • To deploy an Edge host device, use the Edge Forge workflow. The workflow allows you to customize the Edge Installer, include a user-agent configuration file, preload content bundles, and perform other functions according to your preferences. Visit the Edge Forge workflow page to learn more.

Improvements​

  • The events log stream for the Edge host cluster now includes audit messages and critical errors. Logs for an individual Edge host are now also accessible. The Edge host logs are helpful in debugging and monitoring the deployment process of an Edge host.
  • The upgrade process for Edge cluster has been optimized to avoid extra reboots of the Edge host, whether it's for upgrading the OS or the Kubernetes version.
  • The latest Kairos release information is now appended to the /etc/os-release file. Unlike previous versions of Pallette, the Kairos release information no longer replaces the entire content of the OS's release file. This change prevents any issues that may arise with tools like Nvidia's GPU Operator due to the previous overwrite behavior.
  • The Palette dashboard now displays Edge host clusters undergoing an upgrade process..

Palette Dev Engine (PDE)​

Features​

  • Palette PDE is now available in self-hosted installation of Palette.
  • PDE now has a Command Line Interface (CLI) that you can use for programmatic access to PDE resources. Users can perform actions such as create, list, delete, resize, pause, and resume virtual cluster. You can also download the kubeconfig file of a virtual cluster with the CLI. Refer to the Palette CLI documentation page to learn more.

Improvements​

  • Container applications that expose a service now automatically receive ingress support with HTTPS support out-of-the-box. This means exposed service URLs automatically receive dynamic SSL certificates used for HTTPS.
  • You can now access a new dashboard to better understand your virtual clusters, app profiles, deployed apps, and resource utilization. The dashboard provides a comprehensive overview of critical metrics and more.
  • You can now increase or decrease the number of replicated instances of a container service. Check out the Container Deployment guide to learn more about containerized deployments.

Terraform​

Packs​

Operating System Packs​

PackNew Version
COS GKE1.0.0
Edge Native BYOI1.0.0
SLES Libvirt15.4.1
SLES vSphere15.4.1
Ubuntu OpenStack22.04

Kubernetes Packs​

PackNew Version
Edge k3s1.25.2
Edge k8s1.25.2
Edge microk8s1.25
Edge RKE21.25.2
Kubernetes1.26.3
Kubernetes EKS1.26
Kubernetes GKE1.25.8

CNI Packs​

PackNew Version
CNI Calico3.25.1
CNI Calico Azure3.25.1
CNI Cilium1.13.2
CNI VPC Native GKE1.0.0
CNI Flannel0.21.4
CNI Cilium Tetragon0.9.0

CSI Packs​

PackNew Version
CSI AWS EBS1.17.0
CSI GCP Persistent Driver1.10.1
CSI Longhorn1.4.1
CSI OpenStack Cinder1.26
CSI Portworx Generic2.12.0
GKE CSI GCP Driver1.0.0
CSI vSphere3.0.0

Add-on Packs​

PackNew Version
Nvidia GPU Operator22.9.2
AVI Kubernetes Operator1.9.2
Istio1.17.2
Cloudanix1.0.0
CSI Longhorn1.4.1
CSI Topolvm11.1.1
External DNS0.13.4
Flux CD2.6.0
Kong2.17.0
Nginx1.7.0
Palette Upgrader3.3.16
Portworx2.13.0
Prometheus Agent19.0.2
Prometheus Operator45.25.0
Reloader1.0.24
Spectro k8s Dashboard2.7.1
HashiCorp Vault0.24.1

Pack Notes​

  • The CNI Calico pack version 3.25.1 is now available which contains support for IPV6 CIDR support has been added.

  • The Nvidia GPU Operator pack is available and can be used to install Nvidia GPU drivers on Nvidia hardware.

  • The AVI Kubernetes Operator (AKO) pack is now available. You can use this pack to provide L4-L7 load balancing for applications deployed in a Kubernetes cluster for north-south traffic network traffic. This pack is only available for VMware vSphere.

  • The vSphere CSI pack version 3.0.0 is available. This versions supports the usage of custom images for vSphere pods.

  • The CNCF Kubernetes pack is renamed to Palette eXtended Kubernetes.
  • Kubernetes versions before 1.24 are no longer supported for host clusters targeting Azure Kubernetes Service (AKS). This deprecation is due to Azure's Kubernetes support policy. You can learn more about Azure-supported Kubernetes versions here.

Education​

  • An introductory tutorial on deploying a Palette-managed cluster to public cloud providers is now available. Learn to deploy a host cluster with Palette using the Palette user interface or Terraform. Check out the Deploy a Cluster tutorial to get started.

March 19, 2023 - Release 3.3.0​

This release contains several security fixes and new features for Edge. The Edge installation process has been improved to allow users greater flexibility and more control over the installation process.

Palette​

Enhancements:​

  • Users can now download all the clusters listed when applying a filter to the clusters list.

Edge​

Features:​

  • Edge now supports the ability to load images from an external OCI registry.
  • The Edge Installer can now include preloaded content bundles containing packages and artifacts. This is useful for scenarios where you work with limited internet bandwidth or want to optimize the installation process.
  • Users can now create custom Edge Installer images to support advanced scenarios such as Bring Your Own Operating System (BYOOS), installing additional OS packages, preloading content into the installer, and more.
  • Support for creating Virtual Machine Disks (VMDK) from the Edge installer ISO is now available. Use this to simplify deployments into VMware-based environments.
  • Support for generating random UUID values for the Edge host is now available. This addresses the issue of some devices having the same Universal Unique Identifier (UUID) due to identical device identifiers.

Packs​

  • CNI Packs:
    • Calico CNI 3.25.0
  • CSI Packs:
    • EBS CSI 1.16.0
    • vSphere CSI 2.7.0
  • Add-on Packs:
    • Flux v2 2.6.0
    • Prometheus Operator 45.4.0
    • MetalLB 0.13.9
    • Spectro Proxy 1.3.0

February 28, 2023 - Release 3.2.0​

Release 3.2 introduces support for a new public cloud provider, Cox Edge. Other highlights include a streamlined experience for installing the Kubernetes Dashboard in a cluster, a new security scan, auto registration capabilities for edge devices, new out-of-the-box services, and many other product enhancements.

Palette​

Features​
  • Support for the Cox Edge cloud provider is now available in Palette.
  • Palette introduces a new user sign-in flow for users who previously created an account through SSO and who are a member of different organizations. Palette prompts you to select the organization to log in to. If you need help remembering, you can retrieve it using “Forgot your organization name?”.
  • Palette now provides a streamlined experience for users when installing Kubernetes dashboard. When adding Kubernetes dashboard as a pack, Palette displays relevant configuration items directly in the pack UI.
  • Palette now auto-cleans deleted clusters, deployments, cluster profiles, cloud accounts, edge hosts, and other resources. Users can expect auto cleanup to take approximately 15 minutes.
  • Additional filtering options are available to apply to clusters. Users can filter by region and country with pre-populated values based on cluster information and by ‘Unknown’ state.
  • Palette now provides a way to search and filter private cloud gateways (PCGs) by resource tag.
  • Palette provides the ability to schedule OS patching for enterprise clusters and PCGs. OS patching applies to clusters that have a master pool with multiple nodes.
  • Palette provides a tag.update permission that can be assigned to user roles that allows modifying resource tags.
  • Palette introduces a Software Bill of Materials (SBOM) scan capability that can be invoked manually or scheduled to run on tenant clusters. Multiple output formats are available.
  • Palette offers two new app services: CockroachDB and HashiCorp Vault.
  • Palette provides access to configuration and status logs for each application.
  • Palette now allows you to revise the order of layers as you create an app profile.
  • Virtual clusters now support the ability to back up all disk volumes within the cluster.
  • A system cluster profile named nginx-ingress is now available to help users set up ingress endpoints for cluster groups.

Enhancements​

  • Cluster groups that were previously supported only at the tenant scope are now supported at the project scope.
  • Palette has improved the launch time for virtual clusters.
  • Virtual clusters can be resized from the default to a size that does not exceed the system-level quota for a cluster group like Beehive or the user quota for tenant-level cluster groups.
  • Virtual clusters now display a progress status during the creation phase.
  • The App profile container service layer contains additional output variables to help services connect. Refer to the service connectivity document for additional guidance.
  • We optimized the Spectro Cloud Postman collection to circumvent a nested levels bug in Postman.

Deprecations​

  • Enabling virtual clusters on host clusters is deprecated. Use cluster groups to enable virtual clusters moving forward. Cluster groups are also now supported at the project scope.

Edge​

Features​

  • Palette provides the ability to automatically register edge hosts for a specific project when a host authentication token is specified in Tenant Settings > Registration Tokens.

  • Bring Your Own OS (BYOS) support.

Packs​

  • OS packs:
    • Ubuntu 22.04 on AWS, Azure, GCP
  • K8s packs:
    • Support for K8s 1.26.1
    • Support for K8s 1.25.6
    • Support for K8s 1.24.10
    • Support for K8s 1.23.16
    • Support for Tencent TKE 1.0.0 on VMware
  • CNI Packs:
    • Calico CNI 3.24.5
    • Cilium CNI 1.12.6
    • Antrea CNI for VMware 1.9.0
  • CSI Packs:
    • EFS CSI 1.4.9
    • Azure Disk CSI 1.25.0
    • GCE Persistent Disk CSI 1.8.2
    • Rook-Ceph CSI 1.10.0
  • Add-on Packs:
    • Kong Ingress 2.13.1
    • K8S Dashboard 2.7.0
    • External DNS 0.13.1
    • Open Policy Agent 3.11.0
    • Reloader 0.0.129
    • External 0.7.1
    • Vault 0.23.0
    • Nginx Ingress 1.5.1
    • AWS Application Load Balancer 2.4.6
    • Prometheus Operator 44.3.0
    • Bring Your Own OS (BYOS) pack 1.1.0
    • Spectro Proxy 1.2.0

December 28, 2022 - Release 3.1.0​

Palette 3.1 is released with support for AWS GovCloud, FIPS compliant PXK, and PXK-E Kubernetes versions. This release also features Autoscalers for IaaS clusters, FIPS enablement at the scope level, cluster tagging, and the ability to use tags for resource filtering and access control. The Palette Developer Experience (PDE) product also contains several enhancements that improve the user experience, such as the ability to pause and resume clusters, new services for app profiles, and more.

Palette​

Upgrade Notes:​

  • MaaS cluster's initialization configuration has been updated to disable memory swap. This will result in MaaS cluster nodes becoming repaved when applying the new configuration.

Features:​

  • Palette supports integration with AWS GovCloud services to meet the compliance mandates for safeguarding sensitive data by strengthening identity management, improving cloud visibility, and protecting accounts and workloads to support mission-critical workloads for government customers.
  • Autoscaling capabilities for Palette IaaS clusters to ensure better availability and cost management for dynamic workloads.
  • Palette is now compliant with FIPS compliance and provides a FIPS-compliant version of Kubernetes (PXK and PXK-E). Palette FIPS support is extended at the platform Level with the tenant and project Scope and cluster level with FIPS compliant infrastructure layer cluster profiles.
  • Palette supports tagging and the ability to filter user access and visibility to clusters using tags. You can filter geographically dispersed clusters in the Palette map view and list view using flexible filters to have a granular view of cluster information.
  • Palette supports app profile versioning. Versioning enables users to create multiple versions of an App Profile within the scope of a single profile name.
  • Palette supports the cloning of App Profiles across multiple projects. For example, you can clone an app profile created under a specific project to another project within the same tenant.
  • Palette Dev Engine supports the manual and system update of an App Profile. You can verify the update notification and apply the changes to the Apps.
  • Palette app mode now supports the use of containers. You can specify containers when creating an app profile.
  • Palette leverages Helm and OCI registries for custom pack management.
  • Palette provides out-of-the-box support for application services such as Kafka, MySQL, NATS, and more for Palette Dev Engine. These services can be specified when creating an App Profile.
  • Palette allows you to pause and resume virtual clusters that are not in use. This adds significant flexibility in managing the operating costs and optimizing resource management for virtual clusters.

Enhancements:​

  • OS patch reboot allows clusters to reboot to apply system updates if required.

  • Palette Tencent clusters now support using security groups for network isolation and improved security.

  • Reduced launch time when creating Palette Virtual Clusters.

  • Palette Virtual Clusters now support ephemeral storage.

Deprecations:​

  • Deprecated API : GET/v1/dashboard/projects , new API: POST /v1/dashboard/projects

  • Deprecated API: POST /v1/dashboard/spectroclusters , new API: POST /v1/dashboard/spectroclusters/search

Known Issues:​

  • Palette does not allow scaling of control plane nodes for the Microk8s pack. The workaround is to remove the scaling limit of the control plane.

  • Currently, Microk8s does not support an out-of-box service load balancer.

    • Work Around: To avoid this, you can install the AWS Application Load Balancer pack. The packs containing service type as a load balancer will require annotation and loadBalancerClass changes.

Edge​

Features:​

  • Palette supports the provision of MicroK8s clusters. Microk8s deployments are quick and ideal when creating disposal Kubernetes clusters. The MicroK8s pack supports automatic updates, security configuration, and the ability to self-update Kubernetes dependencies.

Spectro Image Updates:​

  • Private Cloud Gateway Installer updated to version 1.4.0.
  • On-Prem Installer updated to version 2.4.0.
  • Air Gap Repo Appliance updated to version 2.1.0.
  • EDGE Installer version 2.2.23.

Packs and Integrations:​

  • csi-longhorn version 1.3.1
  • csi-longhorn-addon version 1.3.1
  • kafka-operator version 0.32.0
  • mysql-operator version 0.6.2
  • nats-operator version 0.18.2
  • palette-upgrader version 3.0.70
  • palette-upgrader version 3.0.51
  • spectro-k8s-dashboard version 2.6.0

October 24, 2022 - Release 3.0.0​

Spectro Cloud Palette 3.0.0 is released with Native Edge, Palette Dev Engine, NOC-UI, and many more exciting capabilities.

Features

  • A new set of capabilities that improve the developer experience are introduced in this release:

    • Rapid Application deployment with a smooth onboarding experience.
    • RBAC with a developer-centric view.
    • System scope resource quota.
    • System Scope Cluster groups to host Palette Virtual Clusters.
    • Out-of-the-box application profiles and applications deployment with Palette Virtual Clusters.
    • Application profiles can consists of Helm charts, Manifests, and Database services such as MongoDB, Redis, PostgreSQL

  • The Palette Native Edge architecture is an instance of Palette Edge Distribution. The Palette Edge instance is based on the desired version of Operating System-Kubernetes installed natively onto the edge devices. All the Day 1 and Day 2 Operations starting from Installation to Scaling, Upgrades, and Reconfigurations, will be managed by the Palette Console.

  • Palette provides intuitive, location-based UI that monitors clusters with NOC-UI.

  • Palette enterprise mode production clusters can be backed up to Azure Blob storage for convenient restoration.

  • Palette provisions cluster monitoring with Kubernetes Dashboard exposed to external traffic using Spectro Proxy pack with RBAC authentication.

Enhancements

  • Palette enables the provisioning of private Azure Kubernetes Clusters (AKS) clusters within Azure Virtual networks (VNet) for enhanced security by offloading the orchestration to a Private Cloud Gateway deployed within the same account as the private AKS clusters.

  • Operators can now customize the pod limit for AKS clusters. Customize the pod limit value from the Kubernetes configuration file at any time by editing the maxPodPerNode value.

  • The Kubernetes Packs for Edge Native deployments disable a few items by default to allow users to install those items independently or to avoid duplication.

  • The latest Palette Terraform releases, Module 0.4.1 and Module 0.10.1, support:

    • Native Edge clusters
    • Palette Virtual Clusters
    • Fixes towards Enhancements

Packs and Integrations

  • Dex version 2.35.1
  • Harbor version 1.9.3
  • Istio version 1.14.3
  • Image Swap version 1.5.1
  • Generic-VM Libvirt version 1.0.1
  • Generic VM vSphere version 1.0.3
  • Tekton-chains version 0.12.0
  • Tekton-operator version 0.61.0
  • K3s version 1.24.4
  • Spectro Proxy version 1.1.0
  • External DNS version 0.12.2
  • MetalLB-version version 0.13.5
  • Reloader version version 0.0.118
  • AWS Cluster Autoscaler version 1.22.2
  • Fluentbit version 1.9.6
  • Kubernetes dashboard version 2.6.1
  • Calico version 3.24
  • Cert-Manager version 1.9.1
  • Open Policy Agent version 3.9.0
  • AWS EBS CSI version 1.10.0

Known Issues

  • While deploying multiple apps in a Palette Virtual Cluster, if the deployment of one of the apps is blocked due to errors, then subsequent apps deployed to the same virtual cluster might also be stuck in deploying state. Apply the following workarounds if you encounter the issue.

    • Delete the stuck App.
    • Fix the App with the error.
    • Redeploy the App again.

September 10, 2022 - Release 2.8.0​

Spectro Cloud Palette 2.8.0 is now available with the support of Palette Virtual Clusters, Web-Based Kubectl, Import and Export of Profiles, Terraform Releases, and many exciting enhancements.

Features

  • Palette now supports lightweight, cost-effective, secure, and resource-efficient Palette Virtual Clusters to rapidly create securely-isolated environments for applications without the infrastructure and operational overhead of additional Kubernetes clusters.
  • Palette leverages web-based Kubectl for the users to deploy applications, inspect and manage cluster resources, and view logs via the Palette terminal without an external terminal.
  • Palette enables the reuse and sharing of large profiles with many add-ons and integrations to be exported and imported across multiple environments, projects, and tenants.
  • Palette customers can now provision the fully conformant Kubernetes distribution RKE2 focusing on security and compliance.
  • The latest Palette Terraform releases, Module 0.2.3 and Module 0.3.0, focus on:
    • Cluster resource tagging
    • Static placement of AKS clusters
    • VMware cloud-type support of Terraform modules
    • Image template support

Enhancements

  • Palette upgrades the vSphere Private Cloud Gateways and On-Prem cluster specifications to newer versions:

    • K8s version has been upgraded from 1.21 to 1.22.12 [ the latest version in 1.22 ]
    • The storage layer has been upgraded from 2.3 to 2.5.2 to fix volume attachment issues
    • Ubuntu OS has been upgraded from LTS 18.04 to LTS 20.04
    • The PCG and On-Premise images now have all the latest OS patches updated

  • Palette enables Cluster(s) Lock to restrict the cluster(s) under the Tenant, Project, or single cluster from being upgraded from cluster management services upgrade on the upgrade of the Palette.

  • Palette feeds observability of OS patching details such as Last Applied Patch Time and The date and time of the last OS Patch.

  • Palette boards the mapping between cluster profiles and clusters in cluster profiles details UI page listing the clusters created using a specific cluster profile.

  • Palette promotes VNet Resource Group filtering for AKS clusters, allowing the VNet to be a part of a different resource group than the AKS resource group.

  • Palette enables the users to override the custom folder for vSphere templates, in addition to the default image template folder, spectro-templates for the vSphere environment.

  • Regex Expression for mass selection of workspace names for role binding.

  • Palette also leverages the single sign-on, using SAML/OIDC integration with Google Identity.

  • Palette enables the customers to optionally disable the OIDC associate provider for EKS clusters if the service provider restricts the cluster deployment in OIDC enabled state.

  • Tenant administrators can now set the Palette resource limits though the Palette console.

  • Palette provisions user's infrastructure privacy for the Azure cloud account.

Deprecations

  • API Deprecations

    • Deprecated API: GET /v1/clusterprofiles
      New API : POST /v1/dashboard/clusterprofiles with better filter support
    • Deprecated API: GET /v1/projects
      New API : POST /v1/dashboard/projects with better filter support
    • Deprecated API: GET /v1/spectroclusters
      New API : POST /v1/dashboard/spectroclusters with better filter support
    • Deprecated API: GET /v1/spectroclusters/{uid}/packs/{packName}/config.
      New API : GET /v1/spectroclusters/{uid}/profiles/{profileUid}/packs/{packName}/config with multiple cluster profiles support within cluster, the profileUid is required to locate a uniquely within the cluster

  • Pack Deprecations:

    • Azure Kubernetes Services (AKS) 1.21

Packs and Integrations

  • Nginx 1.3.0
  • Thanos - 10.5.3
  • EFK - 7.17.3
  • Kubernetes Dashboard - 2.6.0
  • Vault - 0.20.1
  • Calico - 3.23
  • Calico for Azure - 3.23
  • AWS EBS CSI - 1.8.0
  • AWS EFS - 1.4.0
  • AWS EFS -addon - 1.4.0
  • gce-pd-csi-driver-v1.7.1
  • Portworx-generic-addon-v2.11.2
  • Portworx-generic-v2.11.2
  • vSphere_csi_2.5.2

Known Issues

  • AKS Clusters in v1beta1 environment gives an empty report for Kubernetes Conformance Testing (Sonobuoy scan).
  • OS Patch information not getting displayed for clusters with os patch scheduled on boot.

July 17, 2022 - Release 2.7.0​

Spectro Cloud Palette 2.7 is released with advanced features supporting Windows Worker Node Pools, Canonical Ubuntu Advantage, Cluster Migration from Private Cloud Gateway, enhanced Workspace, and more.

Features:

  • Spectro Cloud Palette has enhanced the import cluster functionality with "Read-Only Mode" mode and the "Full Permission Mode" mode. Users can start exploring Palette by importing a cluster in a minimal model without granting the full administrative set of permissions. Over time, users can grant additional permissions to manage Day 2 operations.
  • Palette now supports Windows worker nodes in addition to the Linux worker nodes for Azure Kubernetes Services (AKS) clusters.
  • Palette ensures Security and OS patching benefits with Canonical's Ubuntu Advantage for Infrastructure subscription with Ubuntu as an OS layer for multiple operating environments.
  • Automatically scale the workload resources of your Azure Kubernetes Services (AKS) clusters with AKS Autoscaler to meet the dynamic user workloads.
  • Palette leverages the Container Storage Interface (CSI) and Container Network Interface (CNI) layers using Helm Chart in addition to manifest-based deployment.
  • Palette introduces a well-defined color scheme to monitor the different stages of pack deployment during cluster creation.
  • Palette Edge Clusters deployed on remote bare metal or virtual machines appliances providing end-to-end support on deployment, scaling, upgrades and reconfiguration.

Enhancements:

May 30, 2022 - Release 2.6.0​

Spectro Cloud Palette 2.6 is released to support Cluster Profile Version, EKS Secret Encryption, CSI Storageclass, and added Parameters capabilities.

Features:

  • Palette supports multiple versions of a single-cluster profile under a unique name to allow backward compatibility.

  • Palette leverages AWS Key Management Service (KMS) to provide envelope encryption of Kubernetes Secrets stored in Amazon Elastic Kubernetes Service (EKS) clusters.

  • Palette covers a long list of parameters and customization capabilities for the csi-aws-1.0.0 pack manifest.

Enhancement:

  • Palette allows reconciliation of the CSI layer Storageclass for managed clusters of Amazon Elastic Kubernetes Service (EKS).

Bug Fixes

  • We request our users to add the ec2:ReplaceRoute permission to the AWS and EKS-AWS cloud account Controller Policy to replace an existing route, within a route table in a Virtual Private Cloud, to facilitate the cluster deletion process.

April 26, 2022 - Release 2.5.0​

Spectro Cloud Palette 2.5.0 was released with support for Tencent Kubernetes Engine (TKE), Palette free service offerings, many enhancements, and bug fixes.

Features:

  • Palette now supports Tencent Kubernetes Engine (TKE)—a fully-managed Kubernetes service from Tencent Cloud. Deploy and manage the end-to-end life cycle of TKS clusters, effortlessly.
  • Palette introduces Placeholder Variables as Macros in our Cluster Profile layers for advanced regression and easier update of variables, across multiple running clusters.
  • Palette displays a well-organized Product Onboarding process to streamline user-product adoption, with an assured unfailing user experience, to jump-start our product journey.
  • Palette helps out new users in their purchase decision by offering free tier services.
    • Palette Freemium to explore Palette's capabilities with free and fixed kilo-Core-hour usage for finite cluster deployments.
    • Free Cloud Credit offers access to a free cloud account, with sufficient permissions and credentials, to have a first impression on our product journey.

Enhancements:

  • Palette users can now manually Force Delete a Cluster, stuck in the Deletion state for more than 15 minutes, through the User Interface.
  • Palette production clusters can be backed up to object storage of GCP Buckets for convenient restoration.

Bug Fixes:

  • We request our users to please add the ec2:DeleteNetworkInterface permission to their AWS cloud account Controller Policy Permissions to detach and delete the network interface for AWS and EKS clusters.

Packs and Integrations:

  • Ubuntu 20.04- A long term support release of highly popular Ubuntu Linux Operating System.
  • Imageswap-webhook—a mutating webhook integration that intercepts pod requests and changes to the container image location.

February 26, 2022 - Release 2.3.0​

Palette 2.3.0 includes the following enhancements:

  • Added support for cluster-centric detailed Namespace Management and granular RBAC. Previously this capability was only available via workspaces.
  • Enabled secure and straightforward user authentication with API Keys to access the APIs without referring to user credentials.
  • Tenant administrators can now get an aggregated view of clusters across all the projects under their tenant.
  • Added support for Taints that can be applied to a node pool to restrict a set of intolerant pods getting scheduled to an inadequate node.
  • Added support for Labels to constrain pods so that they can run on a particular set of nodes.
  • Enable multi-cluster backup and restore from workspaces.
  • New workspace user roles that provide granular control to specific actions within a workspace:
    • Workspace Operator - Allows only backup and restore capabilities within a workspace
    • Workspace Admin - Administrative privileges within a workspace
  • Palette will now perform a rolling upgrade on the nodes for any fundamental changes to the cluster config. Palette will keep track of the reason that triggered the rolling upgrade on the nodes in the cluster and is made accessible under Cluster Overview > Upgrade details.
  • Enable deployment of the single pack across multiple layers cluster profile layers.
  • Palette introduces a VM operator to allow Virtual Machine based applications to be modeled as Cluster Profile layers.

January 20, 2022 - Hotfix 2.2.26​

  • Palette Hotfix 2.2.26 supports custom Helm chart registry in Private Networks.
  • Helm registries can now be set up in Protected mode also. In protected mode, charts are configured in cluster profiles without being synchronized into the management console.
  • For the tenant clusters deployed in a private network, these charts from the protected Helm registries are downloaded and deployed by the Palette orchestrator.

December 24, 2021 - Release 2.2.0​

Palette 2.2.0 is released with the beta version of Edge Clusters along with upgraded Cluster API support.

The 2.2.0 Palette enhancements are:

  • Palette users can now provision and manage their Kubernetes clusters using edge appliances in addition to usual data centers or cloud environments.
  • Palette has been upgraded to use a newer version of the CNCF Cluster API for better automation, integration, and efficiency.
  • The upgraded Cluster API version used by Palette mandates the following pack updates:
    • Kubernetes 1.18.x and below are no longer supported. Please use Kubernetes version 1.19.x or above in the Cluster Profile.
    • vSphere CSI storage driver 1.0.x version is no longer supported for new Cluster Provisioning. Please upgrade your CSI Pack to 2.3.x for enhanced performance.
  • As part of Palette upgrade to 2.2.0, control plane node(s) of any existing vSphere cluster will be replaced.

November 20, 2021 - Release 2.1.0​

Palette 2.1.0 is released with the following key improvements:

  • Added support for replicated, cross-region Amazon Elastic Container Registries (ECR) whereby a single OCI registry within Spectro Cloud Palette can serve multiple deployment regions.
  • Spectro Cloud users can now join more than one tenant. Users belonging to multiple organizations must choose the desired tenant to log in to. This feature is also supported for SSO-enabled tenants.
  • Improved the UI of the Cluster Overview page. Visibility into basic cluster properties as well as cluster management actions such as configuration overrides, machine management, scan and backup policies, cluster deletion are now arranged under the Settings menu on the top right-hand side.

November 1, 2021 - Release 2.0.0​

We are excited to announce the Spectro Cloud platform's new name - "PALETTE". In addition, version 2.0 of our platform brings additional cost visibility, optimization features, enhanced governance, and control with Workspaces.

Our latest list of features includes:

  • Workspaces enable the association of relevant namespaces across clusters to manage access, obtain cost visibility, and get workload visibility by applications or teams.
  • Cluster health alert can be integrated with IT service management (ITSM) and collaboration tools such as Slack, ServiceNow, Microsoft Teams, etc.
  • Our built-in Spectro Proxy can be leveraged to establish seamless and secured access to the Kubernetes clusters in public and private data center environments.
  • Cluster cloud cost calculation for public and private clouds.
  • Granular usage cost break down by namespaces, workspaces, and projects based on actual resource utilization by pods, jobs, stateful sets, PVCs, etc.
  • Detailed visibility of resource utilization by cluster, namespaces, projects, and workspaces.

September 14, 2021 - Release 1.14.0​

Spectro Cloud 1.14 is released with additional health alert conveyances, secured log storage, transparent cost features, and scalable enterprise cluster backup.

  • Spectro Cloud users can now push their audit logs to the AWS Cloudtrail to enhance continuous monitoring and troubleshooting of the workload clusters.
  • Spectro Cloud layouts instantaneous and effortless monitoring of the cluster cloud cost.
  • Now Spectro Cloud users can receive real-time alerts on cluster health at hooked external applications.
  • Spectro Cloud enterprise mode production clusters can be backed up to object storage of S3 buckets for convenient restoration.
  • Spectro Proxy authentication pack to provision reverse proxy aided communication for clusters deployed in a private network belonging to local data centers.
  • Spectro Cloud has stepped up to an upgraded and stable API version for better automation, integration, and efficiency.

August 14, 2021 - Release 1.13.0​

Spectro Cloud users can now convert their bare-metal servers into flexible, cohesive, and distributed instances of virtual machines with the slightest efforts utilizing Metal as a Service (MAAS).

July 23, 2021 - Release 1.12.0​

Spectro Cloud 1.12 is released with generic cluster import, OpenID Connect (OIDC) support to handle identify management securely and seamlessly, and support for AKS—a managed Kubernetes Service offering from Azure cloud.

  • Now import existing non-Spectro clusters from any cloud platform using our Generic cluster import feature. We support broad operations like scans, backups, etc. on these imported clusters as well as provisioning and lifecycle management of add-ons.
  • Spectro Cloud now supports AKS, a fully-managed Kubernetes service from Azure. Deploy and manage end-to-end lifecycle of AKS clusters.
  • Spectro Cloud extends its SSO support by providing integration with OpenID Connect (OIDC). OIDC is the de facto standard to handling application authentication in the modern world. Through this integration, Spectro Cloud enables users to integrate single sign on, using various identify providers such as Amazon Cognito, Keycloak etc.
  • Kubernetes upgraded to version 1.19 for enterprise clusters.

June 28, 2021 - Release 1.11.0​

Spectro Cloud 1.11 is released with the support of OpenStack cloud and support for OIDC based authentication into Kubernetes clusters.

  • Spectro now supports deployment and management of Kubernetes clusters in OpenStack based private data centers.
  • Support for OIDC based authentication into Kubernetes clusters and preconfigured kubeconfig file to easily authenticate when using kubectl.

June 1, 2021 - Release 1.10.0​

Spectro Cloud 1.10 released with support for Amazon Elastic Kubernetes Service (EKS), cluster management policies to measure cluster compliance and perform backups and restores.

  • Provision and manage Kubernetes clusters using Amazon EKS service including support for advanced configurations like Fargate profiles, OIDC Authentication etc.
  • Scan your Kubernetes clusters to ensure they are conformant and compliant.
  • Consensus-driven security scan for the Kubernetes deployment with CIS Kubernetes Benchmarks.
  • Perform penetration tests to check for configuration issues that can leave the tenant clusters exposed to attackers.
  • Backup your Kubernetes clusters including any persistent volumes. Restore these backups as required on any cluster.

Note:

The following permissions are additionally required to be granted to the cloud accounts used to launch clusters on AWS. Please update your account to ensure that you have these new permissions included.

Add the following permissions to the IAM policy called NodePolicy if it was created as documented in Spectro Cloud documentation.

{
  "Effect": "Allow",
  "Action": ["secretsmanager:DeleteSecret", "secretsmanager:GetSecretValue"],
  "Resource": ["arn:*:secretsmanager:*:*:secret:aws.cluster.x-k8s.io/*"]
},
{
  "Effect": "Allow",
  "Action": [
    "ssm:UpdateInstanceInformation",
    "ssmmessages:CreateControlChannel",
    "ssmmessages:CreateDataChannel",
    "ssmmessages:OpenControlChannel",
    "ssmmessages:OpenDataChannel",
    "s3:GetEncryptionConfiguration"
  ],
  "Resource": ["*"]
}

Add the following permissions to the IAM policy called ControllerPolicy if it was created as documented in Spectro Cloud documentation.

{
  "Effect": "Allow",
  "Action": ["eks:AssociateIdentityProviderConfig", "eks:ListIdentityProviderConfigs"],
  "Resource": ["arn:aws:eks:*:*:cluster/*"]
},
{
  "Effect": "Allow",
  "Action": ["eks:DisassociateIdentityProviderConfig", "eks:DescribeIdentityProviderConfig"],
  "Resource": ["*"]
}

May 4, 2021 - Release 1.9.0​

Spectro Cloud 1.9.0 released with advanced support of security, availability and updates.

  • Spectro Cloud ensures users to start, run and scale highly-available and secure clusters with automated key tasks such as patching, node provisioning and updates with EKS support.
  • Now create and gain permission to your AWS cloud account by just using role ARN, without sharing long-term credentials.

March 29, 2021 - Release 1.8.0​

Spectro Cloud 1.8.0 released with advanced support for deploying & discovering Helm Charts and several usability enhancements!

Featuring

  • Set up public and private helm chart registries to leverage the vast database of integrations and add-ons.
  • Deploy reliable and secure Kubernetes clusters, without worrying about Kubernetes updates, dependencies and security patches using the EKS Distro (EKS-D).
  • Accumulate container logs across all cluster nodes to create a support bundle to enable faster troubleshooting.
  • Attach multiple supporting manifests to your cluster profile layers in order to deploy integrations end to end without having to use command line client.
  • Add additional BYOM (Bring Your Own Manifest) layers to your cluster profiles to perform ad-hoc customized deployments on the cluster.
  • You can now import and manage existing clusters running in your private VMware environment behind a proxy.
  • Discover charts deployed on your existing clusters and convert them into a cluster profile to use it as a template for future cluster deployments.
  • Enhanced cluster profile builder experience with several usability enhancements.

February 07, 2021 - Release 1.7.0

The following features and enhancements were released as part of 1.7.0

  • Support for existing Kubernetes clusters that were not deployed by Spectro Cloud to be imported into the Spectro Cloud platform for visibility, management and additional capabilities such as application lifecycle management
  • Automated as well as on-demand OS updates to keep cluster nodes up-to-date with the latest security fixes and enhancements.
  • Modularize cluster profiles as Core Infra, Add-on, and Full profiles; Apply multiple add-on profiles to a cluster.
  • Optimize AWS cloud cost utilizing spot instance pricing for cluster worker node pools.
  • Selectively upgrade on-premises Spectro Cloud instance to a desired version, as opposed to always having to upgrade to the latest version.

December 23, 2020 - Hotfix 1.6.4​

This release adds a fix for the permissions of vSphere GET folders.

December 13, 2020 - Release 1.6.0​

Our on-premises version gets attention to finer details with this release:

  • The Spectro Cloud database can now be backed up and restored.
  • Whereas previous on-premises versions allowed upgrading only to major versions, this release allows upgrading to minor versions of the Spectro Cloud platform.
  • Monitoring the installation using the dedicated UI now provides more details when migrating from the quick start version to the enterprise version.
  • AWS and GCP clusters can now be provisioned from an on-premises Spectro Cloud system.

On the VMware front, we have:

  • removed the dependency on the HA Proxy Load balancer for creating clusters via DHCP.
  • introduced dynamic folder creation in vCenter. This applies to every cluster, in all of the cluster virtual machines.
  • enabled support for DNS mapping in search domains on vSphere.

Other new features:

  • New customers can now sign up for free trials of Spectro Cloud. When ready, it is easy to upgrade plans and set up automatic payments using credit/debit cards.
  • Pack constraints have been enabled to reduce the chances of cluster deployment failures that might occur due to incorrect values being set.
  • Compatibility for Portworx version 2.6.1, Calico version 3.16, and for newer versions for Kubernetes.

December 03, 2020 - Hotfix 1.5.7​

In this hotfix, we added:

  • Compatibility for Calico 3.16.
  • The on-premises version now allows specifying CIDR for pods to allocate them an exclusive IP range.
  • It also allows allocating an IP range in the CIDR format exclusive to the service clusters.

The IP ranges for the pods, service clusters, and your IP network must not overlap with one another. This hotfix provides options to prevent node creation errors due to IP conflicts.

November 05, 2020 - Hotfixes 1.5.1 through 1.5.6​

A host of hotfixes were applied for a smoother on-premises operation:

VersionFeature
1.5.6Added improvements for faster kCh usage calculation.
1.5.5Patched the govc vm.info command to allow spaces in datacenter names.
1.5.4Changes to use client updates instead of patches for vendorcrd installations.
1.5.3Improved resource utilization by deleting a machine when a node is not available.
1.5.2Updates to keep sessions alive for SOAP and REST clients using the keepalive command.
1.5.1Fixed a bug that caused a trailing line to be added in the vsphere.conf file.

October 23, 2020 - Release 1.5.0​

The 1.5.0 release of the Spectro Cloud platform consists of the following features and enhancements:

  • On-Premise version of the Spectro Cloud platform for deployment into private VMWare environments.
  • Cloud accounts can now be created at the tenant scope, to allow accounts to be shared across all projects in the tenant.
  • Cross-compute cluster deployment of Private Cloud Gateway clusters for high-availability purposes.
  • SSH Public Key management to easily select the desired keys and share them across Kubernetes clusters within a project.
  • Improvements to cloud settings interface to simplify the creation of multiple failure domains during cluster provisioning.

September 10, 2020 - Release 1.2.0​

With release 1.2.0, users get more control and added support:

  • Users can now access Kubernetes cluster certificates and renew them.
  • For VMware, multi-domain support for private gateways is now available.
  • Also for VMware, layout changes have been made to improve usability.

August 21, 2020 - Release 1.1.0​

Release 1.1.0 is all about enhancing the user experience, providing tighter controls on clusters, and important bug fixes.

  • On the UI side, the login has been made faster. Additionally, users can now set up alerts to monitor cluster health. A Revert to default values button for cluster profiles is added.
  • Clusters are easier to launch with the Copy from Master button; bad deployments are now prevented for certain instances; scaling is easier with the Scale Strategy.
  • Private gateways can now be provisioned on static IPs with greater control on IP allocation using IP pools.
  • Updates to the CLI tool include more flags to the PUSH command for forcibly overwriting registry packs.
  • Bug Fixes: BET-806 related to SSO login and BET-403 related to validation of dependencies for availability zones have been resolved.

July 3, 2020 - Release 1.0.2​

  • Minor bug fixes for release 1.0.1.
  • Updates to the orchestration engine for the new regions.
  • Minor updates to the Istio integration.

July 3, 2020 - Release 1.0.1​

  • New Regions for AWS > Spectro Cloud is now available for deploying AWS clusters in the European regions.
  • Changes to the pricing structures > more usage = lesser price per kCh.

June 23, 2020 - Release 1.0​

The following features are included as part of Spectro Cloud 1.0:

  • Multi cluster deployment and lifecycle management of Kubernetes clusters across multiple cloud environments—AWS, Azure, and VMWare.
  • Security-hardened, compliant, and conformant Kubernetes clusters out of the box.
  • Cluster construction templates called Cluster Profiles.
  • Platform extensibility through custom integration packs.
  • Grouping of clusters logically into Projects for governance and control.
  • Rich set of enterprise features such as granular RBAC, Single Sign-on, detailed Audit logs, etc.
info

Spectro Cloud adopts relevant security best practices for operating systems, Kubernetes components, and cloud environments. All Spectro Cloud container images are scanned for CVEs before a release. While Spectro Cloud takes ownership of securing the cluster infrastructure, there may be additional 3rd party integrations installed on the Kubernetes clusters provisioned. Security of such 3rd party integrations, including their container images and associated configurations, is the responsibility of the provider.