Altinity Cloud Manager Release Notes - V22 and older

These are the release notes for Altinity Cloud Manager version 22 and older. You can go directly to a particular release through one of these links:

22.12.25

Released 2022-12-25

Added

  • User is notified with a warning sign when backups are not configured
  • User is notified with a popup message when data migration is completed or failed
  • ‘Delete table’ action is added to Data Consistency tab
  • List of databases granted to ClickHouse user are displayed
  • Quick filter was added in order to see unhealthy nodes on Dashboard page
  • Support Bare Metal environments as a hook for non-cloud customers billing
  • Markdown is supported for Notifications (Altinity only)
  • Recipients selection has been re-worked for Notifications (Altinity only)
  • Altinity is notified when user removed the payment method (Altinity only)

Changed

  • ‘Environment Settings’ was renamed to ‘Environment Variables’ on the cluster page
  • DBA tools UI was made more intuitive
  • Improved new Anywhere environment setup process
  • Improved Data Rebalance function that could sometimes move too much data
  • Backup configuration is moved to a separate resources instead of being bundled with ClickHouse configuration. This change requires restart.
  • Backup stability improvements, and clickhouse-backup:2.1.1 certification

Fixed

  • Fixed a bug when node status was not updated for a few minutes after ClickHouse cluster is up an running
  • Fixed a bug with backup being restored from AWS to GCP environments or vice versa could not be restored to a new cluster due to mismatching node types
  • Fixed a bug when Rescale ignored auto publishing being turned off
  • Fixed a bug when ‘Run DDL ON CLUSTER’ did switch off automatically when specific node is selected
  • Fixed a bug with rescaling GCP clusters in old tenants
  • Fixed a bug when profile settings could not be changed on a cluster that can not start
  • Fixed Data Migration tool that did not work in Anywhere environments due to hard-coded tolerations
  • Fixed a bug with backup compression format was not respected for GCP clusters
  • Fixed a bug with memory and volume graphs displaying incorrect data

22.11.30

Released 2022-11-14

Added

  • Used/available quota is now displayed when starting a cluster
  • New System Metrics Grafana dashboard
  • Reset Anywhere action in order to disconnect from the Anywhere environment
  • Rebalance data across storage volumes
  • Tracking customer credits when invoicing

Changed

  • In the list of accounts, environments for a particular account are now displayed
  • Anywhere connection wizard has been improved
  • Sensitive environment settings are back to readonly for non-Anywhere clusters
  • Multiple improvements to backup functionality
  • Multiple improvements to Copy Data between Clusters feature
  • Log storage has been migrated to Grafana Loki

Fixed

  • Fixed latest backup timestamp that has not been updated sometimes
  • StatusCheck now works for Anywhere environments
  • Billing estimates are now correct for Anywhere clusters
  • MaterializedView tables are now correctly restored when using Consistency check tool
  • Fixed a UI bug with ClickHouse version was not displayed when one of cluster nodes was down
  • Fixed Kafka Connection tool generated XML that was sometimes incorrect
  • Fixed Environment Variable settings page that did not allow to specify non-secret settings
  • Fixed a bug that did not allow to restore GCP backup to AWS or vice versa to an automatically created cluster due to incorrect node specifications
  • Billing reports are now displayed correctly for Anywhere clusters

22.10.24

Released 2022-09-15

Added

  • Allow to restrict access to cluster management for Altinity stuff
  • Setup and initial configuration of Anywhere environments
  • Dashboard is enabled for env and org admins
  • Copy Data feature is enabled for env and org admins
  • Logging into Loki for Anywhere tenants
  • Option to turn on ClickHouse SQL access management for users
  • New ‘Errors’ tab under DBA tools
  • New ‘Cluster Consistency’ tab under DBA tools
  • Pod status in the Node view
  • Environment variables from a k8s secret

Changed

  • Processes tab have been improved
  • Multi-statements now can be executed in Explorer
  • When ClickHouse cluster is upgraded to the new version, the UI now allows to easily pick Altinity.Stable and Community versions
  • ClickHouse version upgrade recommendations have been improved
  • When user returns with a direct cluster link, cluster Environment is automatically selected as a current one

Fixed

  • Fixed sort order in a list of nodes dropdown in Explorer
  • Fixed backup restore scenarios between different environments and clusters
  • Fixed a bug with detached parts could not be deleted for ‘.inner.’ tables
  • Fixed Kafka connection tool in GCP environments

22.9.21

Released 2022-08-15

Added

  • Added a feature to convert from non-replicated to replicated MergeTree (available for Altinity staff only)
  • Data Migration Tool to copy data between clusters (available for Altinity staff only)
  • New ‘Launch from Backup’ wizard that allows to pick any backup source, including outside of Altinity.Cloud
  • Replication status in Workload
  • Alert cluster owners when Altinity access level is changed
  • Backlink button to the Environment page
  • Proxy connection mode for Anywhere clusters

Changed

  • Workload tab was refactored to show 3 panels: Queries, Replication and Processes
  • Workload is sorted in descending order by default
  • Table creation hints were updated in Explorer
  • Improved loading test datasets feature
  • User is automatically redirected to the last visited page on re-login

Fixed

  • Fixed restoring a backup in sharded and replicated cluster with tables replicated to every shard
  • Fixed sorting order in dashboard
  • Last insert timestamp now displays timestamp for Kafka inserts correctly now
  • Fixed SELECT ALL IGNORED for detached parts

22.8.15

Released 2022-07-07

Added

  • New tool to review and remove detached parts
  • New tool to test connectivity to Kafka broker
  • New tool to import test datasets – available for 22.3 ClickHouse version and above

Changed

  • Default log level for new clusters is set to ‘information’. Users can edit log level using ’logger/level’ cluster setting
  • Storage size is displayed as ‘Pending’ if rescale has not been complete
  • Improved version upgrade recommendations
  • Improved Schema and Workload tabs

Fixed

  • Fixed a bug with uptime schedule that could unexpectedly stop clusters sometimes
  • Fixed a bug with memory configuration settings if cluster is resumed to the different node size

22.7.13

Released 2022-06-03

Added

  • User role is now displayed on Account page
  • A warning is displayed on ClickHouse version upgrade is available
  • Sorting has been added to the Schema tab
  • A tool to convert a table from MergeTree to ReplicatedMergeTree (available for superadmins only)
  • VPC Endpoint status is displayed on Connections popup
  • Custom tolerations can be specified for node types

Changed

  • User is automatically authenticated as ClickHouse admin when starting a new cluster
  • Schedule icon opens a Schedule popup now
  • When rescaling a volume, minimum rescale ratio is 20% of the volume size
  • Org admin can access Environment details now (previously it was only possible with Env admin)

Fixed

  • ClickHouse use authentication fixes
  • List of backups was sometimes not properly sorted
  • Fixed a possible race condition in backup and restore of replicated clusters

22.6.18

Released 2022-05-13

Added

  • Explorer now requires user authorization using ClickHouse user/password
  • Altinity staff does not have an access to the data by default. Multiple levels of access can be granted by a customer – that enables ‘altinity’ user to work with the data.
  • New ‘Workload’ tab in Explorer to analyze typical queries
  • Copy to Clipboard buttons in Connection Details

Changed

  • DataDog metrics are labeled with environment and cluster
  • clickhouse-operator user is restricted to Altinity network only
  • Brute force protection is enabled for password recovery form

22.5.15

Released 2022-04-25

Added

  • Cluster Uptime feature that allows stopping the cluster automatically when inactive or by schedule.
  • Reset to defaults is available on ClickHouse settings and profile settings pages.
  • Email notification is sent to the user when trial is extended.
  • Connection to Remote environment via Altinity Connector.

Changed

  • Display a warning when downgrading ClickHouse major version
  • Display a warning when non-replicated MergeTree table is created on replicated cluster
  • Cluster Dashboard now shows LB type and storage type

Fixed

  • Fixed UI slowness when a long query is being executed.
  • Fixed Schema tab that may be not displaying tables when databases contains hundreds of those.
  • Small UI fixes in different places.

22.4.15

Released 2022-04-06

Added

  • Breakdown by clusters on a billing page
  • Initial support for user managed environments
  • Environment connection status

Changed

  • Changed cluster wizard to make it easier to use
  • Fractional disk sizes are not allowed anymore
  • ‘Pay by Invoice’ option is disabled

Fixed

  • Fixed a bug with local backups not being deleted that might result in higher disk usage
  • Fixed a possible backup failure on clusters with async_inserts=1
  • Fixed a bug with ALTER TABLE did not work sometimes on clusters restored from a backup
  • Fixed a bug with schema did not refresh sometimes
  • Fixed a bug in incorrect retention of backups of sharded cluster

22.3.14

Released 2022-03-17

Added

  • Allow to select a node type when launching a cluster from backup (available for Altinity staff only)

Changed

  • DROP TABLE is executed now before restoring a table from the backup
  • CPU is correctly displayed in cores on Environment page in this release
  • clickhouse-operator has been upgraded to 0.18.3
  • Fixed a bug that did not allow to enter ‘0’ in cluster settings
  • Fixed a bug that might result in cluster not going online when using ClickHouse versions 22.2 and above
  • Fixed a bug with incorrect display of billing data for GCP environments
  • Fixed a bug with AWS NLB usage
  • Fixed a bug with cluster metadata not being stored in backup sometimes

22.2.15

Released 2022-02-28

Added

  • Notifications for cluster related events can be configured
  • Datadog integration
  • Option to force Auth0 authentication for organization
  • Dark UI theme
  • Cmd/Ctrl+Enter in Explorer can be used to run a query

Changed

  • ZooKeeper is now stopped when cluster is stopped
  • Warning has been removed from volume rescale popup
  • Monitoring links have been moved to the top in order to make it easier to find
  • Max part size has been reduced to 50GB
  • Column compression tab is more compact now
  • When backup operation is in progress all operations that may incidentally restart the cluster are blocked now

Fixed

  • Fixed a bug with list of databases sometimes could not be parsed in user dialog
  • Fixed a bug with replica cluster creation
  • Fixed latest backup timestamp display for stopped clusters
  • Fixed a bug with table restore from a backup that could download full cluster backup instead of a single table

22.1.28

Released 2022-01-31

Added

  • Restore cluster from an External backup (available for superadmins only)
  • Restore single table from a backup
  • New Grafana dashboard for logs

Changed

  • UI facelifting on Cluster and Nodes dashboards
  • System tables are now hidden by default on Schema dashboard
  • Stronger security for Grafana monitoring dashboard
  • Better performance of Billing dashboard
  • Use ‘pd-ssd’ fast storage for ZooKeeper nodes in GCP
  • Cluster dashboard now shows a warning if backup utility is outdated
  • Backup line item is now correctly displayed for GCP clusters
  • Support plan is now displayed on a billing page
  • Error Log section is removed from ClickHouse logs page

Fixed

  • Fixed ON CLUSTER switch behavior
  • Removed deprecated ClickHouse settings from default profile
  • Removed deprecated node annotations

21.13.21

Released 2021-12-21

Added

  • Expiration date for trials can be adjusted from UI (previously it could only be done with an API call)
  • Expiration date for notifications can be configured
  • Units to the billing usage page
  • Legend to the Columns tab that clarifies key flags

Changed

  • UI has been refreshed with a new version of Clarity.Design library
  • When user VPC endpoint is configured Access Point URLs are switched to ‘internal’ now
  • AWS NLB is disabled by default. It can be enabled on Environment level if needed
  • Cron job logs are sent to centralized logging

Fixed

  • Processes view is fixed for ClickHouse versions 21.8
  • Estimated costs for GCP are corrected
  • Trial notifications are not longer created for blocked organizations

21.12.26

Released 2021-12-01

Added

  • Post-trial workflow allows user to signup to the paid account
  • Column level compression tab in Schema popup
  • New billing user role in order to access billing only
  • Soft rolling restart of ClickHouse nodes is now available. The previous ‘hard’ restart can be used as well.
  • Background operation status is now displayed on the cluster dashboard
  • Billing integration for GCP
  • Backups for GCP

Changed

  • ZooKeeper is updated to 3.7.0. It only affects new clusters.
  • clickhouse-backup is updated to 1.2.2
  • User will receive notification when subscribes or unsubscribes from Clickhouse alerts
  • Billing company name can now be different from the organization name

Fixed

  • Fixed ‘Refresh’ button on Processes tab that did not refresh the screen sometimes
  • Fixed an issue when sometimes schema was displayed as empty

21.11.24

Released 2021-10-27

Added

  • Usage details are available in Billing
  • Download links to issued invoices are available in Billing
  • Backup cost is extracted as a separate line item. Previously it was a part of a storage cost.
  • VPC Endpoint status is displayed when enabled
  • Datadog integration is supported for ClickHouse logs. Contact us with your datadog agent id.
  • GCP support
  • Enabled support for Altinity Builds of ClickHouse

Changed

  • Networks are removed from ClickHouse users creation. It is now controlled in Connectivity on a cluster level
  • ZooKeeper cluster size can not be selected anymore. It is adjusted automatically.
  • Available API endpoints are now filtered according to the user role. Previously, user could see all API even if those could not be used.

Fixed

  • Fixed a bug with node endpoints being unavailable under VPC endpoint

21.10.28

Released 2021-09-21

Added

  • Allow users to configure alerts for the cluster. Note: cluster may be restarted when email is used for a first time
  • IP/CIDR whitelisting to protect access point access
  • Compression ratio column on a Schema tab
  • Email notifications (system)
  • Notifications to a specific recipient (system)
  • ‘Prepare All Invoices’ super-button that sends invoices to all paid customers (system)
  • CC and BCC addresses for invoices

Changed

  • Users and ClickHouse users passwords are now required to be 12 characters at least
  • Session timeout is increased to 60 minutes
  • Troubleshooting mode now allows Altinity Engineers to enter the failed node
  • ‘View Logs’ are renamed to ‘Logs’
  • Backup utility is updated to altinity/clickhouse-backup:1.0.16. That improves speed of backups among other fixes.

21.9.9

Released 2021-08-12

Added

  • Cluster level access control
  • Cluster Restart action
  • User level configurable API tokens

Changed

  • Improved ZK cluster scale up/down logic
  • Improved Invoices creation logic
  • Security improvements

21.8.20

Released 2021-07-21

Added

  • Billing integration
  • Price estimator is now displayed when starting a cluster
  • In-app notifications
  • Allow to deploy 3-node ZK cluster in the regions with only two AZs available (e.g. us-west-1)
  • Cluster name now appears at all cluster related popup windows

Changed

  • Upgraded clickhouse-operator to 0.15.0
  • Backup and security improvements

21.7.19

Released 2021-06-18

Added

  • Support for multiple environments for an organization
  • Basic usage information at the billing page
  • Download of logs
  • Password recovery if user has lost his password
  • Externally available status page that can be referenced as https://status.<tenant-name>.altinity.cloud

Changed

  • ClickHouse custom images are restricted to Yandex and Altinity only
  • Non-XML config files are now allowed (e.g. for dictionaries)
  • Backup and security improvements

21.6.9

Released 2021-05-19

Added

  • New Environment Settings section into cluster configuration
  • default_replica_path and default_replica_name settings are now pre-populated that to simplifies creation of ReplicatedMergeTree tables (requires ClickHouse 21.1+)
  • Node selector is now available at the Explorer page. It allows to run queries against an individual node.

Changed

  • Improved usability of cluster settings
  • Fixed a bug with “.inner.” tables did not properly work in Explorer
  • Fixed a bug with orgadmin did not have permissions to modify cluster settings
  • Fixed a bug with orgadmin could see user plain password in user audit log when password is changed
  • Upgraded to clickhouse-operator to 0.14.1. That fixes a possible failure of schema creation when adding a new replica to the cluster.
  • Upgraded clickhouse-backup to 1.0.9. That fixes restore of materialized views and distributed tables.
  • Backup and security improvements

21.5.10

Released 2021-04-27

Added

  • Node endpoints connection details
  • Last query and last insert timestamps
  • Fixed default ClickHouse version when upgrading.
  • Login screen protection from a brute force attack

Changed

  • Now it is possible to rollback quickly to the older version if ClickHouse does not start after upgrade
  • Fixed Share feature when user belongs to a different environment
  • Enabled multi-AZ ZooKeeper deployment
  • Upgraded to clickhouse-operator 0.14.0
  • Improvements to ACM dashboard
  • Backup and security improvements

21.4.10

  • Schema tab has been fully re-designed
  • Atomic databases can be now correctly backed up with the new version of backup utility (requires cluster re-publish)
  • We have added gp3 storage option, and removed unencrypted volumes completely
  • ClickHouse Version is now automatically defaults to the latest Altinity Stable release
  • The number of replicas for Zookeeper clusters has been added to a list of Zookeepers
  • General stability and security improvements

21.3.21

  • New ‘Share’ function to invite users
  • Cluster created by one user can not be deleted by another user anymore
  • Improved Account Details screen
  • New service status page that allows to subscribe for status changes
  • Added a startup mode advanced setting. New ‘Direct’ mode decreases startup times for huge clusters
  • Added input validation in different places
  • Added a limit on maximum number of shards and replicas
  • Added an option to re-scale ZooKeeper from 1 to 3 nodes and vice versa (available only for admins yet)
  • Stability, security and backup improvements

21.2.15

  • Grafana is now accessible under ‘/monitoring’ path rather than a separate endpoint. That works under VPC as well.
  • Individual shards and replicas can be directly accessed by TCP and HTTP clients. In order to use that cluster needs to be re-published. Ask us for more detail if interested.
  • Flexible backup schedule (available on request)
  • Restore a backup to a new cluster (available on request)
  • Cluster names are now forced to use only lower case latin characters and numbers
  • Fixed a bug with RENAME TABLE query did not work in ON CLUSTER mode
  • Fixed a bug with losing SSL files when stopping the cluster for a long time
  • UI stability improvements and bug fixes

21.1.12

  • UI performance optimizations
  • Usability changes in Rescale screen
  • Added a validation to Profile Settings values
  • Login attempts are now correctly logged into Audit Log
  • Macros section is removed. Macros can be overridden via Settings if needed and looked up in system.macros table
  • Fixed a bug in Query Explorer that did not display query results with WITH statement properly
  • Fixed a bug that did not allow to Resume to a different node type
  • UI improvements and minor bug fixes

20.5.10

  • Handling of custom configuration files in cluster settings has been improved
  • Altinity Stable ClickHouse version has been upgraded to 20.8.11.17
  • Cluster Migrate feature has been temporary disabled
  • UI improvements and minor bug fixes

20.4.3

  • Grafana has been switched to Edge Ingress load balancer, and is now secured by https
  • UI improvements and minor bug fixes

20.3.4

  • Platform specific settings are now protected from user modifications
  • Node and Cluster status is displayed correctly
  • ClickHouse version has been added to the clusters list
  • Session times out after 30 minutes of user inactivity
  • Healthcheck screen has been improved
  • Automatic redirect from HTTP to HTTPs when accessing the management plane