Altinity.Cloud Release Notes

• 1: Altinity.Cloud 23.1.22
• 2: Altinity.Cloud 22.12.27
• 3: Altinity.Cloud 22.11.30
• 4: Altinity.Cloud 22.10.24
• 5: Altinity.Cloud 22.9.21
• 6: Altinity.Cloud 22.8.15
• 7: Altinity.Cloud 22.7.13
• 8: Altinity.Cloud 22.6.18
• 9: Altinity.Cloud 22.5.15
• 10: Altinity.Cloud 22.4.15
• 11: Altinity.Cloud 22.3.14
• 12: Altinity.Cloud 22.2.15
• 13: Altinity.Cloud 22.1.28
• 14: Altinity.Cloud 21.13.21
• 15: Altinity.Cloud 21.12.26
• 16: Altinity.Cloud 21.11.24
• 17: Altinity.Cloud 21.10.28
• 18: Altinity.Cloud 21.9.9
• 19: Altinity.Cloud 21.8.20
• 20: Altinity.Cloud 21.7.19
• 21: Altinity.Cloud 21.6.9
• 22: Altinity.Cloud 21.5.10
• 23: Altinity.Cloud 21.4.10
• 24: Altinity.Cloud 21.3.21
• 25: Altinity.Cloud 21.2.15
• 26: Altinity.Cloud 21.1.12
• 27: Altinity.Cloud 20.5.10
• 28: Altinity.Cloud 20.4.3
• 29: Altinity.Cloud 20.3.4

1 - Altinity.Cloud 23.1.22

Added

• Clone database feature that allows to clone database w/o data copy on same host
• Force restart of an individual node
• Show pod events in a node view
• Current quota usage is now displayed on an environment screen
• User role can be specified when inviting user to an environment
• Progress bar when applying changes to a cluster
• Operator managed persistence is now default for new environments, and can be turned on for existing ones. It allows to re-scale volumes w/o downtime
• Re-publish ZK clusters

Changed

• Backup configuration is currently always deployed, even if schedule is disabled
• ClickHouse version recommendations were improved
• IAM-managed access to backup bucket is now allowed
• Data rebalance UI has been improved
• Cluster are now sorted alphabetically
• Asynchronous metrics log frequency is reduced for new clusters
• Changed some ‘default’ profile settings (part of operator release):
  • Enabled ‘do_not_merge_across_partitions_select_final’
  • Set ’load_balancing’ to ’nearest_hostname’
  • Set niceness (‘os_thread_priority’) to 2.

Fixed

• Fixed data consistency checks for 3 replica clusters
• Improved loading speed for Accounts screen
• Copy Data wizard can now work with non-Altinity.Cloud ClickHouse
• Fixed Auth0 integration with Okta

Fixed in 23.1.23 2022-03-10

• Fixed a bug with version upgrades for ClickHouse 23.1 and above that might result in cluster not going online after restart
• Fixed a bug with “Workload->Replication” screen did not display any results
• Fixed a bug with “Copy Data Between Clusters” tool that did not work correctly in a replicated cluster with non-partitioned tables in some cases
• Display an error message if “Schema Consistency -> Create table on all nodes” fails with an error

2 - Altinity.Cloud 22.12.27

Added

• User is notified with a warning sign when backups are not configured
• User is notified with a popup message when data migration is completed or failed
• ‘Delete table’ action is added to Data Consistency tab
• List of databases granted to ClickHouse user are displayed
• Quick filter was added in order to see unhealthy nodes on a Dashboard page
• Cluster tags for GCP environments in order to split costs by clusters

Changed

• ‘Environment Settings’ was renamed to ‘Environment Variables’ on the cluster page
• DBA tools UI was made more intuitive
• Improved new Anywhere environment setup process
• Improved ‘Data Rebalance’ function that could sometimes move too much data
• Backup configuration is moved to a separate resource instead of being bundled with ClickHouse configuration. This change requires restart.
• Backup stability improvements, upgrade clickhouse-backup to 2.1.3 version
• Upgraded clickhouse-operator to 0.20.1
• n2d-standard-64 is now available by default for GCP clusters

Fixed

• Fixed a bug when node status was not updated for a few minutes after ClickHouse cluster is up an running
• Fixed a bug with backup being restored from AWS to GCP environments or vice versa could fail due to mismatching node types
• Fixed a bug when Rescale ignored auto publishing being turned off
• Fixed a bug when ‘Run DDL ON CLUSTER’ did switch off automatically when specific node is selected
• Fixed a bug with rescaling GCP clusters in old tenants
• Fixed a bug when profile settings could not be changed on a cluster that can not start
• Fixed Data Migration tool that did not work in Anywhere environments due to hard-coded tolerations
• Fixed a bug with backup compression format was not respected for GCP clusters
• Fixed a bug with memory and volume graphs displaying incorrect data

3 - Altinity.Cloud 22.11.30

Added

• Used/available quota is now displayed when starting a cluster
• New System Metrics Grafana dashboard
• Reset Anywhere action in order to disconnect from the Anywhere environment
• Rebalance data across storage volumes
• Tracking customer credits when invoicing

Changed

• In the list of accounts, environments for a particular account are now displayed
• Anywhere connection wizard has been improved
• Sensitive environment settings are back to readonly for non-Anywhere clusters
• Multiple improvements to backup functionality
• Multiple improvements to Copy Data between Clusters feature
• Log storage has been migrated to Grafana Loki

Fixed

• Fixed latest backup timestamp that has not been updated sometimes
• StatusCheck now works for Anywhere environments
• Billing estimates are now correct for Anywhere clusters
• MaterializedView tables are now correctly restored when using Consistency check tool
• Fixed a UI bug with ClickHouse version was not displayed when one of cluster nodes was down
• Fixed Kafka Connection tool generated XML that was sometimes incorrect
• Fixed Environment Variable settings page that did not allow to specify non-secret settings
• Fixed a bug that did not allow to restore GCP backup to AWS or vice versa to an automatically created cluster due to incorrect node specifications
• Billing reports are now displayed correctly for Anywhere clusters

4 - Altinity.Cloud 22.10.24

Added

• New ‘Errors’ tab under DBA tools
• New ‘Cluster Consistency’ tab under DBA tools
• Allow to restrict access to cluster management for Altinity stuff
• Setup and initial configuration of Anywhere environments
• Dashboard is enabled for env and org admins
• Copy Data feature is enabled for env and org admins
• Logging into Loki for Anywhere tenants
• Option to turn on ClickHouse SQL access management for users
• Pod status in the Node view
• Environment variables from a k8s secret

Changed

• Processes tab have been improved
• Multi-statements now can be executed in Explorer
• When ClickHouse cluster is upgraded to the new version, the UI now allows to easily pick Altinity.Stable and Community versions
• ClickHouse version upgrade recommendations have been improved
• When user returns with a direct cluster link, cluster Environment is automatically selected as a current one

Fixed

• Fixed sort order in a list of nodes dropdown in Explorer
• Fixed backup restore scenarios between different environments and clusters
• Fixed a bug with detached parts could not be deleted for ‘.inner.’ tables
• Fixed Kafka connection tool in GCP environments

5 - Altinity.Cloud 22.9.21

Added

• Added a feature to convert from non-replicated to replicated MergeTree (available for Altinity staff only)
• Data Migration Tool to copy data between clusters (available for Altinity staff only)
• New ‘Launch from Backup’ wizard that allows to pick any backup source, including outside of Altinity.Cloud
• Replication status in Workload Alert cluster owners when Altinity access level is changed
• Backlink button to the Environment page
• Proxy connection mode for Anywhere clusters

Changed

• Workload tab was refactored to show 3 panels: Queries, Replication and Processes
• Workload is sorted in descending order by default
• Table creation hints were updated in Explorer
• Improved loading test datasets feature
• User is automatically redirected to the last visited page on re-login

Fixed

• Fixed restoring a backup in sharded and replicated cluster with tables replicated to every shard
• Fixed sorting order in dashboard
• Last insert timestamp now displays timestamp for Kafka inserts correctly now
• Fixed SELECT ALL IGNORED for detached parts

6 - Altinity.Cloud 22.8.15

Added

• New tool to review and remove detached parts
• New tool to test connectivity to Kafka broker
• New tool to import test datasets – available for 22.3 ClickHouse version and above

Changed

• Default log level for new clusters is set to ‘information’. Users can edit log level using ’logger/level’ cluster setting
• Storage size is displayed as ‘Pending’ if rescale has not been complete
• Improved version upgrade recommendations
• Improved Schema and Workload tabs

Fixed

• Fixed a bug with uptime schedule that could unexpectidly stop clusters sometimes
• Fixed a bug with memory configuration settings if cluster is resumed to the different node size

7 - Altinity.Cloud 22.7.13

Added

• User role is now displayed on Account page
• A warning is displayed on ClickHouse version upgrade is available
• Sorting has been added to the Schema tab
• A tool to convert a table from MergeTree to ReplicatedMergeTree (available for superadmins only)
• VPC Endpoint status is displayed on Connections popup
• Custom tolerations can be specified for node types

Changed

• User is automatically authenticated as ClickHouse admin when starting a new cluster
• Schedule icon opens a Schedule popup now
• When rescaling a volume, minimum rescale ratio is 20% of the volume size
• Org admin can access Environment details now (previously it was only possible with Env admin)

Fixed

• ClickHouse use authentication fixes
• List of backups was sometimes not properly sorted
• Fixed a possible race condition in backup and restore of replicated clusters

8 - Altinity.Cloud 22.6.18

Added

• Explorer now requires user authorization using ClickHouse user/password
• Altinity staff does not have an access to the data by default. Multiple levels of access can be granted by a customer – that enables ‘altinity’ user to work with the data.
• New ‘Workload’ tab in Explorer to analyze typical queries
• Copy to Clipboard buttons in Connection Details

Changed

• DataDog metrics are labeled with environment and cluster
• clickhouse-operator user is restricted to Altinity network only
• Brute force protection is enabled for password recovery form

9 - Altinity.Cloud 22.5.15

Added

• Cluster Uptime feature that allows stopping the cluster automatically when inactive or by schedule.
• Reset to defaults is available on ClickHouse settings and profile settings pages.
• Email notification is sent to the user when trial is extended.
• Connection to Remote environment via Altinity Connector.

Changed

• Display a warning when downgrading ClickHouse major version
• Display a warning when non-replicated MergeTree table is created on replicated cluster
• Cluster Dashboard now shows LB type and storage type

Fixed

• Fixed UI slowness when a long query is being executed.
• Fixed Schema tab that may be not displaying tables when databases contains hundreds of those.
• Small UI fixes in different places.

10 - Altinity.Cloud 22.4.15

Added

• Breakdown by clusters on a billing page.
• Initial support for user managed environments.
• Environment connection status.

Changed

• Changed cluster wizard to make it easier to use.
• Fractional disk sizes are not allowed anymore.
• ‘Pay by Invoice’ option is disabled.

Fixed

• Fixed a bug with local backups not being deleted that might result in higher disk usage.
• Fixed a possible backup failure on clusters with async_inserts=1.
• Fixed a bug with ALTER TABLE did not work sometimes on clusters restored from a backup.
• Fixed a bug with schema did not refresh sometimes.
• Fixed a bug in incorrect retention of backups of sharded cluster.

11 - Altinity.Cloud 22.3.14

Added

• Allow to select a node type when launching a cluster from backup (available for Altinity staff only).

Changed

• DROP TABLE is executed now before restoring a table from the backup.
• CPU is correctly displayed in cores on Environment page in this release.
• clickhouse-operator has been upgraded to 0.18.3.
• Fixed a bug that did not allow to enter ‘0’ in cluster settings.
• Fixed a bug that might result in cluster not going online when using ClickHouse versions 22.2 and above.
• Fixed a bug with incorrect display of billing data for GCP environments.
• Fixed a bug with AWS NLB usage.
• Fixed a bug with cluster metadata not being stored in backup sometimes.

12 - Altinity.Cloud 22.2.15

Added

• Notifications for cluster related events can be configured
• Datadog integration
• Option to force Auth0 authentication for organization
• Dark UI theme
• Cmd/Ctrl+Enter in Explorer can be used to run a query

Changed

• ZooKeeper is now stopped when cluster is stopped
• Warning has been removed from volume rescale popup
• Monitoring links have been moved to the top in order to make it easier to find
• Max part size has been reduced to 50GB
• Column compression tab is more compact now
• When backup operation is in progress all operations that may incidentally restart the cluster are blocked now

Fixed

• Fixed a bug with list of databases sometimes could not be parsed in user dialog
• Fixed a bug with replica cluster creation
• Fixed latest backup timestamp display for stopped clusters
• Fixed a bug with table restore from a backup that could download full cluster backup instead of a single table

13 - Altinity.Cloud 22.1.28

Added

• Restore cluster from an External backup (available for superadmins only)
• Restore single table from a backup
• New Grafana dashboard for logs

Changed

• UI facelifting on Cluster and Nodes dashboards
• System tables are now hidden by default on Schema dashboard
• Stronger security for Grafana monitoring dashboard
• Better performance of Billing dashboard
• Use ‘pd-ssd’ fast storage for ZooKeeper nodes in GCP
• Cluster dashboard now shows a warning if backup utility is outdated
• Backup line item is now correctly displayed for GCP clusters
• Support plan is now displayed on a billing page
• Error Log section is removed from ClickHouse logs page

Fixed

• Fixed ON CLUSTER switch behavior
• Removed deprecated ClickHouse settings from default profile
• Removed deprecated node annotations

14 - Altinity.Cloud 21.13.21

Added

• Expiration date for trials can be adjusted from UI (previously it could only be done with an API call)
• Expiration date for notifications can be configured
• Units to the billing usage page
• Legend to the Columns tab that clarifies key flags

Changed

• UI has been refreshed with a new version of Clarity.Design library
• When user VPC endpoint is configured Access Point URLs are switched to ‘internal’ now
• AWS NLB is disabled by default. It can be enabled on Environment level if needed
• Cron job logs are sent to centralized logging

Fixed

• Processes view is fixed for ClickHouse versions 21.8
• Estimated costs for GCP are corrected
• Trial notifications are not longer created for blocked organizations

15 - Altinity.Cloud 21.12.26

Added

• Post-trial workflow allows user to signup to the paid account
• Column level compression tab in Schema popup
• New billing user role in order to access billing only
• Soft rolling restart of ClickHouse nodes is now available. The previous ‘hard’ restart can be used as well.
• Background operation status is now displayed on the cluster dashboard
• Billing integration for GCP
• Backups for GCP

Changed

• ZooKeeper is updated to 3.7.0. It only affects new clusters.
• ClickHouse Backup is updated to 1.2.2
• User will receive notification when subscribes or unsubscribes from Clickhouse alerts
• Billing company name can now be different from the organization name

Fixed

• Fixed ‘Refresh’ button on Processes tab that did not refresh the screen sometimes
• Fixed an issue when sometimes schema was displayed as empty

16 - Altinity.Cloud 21.11.24

Added

• Usage details are available in Billing
• Download links to issued invoices are available in Billing
• Backup cost is extracted as a separate line item. Previously it was a part of a storage cost.
• VPC Endpoint status is displayed when enabled
• Datadog integration is supported for ClickHouse logs. Contact us with your datadog agent id.
• GCP support
• Enabled support for Altinity Builds of ClickHouse

Changed

• Networks are removed from ClickHouse users creation. It is now controlled in Connectivity on a cluster level
• ZooKeeper cluster size can not be selected anymore. It is adjusted automatically.
• Available API endpoints are now filtered according to the user role. Previously, user could see all API even if those could not be used.

Fixed

• Fixed a bug with node endpoints being unavailable under VPC endpoint

17 - Altinity.Cloud 21.10.28

Added

• Allow users to configure alerts for the cluster. Note: cluster may be restarted when email is used for a first time
• IP/CIDR whitelisting to protect access point access
• Compression ratio column on a Schema tab
• Email notifications (system)
• Notifications to a specific recipient (system)
• ‘Prepare All Invoices’ super-button that sends invoices to all paid customers (system)
• CC and BCC addresses for invoices

Changed

• Users and ClickHouse users passwords are now required to be 12 characters at least
• Session timeout is increased to 60 minutes
• Troubleshooting mode now allows Altinity Engineers to enter the failed node
• ‘View Logs’ are renamed to ‘Logs’
• Backup utility is updated to [altinity/ClickHouse Backup:1.0.16](https://github.com/Altinity/ClickHouse Backup/releases/tag/1.0.16). That improves speed of backups among other fixes.

18 - Altinity.Cloud 21.9.9

Added

• Cluster level access control
• Cluster Restart action
• User level configurable API tokens

Changed

• Improved ZK cluster scale up/down logic
• Improved Invoices creation logic
• Security improvements

19 - Altinity.Cloud 21.8.20

Added

• Billing integration
• Price estimator is now displayed when starting a cluster
• In-app notifications
• Allow to deploy 3-node ZK cluster in the regions with only two AZs available (e.g. us-west-1)
• Cluster name now appears at all cluster related popup windows

Changed

• Upgraded clickhouse-operator to 0.15.0
• Backup and security improvements

20 - Altinity.Cloud 21.7.19

Added

• Support for multiple environments for an organization
• Basic usage information at the billing page
• Download of logs
• Password recovery if user has lost his password
• Externally available status page that can be referenced as https://status.<tenant-name>.altinity.cloud

Changed

• ClickHouse custom images are restricted to Yandex and Altinity only
• Non-XML config files are now allowed (e.g. for dictionaries)
• Backup and security improvements

21 - Altinity.Cloud 21.6.9

Added

• New Environment Settings section into cluster configuration
• default_replica_path and default_replica_name settings are now pre-populated that to simplifies creation of ReplicatedMergeTree tables (requires ClickHouse 21.1+)
• Node selector is now available at the Explorer page. It allows to run queries against an individual node.

Changed

• Improved usability of cluster settings
• Fixed a bug with “.inner.” tables did not properly work in Explorer
• Fixed a bug with orgadmin did not have permissions to modify cluster settings
• Fixed a bug with orgadmin could see user plain password in user audit log when password is changed
• Upgraded to clickhouse-operator to 0.14.1. That fixes a possible failure of schema creation when adding a new replica to the cluster.
• Upgraded ClickHouse Backup to 1.0.9. That fixes restore of materialized views and distributed tables.
• Backup and security improvements

22 - Altinity.Cloud 21.5.10

Added

• Node endpoints connection details
• Last query and last insert timestamps
• Fixed default ClickHouse version when upgrading.
• Login screen protection from a brute force attack

Changed

• Now it is possible to rollback quickly to the older version if ClickHouse does not start after upgrade
• Fixed Share feature when user belongs to a different environment
• Enabled multi-AZ ZooKeeper deployment
• Upgraded to clickhouse-operator 0.14.0
• Improvements to ACM dashboard
• Backup and security improvements

23 - Altinity.Cloud 21.4.10

• Schema tab has been fully re-designed
• Atomic databases can be now correctly backed up with the new version of backup utility (requires cluster re-publish)
• We have added gp3 storage option, and removed unencrypted volumes completely
• ClickHouse Version is now automatically defaults to the latest Altinity Stable release
• The number of replicas for Zookeeper clusters has been added to a list of Zookeepers
• General stability and security improvements

24 - Altinity.Cloud 21.3.21

• New ‘Share’ function to invite users
• Cluster created by one user can not be deleted by another user anymore
• Improved Account Details screen
• New service status page that allows to subscribe for status changes
• Added a startup mode advanced setting. New ‘Direct’ mode decreases startup times for huge clusters
• Added input validation in different places
• Added a limit on maximum number of shards and replicas
• Added an option to re-scale ZooKeeper from 1 to 3 nodes and vice versa (available only for admins yet)
• Stability, security and backup improvements

25 - Altinity.Cloud 21.2.15

• Grafana is now accessible under ‘/monitoring’ path rather than a separate endpoint. That works under VPC as well.
• Individual shards and replicas can be directly accessed by TCP and HTTP clients. In order to use that cluster needs to be re-published. Ask us for more detail if interested.
• Flexible backup schedule (available on request)
• Restore a backup to a new cluster (available on request)
• Cluster names are now forced to use only lower case latin characters and numbers
• Fixed a bug with RENAME TABLE query did not work in ON CLUSTER mode
• Fixed a bug with losing SSL files when stopping the cluster for a long time
• UI stability improvements and bug fixes

26 - Altinity.Cloud 21.1.12

• UI performance optimizations
• Usability changes in Rescale screen
• Added a validation to Profile Settings values
• Login attempts are now correctly logged into Audit Log
• Macros section is removed. Macros can be overridden via Settings if needed and looked up in system.macros table
• Fixed a bug in Query Explorer that did not display query results with WITH statement properly
• Fixed a bug that did not allow to Resume to a different node type
• UI improvements and minor bug fixes

27 - Altinity.Cloud 20.5.10

• Handling of custom configuration files in cluster settings has been improved
• Altinity Stable ClickHouse version has been upgraded to 20.8.11.17
• Cluster Migrate feature has been temporary disabled
• UI improvements and minor bug fixes

28 - Altinity.Cloud 20.4.3

• Grafana has been switched to Edge Ingress load balancer, and is now secured by https
• UI improvements and minor bug fixes

29 - Altinity.Cloud 20.3.4

• Platform specific settings are now protected from user modifications
• Node and Cluster status is displayed correctly
• ClickHouse version has been added to the clusters list
• Session times out after 30 minutes of user inactivity
• Healthcheck screen has been improved
• Automatic redirect from HTTP to HTTPs when accessing the management plane