Bug Fix: Fixed issue with merging configs that have and root XML tags. (backport of ClickHouse@213ecae) (via #114).
Bug Fix: Backport of ClickHouse#31823 to 21.8: Fix invalid cast of nullable type when nullable primary key is used (via #110)
Build/Testing/Packaging Improvement: Various macOS compilation and packaging fixes/backporting (via #108)
Build/Testing/Packaging Improvement: Minor test improvements (via afb4a0a, 4c35386)

Changes compared to Altinity Stable 21.8.13.1

Bug Fixes

Fix segfault while parsing ORC file with corrupted footer. Closes ClickHouse#33797 via ClickHouse#33984 Kruglov Pavel.
Fix usage of functions array and tuple with literal arguments in distributed queries. Previously it could lead to Not found columns exception. ClickHouse#33938 (Anton Popov).
Fix s3 table function reading empty file. Closes ClickHouse#33008 via ClickHouse#33037 (Kseniia Sumarokova).
Fix hdfs url check that didn’t allow using HA namenode address. Bug was introduced in ClickHouse#31042. ClickHouse#32976 (Kruglov Pavel).
Server might fail to start if database with MySQL engine cannot connect to MySQL server, it’s fixed. Fixes ClickHouse#14441 via ClickHouse#32802 (tavplubix).

Test Results

Packages

https://builds.altinity.cloud/

Return to the top.

Altinity Stable for ClickHouse™ 21.8.13

Release Notes

ClickHouse release v21.8.13.1-altinitystable as compared to v21.8.12.29-altinitystable:

Bug Fixes

Fixed Apache Avro Union type index out of boundary issue in Apache Avro binary format. #33022 (Harry Lee).
Quota limit was not reached, but the limit was exceeded. This PR fixes #31174. #31656 (sunny).
NO CL ENTRY: ‘fix json error after downgrade’. #33166 (bullet1337).
Integer overflow to resize the arrays causes heap corrupt. #33024 (varadarajkumar).
fix crash when used fuzzBits with multiply same FixedString, Close #32737. #32755 (SuperDJY).
Fix possible exception at RabbitMQ storage startup by delaying channel creation. #32584 (Kseniia Sumarokova).
Fixed crash with SIGFPE in aggregate function avgWeighted with Decimal argument. Fixes #32053. #32303 (tavplubix).
Some replication queue entries might hang for temporary_directories_lifetime (1 day by default) with Directory tmp_merge_<part_name> or Part ... (state Deleting) already exists, but it will be deleted soon or similar error. It’s fixed. Fixes #29616. #32201 (tavplubix).
XML dictionaries identifiers, used in table create query, can be qualified to default_database during upgrade to newer version. Closes #31963. #32187 (Maksim Kita).
Number of active replicas might be determined incorrectly when inserting with quorum if setting replicated_can_become_leader is disabled on some replicas. It’s fixed. #32157 (tavplubix).
Fixed Directory ... already exists and is not empty error when detaching part. #32063 (tavplubix).
Some GET_PART entry might hang in replication queue if part is lost on all replicas and there are no other parts in the same partition. It’s fixed in cases when partition key contains only columns of integer types or Date[Time]. Fixes #31485. #31887 (tavplubix).
Change configuration path from keeper_server.session_timeout_ms to keeper_server.coordination_settings.session_timeout_ms when constructing a KeeperTCPHandler - Same with operation_timeout. #31859 (JackyWoo).
Fix a bug about function transform with decimal args. #31839 (李帅).
Fix crash when function dictGet with type is used for dictionary attribute when type is Nullable. Fixes #30980. #31800 (Maksim Kita).
Fix crash with empty result on odbc query. Closes #31465. #31766 (Kseniia Sumarokova).
Fix possible crash (or incorrect result) in case of LowCardinality arguments of window function. Fixes #31114. #31888 (Nikolai Kochetov).

Changes compared to the Community Build

Fix invalid cast of Nullable type when nullable primary key is used. (Nullable primary key is a discouraged feature - please do not use). This fixes #31075 #31823 Amos Bird).

Test Reports

Test Report for Altinity Stable Build v21.8.13.1.

Return to the top.

Altinity Stable for ClickHouse™ 21.8.12

Release Notes

ClickHouse release v21.8.12.29-altinitystable as compared to v21.8.11.1-altinitystable:

Performance Improvements

Improved performance of JSON and XML output formats. #31673 (alexey-milovidov).

Bug Fixes

Quota limit was not reached, but the limit was exceeded. This PR fixes #31174. #31337 (sunny).

Build/Testing/Packaging Improvements

Now all images for CI will be placed in the separate dockerhub repo. #28656 (alesapin).

Bug Fixes (user-visible misbehaviour in official stable or prestable release)

Fixed functions empty and notEmpty with the arguments of UUID type. Fixes #31819. #31883 (Anton Popov).
Fixed possible assertion ../src/IO/ReadBuffer.h:58: bool DB::ReadBuffer::next(): Assertion '!hasPendingData()' failed. in TSKV format. #31804 (Kruglov Pavel).
Fixed usage of Buffer table engine with type Map. Fixes #30546. #31742 (Anton Popov).
Fixed race in JSONEachRowWithProgress output format when data and lines with progress are mixed in output. #31736 (Kruglov Pavel).
Fixed there are no such cluster here error on execution of ON CLUSTER query if specified cluster name is name of Replicated database. #31723 (tavplubix).
Settings input_format_allow_errors_num and input_format_allow_errors_ratio did not work for parsing of domain types, such as IPv4, it’s fixed. Fixes #31686. #31697 (tavplubix).
RENAME TABLE query worked incorrectly on attempt to rename an DDL dictionary in Ordinary database, it’s fixed. #31638 (tavplubix).
Fix invalid generated JSON when only column names contain invalid UTF-8 sequences. #31534 (Kevin Michel).
Resolve nullptr in STS credentials provider for S3. #31409 (Vladimir Chebotarev).
Remove not like function into RPNElement. #31169 (sundyli).
Fixed bug in Keeper which can lead to inability to start when some coordination logs was lost and we have more fresh snapshot than our latest log. #31150 (alesapin).
Fixed abort in debug server and DB::Exception: std::out_of_range: basic_string error in release server in case of bad hdfs url by adding additional check of hdfs url structure. #31042 (Kruglov Pavel).

Return to the top.

Altinity Stable for ClickHouse™ 21.8.11

ClickHouse release v21.8.11.1-altinitystable FIXME as compared to v21.8.10.1-altinitystable

New Features

CompiledExpressionCache limit elements size using compiled_expression_cache_elements_size setting. #30667 (Maksim Kita).

Improvements

Made query which fetched table structure for PostgreSQL database more reliable. #30477 (Kseniia Sumarokova).

Bug Fixes

Fixed SHOW GRANTS when partial revokes are used. This PR fixes #31138. #31249 (Vitaly Baranov).

Bug Fixes (user-visible misbehaviour in official stable or prestable release)

Fixed StorageMerge with aliases and where (it did not work before at all). Closes #28802. #31044 (Kseniia Sumarokova).
Fixed JSONValue/Query with quoted identifiers. This allows to have spaces in json path. Closes #30971. #31003 (Kseniia Sumarokova).
Using formatRow function with not row formats led to segfault. Don’t allow to use this function with such formats (because it doesn’t make sense). #31001 (Kruglov Pavel).
Skip max_partition_size_to_drop check in case of ATTACH PARTITION ... FROM and MOVE PARTITION ... #30995 (Amr Alaa).
Fixed set index not used in AND/OR expressions when there are more than two operands. This fixes #30416 . #30887 (Amos Bird).
Fixed ambiguity when extracting auxiliary ZooKeeper name from ZooKeeper path in ReplicatedMergeTree. Previously server might fail to start with Unknown auxiliary ZooKeeper name if ZooKeeper path contains a colon. Fixes #29052. Also it was allowed to specify ZooKeeper path that does not start with slash, but now it’s deprecated and creation of new tables with such path is not allowed. Slashes and colons in auxiliary ZooKeeper names are not allowed too. #30822 (tavplubix).
Fixed a race condition between REPLACE/MOVE PARTITION and background merge in non-replicated MergeTree that might cause a part of moved/replaced data to remain in partition. Fixes #29327. #30717 (tavplubix).
Fixed PREWHERE with WHERE in case of always true PREWHERE. #30668 (Azat Khuzhin).
Functions for case-insensitive search in UTF8 strings like positionCaseInsensitiveUTF8 and countSubstringsCaseInsensitiveUTF8 might find substrings that actually does not match is fixed. #30663 (tavplubix).
Limit push down optimization could cause a error Cannot find column. Fixes #30438. #30562 (Nikolai Kochetov).
Fixed exception handling in parallel_view_processing. This resolves issues / prevents crashes in some rare corner cases when that feature is enabled and exception (like Memory limit exceeded ...) happened in the middle of materialized view processing. #30472 (filimonov).
Fixed segfault which might happen if session expired during execution of REPLACE PARTITION. #30432 (tavplubix).
Fixed ComplexKeyHashedDictionary, ComplexKeySparseHashedDictionary parsing preallocate option from layout config. #30246 (Maksim Kita).
Fixed [I]LIKE function. Closes #28661. #30244 (Nikolay Degterinsky).
Support nullable arguments in function initializeAggregation. #30177 (Anton Popov).
Fixed data-race between LogSink::writeMarks() and LogSource in StorageLog. #29946 (Azat Khuzhin).
Fixed hanging DDL queries on Replicated database while adding a new replica. #29328 (Kevin Michel).
Fixed bad optimizations of ORDER BY if it contains WITH FILL. This closes #28908. This closes #26049. #28910 (alexey-milovidov).
Fixed queries to external databases (i.e. MySQL) with multiple columns in IN ( i.e. (k,v) IN ((1, 2)) ) (but note that this has some backward incompatibility for the clickhouse-copier since it uses alias for tuple element). #28888 (Azat Khuzhin).
Fixed “Column is not under aggregate function and not in GROUP BY” with PREWHERE (Fixes: #28461). #28502 (Azat Khuzhin).
Fixed NOT-IN index optimization when not all key columns are used. This fixes #28120. #28315 (Amos Bird).

Bug Fixes (user-visible misbehaviour in official stable or prestable release

Fixed ORDER BY ... WITH FILL with set TO and FROM and no rows in result set. #30888 (Anton Popov).

Return to the top.

Altinity Stable for ClickHouse™ 21.3

Altinity Stable for ClickHouse™ 21.3.20.2

Changes Compared to Altinity Stable 21.3.17.3

Bug Fixes

Integer overflow to resize the arrays causes heap corrupt. #33024 (Rajkumar Varada).
fix crash when used fuzzBits with multiply same FixedString, Close #32737. #32755 (SuperDJY).
Number of active replicas might be determined incorrectly when inserting with quorum if setting replicated_can_become_leader is disabled on some replicas. It’s fixed. #32157 (tavplubix).
Fix possible assertion ../src/IO/ReadBuffer.h:58: bool DB::ReadBuffer::next(): Assertion '!hasPendingData()' failed. in TSKV format. #31804 (Kruglov Pavel).
Fix crash when function dictGet with type is used for dictionary attribute when type is Nullable. Fixes #30980. #31800 (Maksim Kita).
Fix usage of Buffer table engine with type Map. Fixes #30546. #31742 (Anton Popov).
Fix race in JSONEachRowWithProgress output format when data and lines with progress are mixed in output. #31736 (Kruglov Pavel).
Settings input_format_allow_errors_num and input_format_allow_errors_ratio did not work for parsing of domain types, such as IPv4, it’s fixed. Fixes #31686. #31697 (tavplubix).
Remove not like function into RPNElement. #31169 (sundyli).
Using formatRow function with not row formats led to segfault. Don’t allow to use this function with such formats (because it doesn’t make sense). #31001 (Kruglov Pavel).
Functions for case-insensitive search in UTF8 strings like positionCaseInsensitiveUTF8 and countSubstringsCaseInsensitiveUTF8 might find substrings that actually does not match, it’s fixed. #30663 (tavplubix).
Fixed segfault which might happen if session expired during execution of REPLACE PARTITION. #30432 (tavplubix).
Fix [I]LIKE function. Closes #28661. #30244 (Nikolay Degterinsky).
FlatDictionary, HashedDictionary fix bytes_allocated calculation for nullable attributes. #30238 (Maksim Kita).
Support nullable arguments in function initializeAggregation. #30177 (Anton Popov).
Fix crash of sample by tuple(), closes #30004. #30016 (flynn).
Fix concurrent access to LowCardinality during GROUP BY (leads to SIGSEGV). #29782 (Azat Khuzhin).
Condition in filter predicate could be lost after push-down optimisation. #29625 (Nikolai Kochetov).
Fix null deference for GROUP BY WITH TOTALS HAVING (when the column from HAVING wasn’t selected). #29553 (Azat Khuzhin).
Fix connection timeouts (send_timeout/receive_timeout). #29282 (Azat Khuzhin).
Fix possible Table columns structure in ZooKeeper is different from local table structure exception while recreating or creating new replicas of ReplicatedMergeTree, when one of table columns have default expressions with case-insensitive functions. #29266 (Anton Popov).
Fix segfault while inserting into column with type LowCardinality(Nullable) in Avro input format. #29132 (Kruglov Pavel).
Fix the number of threads used in GLOBAL IN subquery (it was executed in single threads since #19414 bugfix). #28997 (Nikolai Kochetov).
Fix invalid constant type conversion when nullable or lowcardinality primary key is used. #28636 (Amos Bird).
Fix ORDER BY ... WITH FILL with set TO and FROM and no rows in result set. #30888 (Anton Popov).
Fixed Apache Avro Union type index out of boundary issue in Apache Avro binary format. #33022 (Harry Lee).
Fix null pointer dereference in low cardinality data when deserializing LowCardinality data in the Native format. #33021 (Harry Lee).
Quota limit was not reached, but the limit was exceeded. This PR fixes #31174. #31656 (sunny).
Quota limit was not reached, but the limit was exceeded. This PR fixes #31174. #31337 (sunny).
Fix shutdown of AccessControlManager. Now there can’t be reloading of the configuration after AccessControlManager has been destroyed. This PR fixes the flaky test test_user_directories/test.py::test_relative_path. #29951 (Vitaly Baranov).

Performance Improvements

Improved performance of JSON and XML output formats. #31673 (alexey-milovidov).

Other Improvements

Updated zoneinfo files to 2021c. #29925 (alexey-milovidov).
Use real tmp file instead of predefined “rows_sources” for vertical merges. This avoids generating garbage directories in tmp disks. #28299 (Amos Bird).
Use separate clickhouse-bridge group and user for bridge processes. Set oom_score_adj so the bridges will be first subjects for OOM killer. Set set maximum RSS to 1 GiB. Closes #23861. #25280 (Kseniia Sumarokova).

Changes compared to Community Build 21.3.20.1-lts

Applying 21.3 customizations for 21.3.20 release #113 (Vasily Nemkov).
- Improvement: Retries on HTTP connection drops in S3 (ClickHouse#22988)
- Bug Fix: Fixed possible error ‘Cannot read from istream at offset 0’ when reading a file from DiskS3 (https://github.com/ClickHouse/ClickHouse/pull/24885)
- Improvement: Don’t silently ignore errors and don’t count delays in ReadBufferFromS3 (https://github.com/ClickHouse/ClickHouse/pull/27484)
- Bug Fix: Fixed a bug with accessing S3 buckets when the object URL contained ‘+’ sign (ClickHouse#23822)
- Not for changelog: fixed tests (ClickHouse#27176, https://github.com/ClickHouse/ClickHouse/pull/23976 https://github.com/ClickHouse/ClickHouse/pull/26249).

Test Results

Return to the top.

Altinity Stable for ClickHouse™ 21.1

Altinity Stable for ClickHouse™ 21.1.10.3

Changes between 21.1.10.3 and 21.1.9.41

background_fetches_pool_size is set to 8. This is better for production usage with frequent small insertions or slow ZooKeeper clusters.
Fixed the error ‘Cannot find column in ActionsDAG result', which may happen if subquery uses untuple. https://github.com/ClickHouse/ClickHouse/issues/22290
Fixed quantile(s)TDigest that could produce non-accurate results in some edge cases: https://github.com/ClickHouse/ClickHouse/issues/22408
Fixed a bug with accessing S3 buckets when the object URL contained ‘+’ sign: https://github.com/clickHouse/clickHouse/pull/23822

The complete diff between Altinity and community versions can also be viewed at github:

https://github.com/ClickHouse/ClickHouse/compare/v21.1.9.41-stable…Altinity:v21.1.10.3-altinity+stable

Changes between ClickHouse Altinity Stable Release 21.1.9.41 and ClickHouse Altinity Stable Release 21.1.7.1

Fixed a bug with distributed queries that could sometimes fail with ‘Unknown packet n from server’ error message: https://github.com/ClickHouse/ClickHouse/issues/21588
Fixed several issues with mutations handling (e.g. https://github.com/ClickHouse/ClickHouse/issues/22013)
Fix a rare bug when quorum insert with iinsert_quorum_parallel=1 is not really a “quorum” because of deduplication
Fixed a possible buffer overflow in token bloom filter index: https://github.com/ClickHouse/ClickHouse/issues/19233
Fixed a bug when nullable types sometimes could not be retrieved: https://github.com/ClickHouse/ClickHouse/issues/21116
Fixed a bug with replicated tables metadata not properly cleaned from the non-primary ZooKeeper instance: https://github.com/ClickHouse/ClickHouse/issues/21054

Added parseDateTimeBestEffortOrZero to allow for empty values, while parseDateTimeBestEffort will not work with empty values. For example:

SELECT parseDateTimeBestEffort('')

Query id: 1c60717e-116b-445f-b675-7b9cac35c262


0 rows in set. Elapsed: 0.003 sec.

Received exception from server (version 21.11.1):
Code: 41. DB::Exception: Received from localhost:9000. DB::Exception: Cannot read DateTime: neither Date nor Time was parsed successfully: While processing parseDateTimeBestEffort(''). (CANNOT_PARSE_DATETIME)

SELECT parseDateTimeBestEffortOrZero('')

Query id: 484baec9-6d00-4c66-a792-85a270d6f2f2

┌─parseDateTimeBestEffortOrZero('')─┐
│               1970-01-01 03:00:00 │
└───────────────────────────────────┘

ClickHouse Altinity Stable packages for this release can be found at:

Deb packages: https://packagecloud.io/Altinity/altinity-stable
RPM packages: https://packagecloud.io/Altinity/altinity-stable
Docker image: altinity/clickhouse-server:21.1.10.3.altinity_stable

Return to the top.

Altinity Stable for ClickHouse™ 20.8

Altinity Stable for ClickHouse™ 20.8.12.2

Description

Bug fixes.

Bug Fixes

Fixed a rare bug that may result in corrupted data when merging from wide to compact parts. We recommend upgrading to this release all 20.8 users who are using compact parts.

Return to the top.

Altinity Stable for ClickHouse™ 20.3

Altinity Stable for ClickHouse™ 20.3.19.4

Description

The release includes several dozen bug fixes from the previous release.

Major New Features

Server startup time has been reduced by parsing metadata in parallel.
Improved performance of primary key analysis for LowCardinality columns. That was a performance regression introduced in 20.3.
Improved performance of queries with large tuples and tuples used in primary key.

Bug Fixes

Fixed a bug that prevented attaching Materialized Views to system tables.
Fixed incorrect behavior of if function with NULLs.
Fixed segfaults in rare cases.
Fixed a bug that prevented predicate pushdown for queries using WITH clause.
Fixed SIGSEGV in Kafka engine when broker is unavailable.
Fixed a bug leading to block structure mismatch error for queries with UNION and JOIN.
Fixed TTL processing logic to process all partitions in one run.
Fixed a bug of parsing of row policies from configuration files that could result in missing policies sometimes.
Fixed a bug with ALTER TABLE UPDATE could produce incorrect results when updating Nullable columns.
Fixed a bug with codecs not working properly for MergeTree compact parts.

References

Updated RPM packages for Altinity Stable Release can be found in the Altinity Stable Repository. The ClickHouse repository can be used for DEB packages but check version numbers carefully.

Return to the top.