Cloud Changelog
In addition to this ClickHouse Cloud changelog, please see the Cloud Compatibility page.
April 6, 2023
This release brings an API for retrieving cloud endpoints, an advanced scaling control for minimum idle timeout, and support for external data in Python client query methods.
API changes
- Added ability to programmatically query ClickHouse Cloud endpoints via Cloud Endpoints API
Console changes
- Added ‘minimum idle timeout’ setting to advanced scaling settings
- Added best-effort datetime detection to schema inference in data loading modal
Integrations changes
- Metabase: Added support for multiple schemas
- Go client: Fixed idle connection liveness check for TLS connections
- Python client
- Added support for external data in query methods
- Added timezone support for query results
- Added support for
no_proxy
/NO_PROXY
environment variable - Fixed server-side parameter binding of the NULL value for Nullable types
Bug fixes
- Fixed behavior where running
INSERT INTO … SELECT …
from the SQL console incorrectly applied the same row limit as select queries
March 23, 2023
This release brings database password complexity rules, significant speedup in restoring large backups, and support for displaying traces in Grafana Trace View.
Security and reliability
- Core database endpoints now enforce password complexity rules
- Improved time to restore large backups
Console changes
- Streamlined onboarding workflow, introducing new defaults and more compact views
- Reduced sign-up and sign-in latencies
Integrations changes
- Grafana:
- Added support for displaying trace data stored in ClickHouse in Trace View
- Improved time range filters and added support for special characters in table names
- Superset: Added native ClickHouse support
- Kafka Connect Sink: Added automatic date conversion and Null column handling
- Metabase: Implemented compatibility with v0.46
- Python client: Fixed inserts in temporary tables and added support for Pandas Null
- Golang client: Normalized Date types with timezone
- Java client
- Added to SQL parser support for compression, infile, and outfile keywords
- Added support for
BEGIN TRANSACTION
,COMMIT
, andROLLBACK
statements in JDBC driver - Added credentials overload
- Fixed batch support with
ON CLUSTER
- Node.js client
- Added support for JSONStrings, JSONCompact, JSONCompactStrings, JSONColumnsWithMetadata formats
query_id
can now be provided for all main client methods
Bug fixes
- Fixed a bug resulting in slow initial provisioning and startup times for new services
- Fixed a bug that resulted in slower query performance due to cache misconfiguration
March 9, 2023
This release improves observability dashboards, optimizes time to create large backups, and adds the configuration necessary to drop large tables and partitions.
Console changes
- Added advanced observability dashboards (preview)
- Introduced a memory allocation chart to the observability dashboards
- Improved spacing and newline handling in SQL Console spreadsheet view
Reliability and performance
- Optimized backup schedule to run backups only if data was modified
- Improved time to complete large backups
Configuration changes
- Added the ability to increase the limit to drop tables and partitions by overriding the settings
max_table_size_to_drop
andmax_partition_size_to_drop
on the query or connection level - Added source IP to query log, to enable quota and access control enforcement based on source IP
Integrations
- Python client: Improved Pandas support and fixed timezone-related issues
- Metabase: Metabase 0.46.x compatibility and support for SimpleAggregateFunction
- Kafka-Connect: Implicit date conversion and better handling for null columns
- Java Client: Nested conversion to Java maps
February 23, 2023
This release enables a subset of the features in the ClickHouse 23.1 core release, brings interoperability with Amazon Managed Streaming for Apache Kafka (MSK), and exposes advanced scaling and idling adjustments in the activity log.
ClickHouse 23.1 version upgrade
Adds support for a subset of features in ClickHouse 23.1, for example:
- ARRAY JOIN with Map type
- SQL standard hex and binary literals
- New functions, including
age()
,quantileInterpolatedWeighted()
,quantilesInterpolatedWeighted()
- Ability to use structure from insertion table in
generateRandom
without arguments - Improved database creation and rename logic that allows the reuse of previous names
- See the 23.1 release webinar slides and 23.1 release changelog for more details
Integrations changes
- Kafka-Connect: Added support for Amazon MSK
- Metabase: First stable release 1.0.0
- Made the connector is available on Metabase Cloud
- Added a feature to explore all available databases
- Fixed synchronization of database with AggregationFunction type
- DBT-clickhouse: Added support for the latest DBT version v1.4.1
- Python client: Improved proxy and ssh tunneling support; added a number of fixes and performance optimizations for Pandas dataframes
- Nodejs client: Released ability to attach
query_id
to query result, which can be used to retrieve query metrics from thesystem.query_log
- Golang client: Optimized network connection with ClickHouse Cloud
Console changes
- Added advanced scaling and idling settings adjustments to the activity log
- Added user agent and IP information to reset password emails
- Improved signup flow mechanics for Google OAuth
Reliability and performance
- Speed up the resume time from idle for large services
- Improved reading latency for services with a large number of tables and partitions
Bug fixes
- Fixed behavior where resetting service password did not adhere to the password policy
- Made organization invite email validation case-insensitive
February 2, 2023
This release brings an officially supported Metabase integration, a major Java client / JDBC driver release, and support for views and materialized views in the SQL console.
Integrations changes
- Metabase plugin: Became an official solution maintained by ClickHouse
- dbt plugin: Added support for multiple threads
- Grafana plugin: Better handling of connection errors
- Python client: Streaming support for insert operation
- Go client: Bug fixes: close canceled connections, better handling of connection errors
- JS client: Breaking changes in exec/insert; exposed query_id in the return types
- Java client / JDBC driver major release
- Breaking changes: deprecated methods, classes and packages were removed
- Added R2DBC driver and file insert support
Console changes
- Added support for views and materialized views in SQL console
Performance and reliability
- Faster password reset for stopped/idling instances
- Improved the scale-down behavior via more accurate activity tracking
- Fixed a bug where SQL console CSV export was truncated
- Fixed a bug resulting in intermittent sample data upload failures
January 12, 2023
This release updates the ClickHouse version to 22.12, enables dictionaries for many new sources, and improves query performance.
General changes
- Enabled dictionaries for additional sources, including external ClickHouse, Cassandra, MongoDB, MySQL, PostgreSQL, and Redis
ClickHouse 22.12 version upgrade
- Extended JOIN support to include Grace Hash Join
- Added Binary JSON (BSON) support for reading files
- Added support for GROUP BY ALL standard SQL syntax
- New mathematical functions for decimal operations with fixed precision
- See the 22.12 release blog and detailed 22.12 changelog for the complete list of changes
Console changes
- Improved auto-complete capabilities in SQL Console
- Default region now takes into account continent locality
- Improved Billing Usage page to display both billing and website units
Integrations changes
- DBT release v1.3.2
- Added experimental support for the delete+insert incremental strategy
- New s3source macro
- Python client v0.4.8
- File insert support
- Server-side query parameters binding
- Go client v2.5.0
- Reduced memory usage for compression
- Server-side query parameters binding
Reliability and performance
- Improved read performance for queries that fetch a large number of small files on object store
- Set the compatibility setting to the version with which the service is initially launched, for newly launched services
Bug fixes
Using the Advanced Scaling slider to reserve resources now takes effect right away.
December 20, 2022
This release introduces seamless logins for administrators to SQL console, improved read performance for cold reads, and an improved Metabase connector for ClickHouse Cloud.
Console changes
- Enabled seamless access to SQL console for admin users
- Changed default role for new invitees to "Administrator"
- Added onboarding survey
Reliability and performance
- Added retry logic for longer running insert queries to recover in the event of network failures
- Improved read performance of cold reads
Integrations changes
- The Metabase plugin got a long-awaited v0.9.1 major update. Now it is compatible with the latest Metabase version and has been thoroughly tested against ClickHouse Cloud.
December 6, 2022 - General Availability
ClickHouse Cloud is now production-ready with SOC2 Type II compliance, uptime SLAs for production workloads, and public status page. This release includes major new capabilities like AWS Marketplace integration, SQL console - a data exploration workbench for ClickHouse users, and ClickHouse Academy - self-paced learning in ClickHouse Cloud. Learn more in this blog.
Production-ready
- SOC2 Type II compliance (details in blog and Trust Center)
- Public Status Page for ClickHouse Cloud
- Uptime SLA available for production use cases
- Availability on AWS Marketplace
Major new capabilities
- Introduced SQL console, the data exploration workbench for ClickHouse users
- Launched ClickHouse Academy, self-paced learning in ClickHouse Cloud
Pricing and metering changes
- Extended trial to 30 days
- Introduced fixed-capacity, low-monthly-spend Development Services, well-suited for starter projects and development/staging environments
- Introduced new reduced pricing on Production Services, as we continue to improve how ClickHouse Cloud operates and scales
- Improved granularity and fidelity when metering compute
Integrations changes
- Enabled support for ClickHouse Postgres / MySQL integration engines
- Added support for SQL user-defined functions (UDFs)
- Advanced Kafka Connect sink to Beta status
- Improved Integrations UI by introducing rich meta-data about versions, update status, and more
Console changes
- Multi-factor authentication support in the cloud console
- Improved cloud console navigation for mobile devices
Documentation changes
- Introduced a dedicated documentation section for ClickHouse Cloud
Bug fixes
- Addressed known issue where restore from backup did not always work due to dependency resolution
November 29, 2022
This release brings SOC2 Type II compliance, updates the ClickHouse version to 22.11, and improves a number of ClickHouse clients and integrations.
General changes
- Reached SOC2 Type II compliance (details in blog and Trust Center)
Console changes
- Added an "Idle" status indicator to show that a service has been automatically paused
ClickHouse 22.11 version upgrade
- Added support for Hudi and DeltaLake table engines and table functions
- Improved recursive directory traversal for S3
- Added support for composite time interval syntax
- Improved insert reliability with retries on insert
- See the detailed 22.11 changelog for the complete list of changes
Integrations
- Python client: v3.11 support, improved insert performance
- Go client: fix DateTime and Int64 support
- JS client: support for mutual SSL authentication
- dbt-clickhouse: support for DBT v1.3
Bug fixes
- Fixed a bug that showed an outdated ClickHouse version after an upgrade
- Changing grants for the "default" account no longer interrupts sessions
- Newly created non-admin accounts no longer have system table access by default
Known issues in this release
- Restore from backup may not work due to dependency resolution
November 17, 2022
This release enables dictionaries from local ClickHouse table and HTTP sources, introduces support for the Mumbai region, and improves the cloud console user experience.
General changes
- Added support for dictionaries from local ClickHouse table and HTTP sources
- Introduced support for the Mumbai region
Console changes
- Improved billing invoice formatting
- Streamlined user interface for payment method capture
- Added more granular activity logging for backups
- Improved error handling during file upload
Bug fixes
- Fixed a bug that could lead to failing backups if there were single large files in some parts
- Fixed a bug where restores from backup did not succeed if access list changes were applied at the same time
Known issues
- Restore from backup may not work due to dependency resolution
November 3, 2022
This release removes read & write units from pricing (see the pricing page for details), updates the ClickHouse version to 22.10, adds support for higher vertical scaling for self-service customers, and improves reliability through better defaults.
General changes
- Removed read/write units from the pricing model
Configuration changes
- The settings
allow_suspicious_low_cardinality_types
,allow_suspicious_fixed_string_types
andallow_suspicious_codecs
(default is false) cannot be changed by users anymore for stability reasons.
Console changes
- Increased the self-service maximum for vertical scaling to 720GB memory for paying customers
- Improved the restore from backup workflow to set IP Access List rules and password
- Introduced waitlists for GCP and Azure in the service creation dialog
- Improved error handling during file upload
- Improved workflows for billing administration
ClickHouse 22.10 version upgrade
- Improved merges on top of object stores by relaxing the "too many parts" threshold in the presence of many large parts (at least 10 GiB). This enables up to petabytes of data in a single partition of a single table.
- Improved control over merging with the
min_age_to_force_merge_seconds
setting, to merge after a certain time threshold. - Added MySQL-compatible syntax to reset settings
SET setting_name = DEFAULT
. - Added functions for Morton curve encoding, Java integer hashing, and random number generation.
- See the detailed 22.10 changelog for the complete list of changes.
October 25, 2022
This release significantly lowers compute consumption for small workloads, lowers compute pricing (see pricing page for details), improves stability through better defaults, and enhances the Billing and Usage views in the ClickHouse Cloud console.
General changes
- Reduced minimum service memory allocation to 24G
- Reduced service idle timeout from 30 minutes to 5 minutes
Configuration changes
- Reduced max_parts_in_total from 100k to 10k. The default value of the
max_parts_in_total
setting for MergeTree tables has been lowered from 100,000 to 10,000. The reason for this change is that we observed that a large number of data parts is likely to cause a slow startup time of services in the cloud. A large number of parts usually indicates a choice of too granular partition key, which is typically done accidentally and should be avoided. The change of default will allow the detection of these cases earlier.
Console changes
- Enhanced credit usage details in the Billing view for trial users
- Improved tooltips and help text, and added a link to the pricing page in the Usage view
- Improved workflow when switching options for IP filtering
- Added resend email confirmation button to the cloud console
October 4, 2022 - Beta
ClickHouse Cloud began its public Beta on October 4th, 2022. Learn more in this blog.
The ClickHouse Cloud version is based on ClickHouse core v22.10. For a list of compatible features, refer to the Cloud Compatibility guide.